Transaction remote authorization method

Abstract

The invention provides a transaction remote authorization method, which is applied to a client, the client is in communication connection with a remote authorization end, and the transaction remote authorization comprises the following steps: in response to a first predetermined operation of a user, generating a video connection request and sending the video connection request to the remote authorization end, so that the remote authorization end generates a video signaling and sends the video signaling to the client, the video connection request is used for requesting to establish video connection with a remote authorization end, and the video signaling at least comprises a video connection address; and generating a remote authorization request and sending the remote authorization request to a remote authorization end, so that the remote authorization end obtains and displays the current user video of the client, and generates an authorization result in response to a second predetermined operation of the remote teller and sends the authorization result to the client. According to the invention, the risk of remote authorization of the financial transaction service is reduced.

Description

Technical Field

[0001] This application relates to the technical field of remote authorization for financial services. Specifically, it relates to a method for remote authorization of transactions. Background Art

[0002] Currently, self-service devices in financial institutions, such as ITMs (Intelligent Teller Machines) and STMs (Smart Teller Machines), are widely used in various financial institutions, greatly saving manpower at financial institution branches. Although many services can be self-handled by users at self-service devices, in cases of failed person authentication or certain services requiring teller authorization, tellers at the branch need to intervene for on-site review and authorization. At the same time, there is an uneven distribution of business workload among different branches and also within the same branch at different times. This can lead to a shortage of authorized personnel for ITM and STM devices at certain times in certain branches, affecting the efficiency and experience of customers in self-service transactions.

[0003] The current common solution is to send the business information to be reviewed or the image of the user operation interface to tellers at the local branch or remote tellers for review and authorization. However, it is difficult for remote tellers to accurately perceive the actual situation of customers through the method of reviewing images, thus increasing the risk of authorization operations; at the same time, there is also the problem of a shortage of remote tellers and long authorization queuing times. Summary of the Invention

[0004] The main objective of this application is to provide a method for remote authorization of transactions to at least solve the problem of high risk in remote authorization of financial transaction services in the prior art.

[0005] To achieve the above objective, according to one aspect of this application, a method for remote authorization of transactions is provided, which is applied to a client. The client is communicatively connected to a remote authorization end and includes: in response to a first predetermined operation of a user, generating a video connection request and sending it to the remote authorization end, so that the remote authorization end generates a video signaling and sends it to the client to establish a video connection with the client, where the video connection request is used to request to establish a video connection with the remote authorization end, and the video signaling includes at least a video connection address; generating a remote authorization request and sending it to the remote authorization end, so that the remote authorization end acquires and displays the current user video of the client, and generates an authorization result in response to a second predetermined operation of a remote teller and sends it to the client, where the remote authorization request is used to request the remote authorization end to perform remote authorization on a target transaction initiated by the user, the authorization result indicates whether to perform remote authorization on the target transaction, and the second predetermined operation is issued by the remote teller after reviewing the current user video.

[0006] Optionally, the client includes a first screen, a second screen, and a camera. After the remote authorization end generates a video signaling and sends it to the client to establish a video connection with the client, the method further includes: obtaining a real-time video picture of the user through the camera, obtaining a user service picture, and sending the real-time video picture of the user and the user service picture to the remote authorization end; receiving the remote real-time video picture sent by the remote authorization end and displaying the remote real-time video picture on the first screen; receiving the first predetermined operation of the user through the second screen.

[0007] Optionally, in response to the first predetermined operation of the user, generating a video connection request and sending it to the remote authorization end includes: generating a remote authorization inquiry instruction, sending the remote authorization inquiry instruction to the remote authorization end, so that the remote authorization end generates a reply message and sends the reply message to the client, where the remote authorization inquiry instruction is used to inquire whether the target transaction enables the remote authorization mode, and the reply message is information indicating whether the target transaction enables the remote authorization mode, and the remote authorization mode means a mode in which a remote teller at the remote authorization end authorizes the transaction; receiving the reply message sent by the remote authorization end, and in the case where the reply message indicates that the target transaction enables the remote authorization mode, in response to the predetermined operation of the user, generating the video connection request and sending it to the remote authorization end.

[0008] Optionally, after generating a remote authorization request and sending it to the remote authorization end, the method further includes: obtaining user data of the user, generating an authorization application document according to the user data, where the user data is image data representing the identity information of the user, and the authorization application document at least includes the user data and information about the target transaction initiated by the user; sending the authorization application document to the remote authorization end, so that the remote authorization end obtains and displays the authorization application document, and further enabling the remote teller to compare the current user video and the user data.

[0009] Optionally, after generating a video connection request and sending it to the remote authorization end, the method further includes: generating a remote teller call instruction, sending the remote teller call instruction to the remote authorization end, so that the remote authorization end assigns the remote teller and sends the real-time image picture of the remote teller to the client, where the remote teller is pre-registered at the remote authorization end.

[0010] To achieve the above object, according to one aspect of the present application, a method for remote authorization of transactions is provided, which is applied to a remote authorization end. The remote authorization end is communicatively connected to a client, and includes: receiving a video connection request sent by the client, generating a video signaling and sending it to the client to establish a video connection with the client, where the video connection request is generated in response to a first predetermined operation of a user and is used to request to establish a video connection with the remote authorization end, and the video signaling at least includes a video connection address; receiving a remote authorization request sent by the client, obtaining and displaying the current user video of the client, generating an authorization result in response to a second predetermined operation of a remote teller and sending it to the client, where the remote authorization request is used to request the remote authorization end to perform remote authorization on a target transaction initiated by the user, the authorization result indicates whether to perform remote authorization on the target transaction, and the second predetermined operation is issued by the remote teller after reviewing the current user video.

[0011] Optionally, the remote authorization end at least includes a first screen, a second screen, and a camera. After generating a video signaling and sending it to the client to establish a video connection with the client, the method further includes: receiving a user real-time video image and a user service image sent by the client, and displaying the user real-time video image on the first screen and the user service image on the second screen; obtaining a remote real-time video image through the camera and sending the remote real-time video image to the client.

[0012] Optionally, receiving the video connection request sent by the client includes: receiving a remote authorization inquiry instruction sent by the client, generating a reply message and sending the reply message to the client, so that the client generates a video connection request and sends it to the remote authorization end when the reply message indicates that the target transaction enables the remote authorization mode, where the remote authorization inquiry instruction is used to inquire whether the target transaction enables the remote authorization mode, the reply message is information indicating whether the target transaction enables the remote authorization mode, and the remote authorization mode means a mode in which a remote teller of the remote authorization end performs transaction authorization; receiving the video connection request sent by the client.

[0013] Optionally, after receiving the remote authorization request sent by the client, the method further includes: receiving an authorization application document sent by the client, where the authorization application document is obtained by the client from the user's user data and generated based on the user data, the user data is image data representing the user's identity information, and the authorization application document at least includes the user data and information about the target transaction initiated by the user; presenting the authorization application document to enable the remote teller to compare the current user video and the user data.

[0014] Optionally, after receiving the remote authorization request sent by the client, the method further includes: receiving a remote teller call instruction sent by the client, allocating the remote teller to the client, and sending the real-time image of the remote teller to the client, where the remote teller is pre-registered at the remote authorization end.

[0015] Applying the technical solution of the present application, in response to a first predetermined operation of the user, a video connection request is generated and sent to the remote authorization end, so that the remote authorization end generates a video signaling and sends it to the client to establish a video connection with the client. Then, a remote authorization request is generated and sent to the remote authorization end, so that the remote authorization end obtains and presents the current user video of the client, and generates an authorization result in response to a second predetermined operation of the remote teller and sends it to the client. Compared with the prior art, in the remote authorization process, static images of the user side are remotely reviewed to determine whether to authorize, but static images are difficult to accurately perceive the operation process and on-site environment of the customer in real time, resulting in security risks in remote review. In the present application, by establishing a video connection between the client and the remote authorization end, the remote teller reviews the current user video, and the client generates an authorization result and sends it to the client, thus completing the remote authorization process and improving the security of remote authorization. Therefore, it can alleviate the problem of high remote review risk in the prior art and reduce the risk of remote authorization for financial transaction services. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The accompanying drawings forming a part of this application are used to provide a further understanding of this application. The schematic embodiments and descriptions thereof of this application are used to explain this application and do not constitute an improper limitation of this application. In the drawings:

[0017] Figure 1 Shows a hardware structure block diagram of a mobile terminal for implementing a method for remote authorization of transactions provided by an embodiment of this application;

[0018] Figure 2 Shows a flowchart of a method for remote authorization of transactions provided by an embodiment of this application;

[0019] Figure 3Shows a schematic flowchart of another method for remote authorization of transactions provided by an embodiment of the present application;

[0020] Figure 4 Shows a specific method for remote authorization of transactions provided by an embodiment of the present application;

[0021] Figure 5 Shows an audio - video architecture diagram provided by an embodiment of the present application;

[0022] Figure 6 Shows a schematic diagram of a specific multi - screen display provided by an embodiment of the present application;

[0023] Figure 7 Shows a schematic diagram of a specific system interaction timing provided by an embodiment of the present application;

[0024] Figure 8 Shows a structural block diagram of a device for remote authorization of transactions provided by an embodiment of the present application.

[0025] Among them, the above - mentioned drawings include the following reference numerals:

[0026] 102, processor; 104, memory; 106, transmission device; 108, input / output device. Detailed implementation manners

[0027] It should be noted that, without conflict, the embodiments in the present application and the features in the embodiments may be combined with each other. The present application will be described in detail below with reference to the drawings and in combination with the embodiments.

[0028] In order to enable those skilled in the art to better understand the solution of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present application.

[0029] It should be noted that the terms "first", "second", etc. in the description, claims, and the above-mentioned drawings of this application are used to distinguish similar objects, and do not necessarily have to be used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so as to implement the embodiments of this application described here. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or are inherent to these processes, methods, products, or devices.

[0030] For the convenience of description, some nouns or terms related to the embodiments of this application are described below:

[0031] ITM: Intelligent Teller Machine, abbreviated as ITM, is a new type of self-service device launched by financial institutions. It is highly intelligent and has comprehensive functions, and can handle most non-cash transactions.

[0032] STM: Smart Teller Machine, abbreviated as STM. STM is also a self-service device with the non-cash transaction processing ability of ITM, and at the same time STM is also used to handle specific transactions.

[0033] WebRTC: An open-source real-time communication solution, which is a set of APIs that support web browsers for real-time audio and video.

[0034] As introduced in the background technology, in the prior art, during the remote authorization process, the static images of the user terminal are remotely reviewed to determine whether to authorize. However, static images are difficult to accurately perceive the customer's operation process and on-site environment in real time, resulting in security risks in remote review. To solve the problem of high risk in remote review authorization, the embodiments of this application provide a method for remote authorization of transactions.

[0035] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention.

[0036] The method embodiments provided in the embodiments of this application can be executed on a mobile terminal, a computer terminal, or a similar computing device. Taking running on a mobile terminal as an example, Figure 1 is a hardware structure block diagram of a mobile terminal of a method for remote authorization of transactions in an embodiment of the present invention. As Figure 1 shown, the mobile terminal may include one or more ( Figure 1Only one processor 102 (the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data are shown. Among them, the above mobile terminal may further include a transmission device 106 for communication functions and an input / output device 108. Those of ordinary skill in the art can understand that Figure 1 The structure shown is only schematic and does not limit the structure of the above mobile terminal. For example, the mobile terminal may further include more or fewer components than Figure 1 shown in, or have a different configuration from Figure 1 shown.

[0037] The memory 104 can be used to store computer programs. For example, software programs and modules of application software, such as the computer program corresponding to the transaction remote authorization method in the embodiments of the present invention. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, implements the above method. The memory 104 may include a high-speed random access memory and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memories, or other non-volatile solid-state memories. In some instances, the memory 104 may further include a memory remotely disposed relative to the processor 102, and these remote memories may be connected to the mobile terminal through a network. Examples of the above network include, but are not limited to, the Internet, an enterprise intranet, a local area network, a mobile communication network, and combinations thereof. The transmission device 106 is used to receive or send data via a network. Specific examples of the above network may include a wireless network provided by a communication provider of the mobile terminal. In one instance, the transmission device 106 includes a network adapter (Network Interface Controller, abbreviated as NIC), which can be connected to other network devices through a base station and thus can communicate with the Internet. In one instance, the transmission device 106 may be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0038] In this embodiment, a transaction remote authorization method running on a mobile terminal, a computer terminal, or a similar computing device is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order than here.

[0039] Figure 2 is a flowchart of the transaction remote authorization method according to an embodiment of the present application. As Figure 2As shown, it is applied to the client, and the client is communicatively connected to the remote authorization end. The method includes the following steps:

[0040] Step S201: In response to a first predetermined operation of the user, generate a video connection request and send it to the remote authorization end, so that the remote authorization end generates a video signaling and sends it to the client to establish a video connection with the client. Among them, the video connection request is used to request to establish a video connection with the remote authorization end, and the video signaling at least includes a video connection address;

[0041] Specifically, the client can be a self-service device (such as an ITM or an STM). When a customer encounters a situation that requires remote authorization while performing a certain transaction on the self-service device, the self-service device system will generate a video connection request in response to the customer's operation (the first predetermined operation), automatically trigger the remote authorization process, and send the video connection request to the remote authorization end (the remote authorization end). This request contains the basic information required to establish a video connection, such as the source of the request, the basic information of the customer, etc., but the core is the indication to establish a video connection with the remote authorization end. After receiving the video connection request, the remote authorization end will generate a video signaling containing the video connection address. The video connection address is data that uniquely identifies the video session between the remote teller and the self-service device, and it is implemented through real-time communication technologies such as WebRTC. The remote authorization end sends this video signaling back to the self-service device, which then parses the signaling, obtains the video connection address, and establishes two-way audio and video communication with the remote teller. The video signaling mainly includes the media information that needs to be exchanged between the two parties that need to establish a video, including media type, codec, network configuration, etc. The interaction of the video signaling is the exchange of audio and video media information between the customer and the remote teller ends, and this exchange is forwarded through the remote service center system. The establishment of two-way audio and video and screen mirroring between the client and the remote authorization end uses WebRTC technology, which can be built into the browser and can achieve real-time communication through the browser without using any plugins. The process of establishing a webrtc video is as follows: for the establishment of webrtc video, first, the media negotiation and network negotiation data exchange between the self-service device and the remote seat are carried out, and a WebSocket long connection session with the visitor-side browser and the seat-side browser is established through the developed video signaling gateway module. After the long connection session is established, the Session Description Protocol (SDP) is used to exchange the media codec protocols / network requirements / encryption, etc. supported by the self-service device and the seat device, and the network negotiation exchanges each other's network conditions, that is, the video signaling exchange, such as protocol family, IP, port, type, etc. After the exchange of media and network negotiation data. In addition, for the long connections of the visitor, the seat browser and the signaling service, through the random load balancing strategy implemented by nginx, in the case where the visitor and the seat browser are connected to different signaling servers, redis is used as the data bus to achieve communication between multiple signaling services.

[0042] Step S202: Generate a remote authorization request and send it to the remote authorization end, so that the remote authorization end obtains and displays the current user video of the client, and generates an authorization result in response to a second predetermined operation of the remote teller and sends it to the client, where the remote authorization request is used to request the remote authorization end to perform remote authorization on the target transaction initiated by the user, the authorization result indicates whether to perform remote authorization on the target transaction, and the second predetermined operation is issued by the remote teller after reviewing the current user video.

[0043] Specifically, when a customer on a self-service device (ITM, STM) makes a remote authorization request for a certain transaction, the self-service device system will generate a remote authorization request containing the customer's transaction information, the customer's real-time video, and the screen projection of the operation interface, and send it to the remote authorization end. After receiving the request, the remote authorization end automatically starts the video review platform and displays the customer's real-time video and the screen projection of the operation interface to the remote teller for review. During the review process, the remote teller generates an authorization result by clicking a specific authorization button (the second predetermined operation) according to the customer identity verification, operation compliance, etc. in the video. If the remote teller believes that the transaction is compliant and can be authorized, the system will generate a "authorization passed" result; otherwise, if there are problems with the transaction or it cannot be authorized, the system will generate an "authorization rejected" result. This authorization result is then fed back by the remote authorization end to the self-service device system to complete the remote authorization process.

[0044] Through this embodiment, in response to the user's first predetermined operation, a video connection request is generated and sent to the remote authorization end, so that the remote authorization end generates a video signaling and sends it to the client to establish a video connection with the client. Then, a remote authorization request is generated and sent to the remote authorization end, so that the remote authorization end obtains and displays the current user video of the client, and generates an authorization result in response to the second predetermined operation of the remote teller and sends it to the client. Compared with the prior art, in the remote authorization process, the static image of the remote audit user end is used to determine whether to authorize, but the static image is difficult to accurately perceive the customer's operation process and the on-site environment in real time, resulting in security risks in remote audit. In this application, by establishing a video connection between the client and the remote authorization end, the remote teller audits the current user video, and the client generates an authorization result and sends it to the client, thereby completing the remote authorization process and improving the security of remote authorization. Therefore, it can alleviate the problem of high remote audit risk in the prior art and reduce the risk of remote authorization for financial transaction services.

[0045] In the specific implementation process, the client includes a first screen, a second screen, and a camera. The above method further includes step S203: obtaining the user's real-time video image through the camera, and obtaining the user's service image, and sending the user's real-time video image and the user's service image to the remote authorization end; step S204: receiving the remote real-time video image sent by the remote authorization end and displaying the remote real-time video image on the first screen; step S205: receiving the first predetermined operation of the user through the second screen. This method realizes the real-time video transmission between the client and the remote authorization end through the above steps, enhances the sense of presence and interactivity in the remote authorization process, improves the accuracy and security of authorization, and at the same time optimizes the flexibility and convenience of operation.

[0046] Specifically, on the basis of existing devices (such as printers, ID scanners, fingerprint readers, signature pads, etc.) in the client (such as a self-service device terminal), a video screen (the first screen) and a camera are added. The remote teller video can be displayed on the upper screen of the self-service device, and at the same time, the user's live video and sound are transmitted to the remote authorization end. The specific positions can be: the camera is located above the first screen, and the second screen is located below the first screen. In the specific implementation process, other layout methods can also be used. When remote authorization is required, the camera on the self-service device captures the user's real-time video image. At the same time, the device obtains the interface image of the business currently being handled by the user through screen capture technology. These two pieces of video data are compressed and encoded and transmitted in real time through a secure network channel to the remote authorization end, providing an intuitive on-site operation environment and transaction details for the remote teller. In the specific implementation process, this process is called media stream forwarding. The Coturn media service is used to forward the audio and video communication media stream after the session has been established. Each terminal sends the audio and video stream it wants to share to the media server, and the media stream is forwarded through the Coturn media service, thus establishing two-way audio and video communication between the visitor end and the agent end. At the remote authorization end, after receiving the user's real-time video and business image from the self-service device, the remote authorization end of the remote teller presents them on the screen of the remote teller through the video display module. The remote teller can clearly observe the user's real-time operation situation and business processing interface, and thus make an accurate authorization judgment. At the same time, the first screen of the self-service device also receives and displays the real-time video image of the remote teller. This two-way video connection not only strengthens the interaction between the remote teller and the customer, making the authorization process more user-friendly, but also provides a real-time feedback mechanism for remote authorization. The customer can intuitively see the reaction of the remote teller, enhancing the sense of trust and security. In addition, the second screen of the self-service device is used to receive the user's predetermined operations, such as instructions for input, confirmation, or cancellation during the transaction authorization process. This design ensures the independence and security of the user's operations during the transaction authorization process, avoiding the leakage risk that may be brought about by the display of sensitive information through a single screen.

[0047] In some alternative embodiments, the above step S201 can be implemented through the following steps: Step S2011: Generate a remote authorization inquiry instruction, and send the remote authorization inquiry instruction to the remote authorization end, so that the remote authorization end generates a reply message and sends the reply message to the client. Among them, the remote authorization inquiry instruction is used to inquire whether the target transaction enables the remote authorization mode, and the reply message is information indicating whether the target transaction enables the remote authorization mode. The remote authorization mode means a mode in which a remote teller at the remote authorization end conducts transaction authorization; Step S2012: Receive the reply message sent by the remote authorization end. When the reply message indicates that the target transaction enables the remote authorization mode, in response to the user's predetermined operation, generate the video connection request and send it to the remote authorization end. This method conducts automated inquiry through the above steps and determines whether the target transaction enables the remote authorization mode, which not only improves the flexibility and security of remote authorization, but also enhances the user service experience.

[0048] Specifically, when a customer attempts to execute a certain transaction (target transaction) on a self-service device (ITM, STM) and the system detects that authorization is required, the self-service device system will automatically generate a remote authorization inquiry instruction. This inquiry instruction contains specific information about the target transaction, such as transaction type, transaction amount, etc., which is encrypted and sent to the remote authorization end. After receiving the inquiry instruction, the remote authorization end determines whether the target transaction enables the remote authorization mode based on internal preset rules or database queries. If the target transaction supports remote authorization, the remote authorization end generates an affirmative reply message indicating that the transaction can be authorized by the remote teller; otherwise, a negative reply message is generated, indicating that the transaction needs to follow an offline or other authorization path. The remote authorization end sends the reply message back to the self-service device system through a secure network channel. After receiving the reply message from the remote authorization end, the self-service device system will analyze the content of the message. If the reply message indicates that the target transaction has enabled the remote authorization mode, the system will enter a standby state, waiting for the user's further predetermined operation, such as pressing the authorization request button. Once it detects that the user has performed a predetermined operation, such as clicking a specified button to initiate the process of the target transaction that requires authorization, the self-service device system will immediately generate a video connection request and send it to the remote authorization end through a secure channel, triggering the remote authorization process.

[0049] In some other alternative embodiments, after generating a remote authorization request and sending it to the remote authorization end, the method further includes step S206: obtaining the user data of the user, generating an authorization application document according to the user data, where the user data is image data representing the user's identity information, and the authorization application document at least includes the user data and information about the target transaction initiated by the user; step S207: sending the authorization application document to the remote authorization end, so that the remote authorization end obtains and displays the authorization application document, and further enabling the remote teller to compare the current user video and the user data. By the above steps, the method automatically processes the user data and generates an authorization application document containing key information for the review by the remote authorization end, which not only improves the efficiency and compliance of remote authorization, but also optimizes the review process of the remote teller and strengthens the traceability of business operations.

[0050] In the specific implementation process, when the self-service device detects a transaction that requires remote authorization, while generating a video connection request, the system starts to collect user data, including but not limited to image data of the user's identity information (such as front and back scans of the ID card, on-site photos of the user, online verification results, etc.). These data are processed structurally and automatically filled into the authorization application document template to generate an authorization application document containing user identity verification information and detailed information about the target transaction. The camera and scanning device of the self-service device capture the user's ID card information, on-site photos of the user, etc.; perform OCR (Optical Character Recognition) processing on the image data to extract key information on the ID card, and at the same time perform facial recognition on the on-site photos of the user to ensure the integrity of the information; automatically fill the structured user data and target transaction information (such as transaction type, amount, time, etc.) into the preset authorization application document template; the system generates an authorization application document and digitally signs it to ensure the authenticity and integrity of the document; the authorization application document is sent to the remote authorization end through a secure network channel. After receiving the document in the authorization review system, the remote teller displays it for easy comparison by the remote teller to determine whether they are consistent. If they are consistent, authorization is performed; otherwise, authorization is not performed.

[0051] In some other alternative embodiments, after generating a video connection request and sending it to the remote authorization end, the method further includes step S208: generating a remote teller call instruction, sending the remote teller call instruction to the remote authorization end, so that the remote authorization end assigns the remote teller and sends the real-time image screen of the remote teller to the client, where the remote teller is pre-registered in the remote authorization end. By the above steps, the method assigns the remote teller, which can realize the intelligent scheduling of the remote teller and optimize the utilization of remote teller resources.

[0052] Specifically, when the self-service device system successfully generates a remote authorization request and sends it to the remote authorization end, the system will further trigger the generation of a remote teller call instruction. This instruction contains the demand information for the remote teller, such as transaction type, priority, etc., which is encrypted and sent to the remote authorization end through a secure network channel. After receiving the remote teller call instruction, the remote authorization end will automatically start the intelligent scheduling algorithm. This algorithm considers parameters such as the current status of the remote teller (such as whether they are busy), skill matching (whether they are familiar with a specific transaction type), and response time to select the most suitable remote teller for assignment. After being assigned a task, the device of the remote teller will immediately start the video signaling to establish a real-time image transmission connection with the self-service device. The real-time image of the remote teller is encoded into an efficient and secure video stream through WebRTC or similar technologies and transmitted to the first screen of the self-service device. This real-time image transmission ensures effective visual communication between the remote teller and the customer, enhancing the interactivity and affinity of remote authorization.

[0053] In the actual application process, before assigning a remote teller, the remote authorization end can first conduct inquiries and guidance through a digital human. That is, after establishing a video connection, first call the digital human (such as a virtual customer service) to establish a conversation with the digital human. The digital human and the user have a conversation to inquire and guide the user's operations. The virtual human is based on real-person videos and uses machine learning technology to build models for the human's speaking voice, lip movement, expression, and actions. By synthesizing the form and voice of the human image and using speech recognition and speech synthesis technologies to drive the digital human image, it presents a realistic and natural communication form. In terms of speech recognition, a dual-decoding technology is adopted. The high-frequency space is a space composed of SMLTA decoding, and the low-frequency space is a confusion sound space composed of CTC decoding, with a high generalization coverage. At the same time, a semantic nbest screening strategy is integrated to ultimately improve the recognition rate during the decoding process. In terms of speech synthesis, the synthesis of lip movement of the chin and face, high-precision texture synthesis are integrated, and the accuracy of lip movement naturalness is 98.40%. The process of establishing the digital human video is as follows:

[0054] 1) The self-service terminal device calls the digital human, and the routing module requests the digital employee system to allocate digital human resources according to the business volume and digital human resource situation, and returns the digital human audio-video push-pull stream address information;

[0055] 2) The terminal device and the digital teller service respectively push their own audio-video streams and pull the audio-video streams of each other from the media forwarding service;

[0056] 3) The media forwarding service establishes a business signaling forwarding channel between the two parties;

[0057] 4) The digital human broadcasts a welcome message and drives the business transaction process nodes to guide the customer to handle transactions, such as prompting the user to insert the card, confirming whether it is the user himself / herself, and guiding identity recognition operations;

[0058] 5) Identify the user's intention in real time and drive the transaction process, such as automatically opening the transaction process, transferring to an operator, hanging up, and consulting questions when identifying that the user is handling a transaction.

[0059] Figure 3 It is a flowchart of another remote authorization method for transactions according to an embodiment of the present application. As Figure 3 shown, it is applied to the remote authorization end, and the client is communicatively connected to the remote authorization end. The method includes the following steps:

[0060] Step S301: Receive the video connection request sent by the client, generate a video signaling and send it to the client to establish a video connection with the client. Wherein, the video connection request is generated in response to a first predetermined operation of the user and is used to request to establish a video connection with the remote authorization end, and the video signaling at least includes a video connection address;

[0061] Specifically, when the client (self-service device side) detects that the user has performed a first predetermined operation (such as clicking the remote authorization button), the system will automatically generate a video connection request. This request contains the necessary information for triggering remote authorization, such as user ID, transaction type, client device information, etc., and is sent to the remote authorization end through a secure network channel. After receiving the video connection request, the remote authorization end immediately starts the video signaling generation mechanism. Video signaling is a set of instructions for establishing a video connection, which contains the key video connection address. This address is the unique identifier for the remote teller to establish audio and video communication with the client. In addition, the video signaling may also contain information such as audio and video codec parameters, network transmission protocols, encryption methods, etc., to ensure the quality and security of audio and video communication. The remote authorization end then sends the generated video signaling back to the client through a secure channel. After the client parses the video signaling, it uses the video connection address to establish two-way audio and video communication with the remote authorization end. This process is usually implemented through WebRTC technology, which allows browsers to establish real-time audio and video connections without any plugins, improving the convenience and security of the entire communication.

[0062] Step S302: Receive the remote authorization request sent by the client, obtain and display the current user video of the client, generate an authorization result in response to a second predetermined operation of the remote teller and send it to the client. Wherein, the remote authorization request is used to request the remote authorization end to perform remote authorization on the target transaction initiated by the user, the authorization result indicates whether to perform remote authorization on the target transaction, and the second predetermined operation is issued by the remote teller after reviewing the current user video.

[0063] Specifically, when the remote authorization terminal receives a remote authorization request sent by a self-service device (client), the system first parses the request information to obtain the details of the target transaction, including key data such as transaction type, amount, timestamp, etc. Immediately afterwards, the remote authorization terminal will start the video review platform, pull the real-time video stream of the user captured by the camera on the self-service device, and display it on the video review interface of the remote teller. This operation enables the remote teller to observe and analyze the customer's behavior, expression, and environment to judge the authenticity of the customer's identity and the compliance of the transaction. The remote teller conducts the review on the video review platform based on the displayed real-time video of the user. If the remote teller believes that the transaction is compliant and the customer's identity is real, the "Authorize Pass" button (the second predetermined operation) can be clicked, and the system will record this operation and generate an authorization result of "Authorize Pass"; conversely, if there are problems with the transaction or doubts about the customer's identity, the remote teller can click the "Authorize Reject" button, and the system will generate an authorization result of "Authorize Reject". The authorization result will be accompanied by the review opinion of the remote teller for subsequent business review or dispute handling. After generating the authorization result, the remote authorization terminal will feedback the authorization result to the self-service device (client) through a secure network channel. After receiving the authorization result information, the self-service device will perform subsequent operations according to the result. For example, if "Authorize Pass", the transaction process will continue; if "Authorize Reject", the user will be prompted to switch to on-site review or other processing methods.

[0064] In some alternative embodiments, the remote authorization terminal at least includes a first screen, a second screen, and a camera. After generating a video signal and sending it to the client to establish a video connection with the client, the method further includes step 303: receiving the real-time video image of the user and the user service image sent by the client, and displaying the real-time video image of the user on the first screen and the user service image on the second screen; step 304: obtaining a remote real-time video image through the camera and sending the remote real-time video image to the client. By displaying the customer video and service images in real time, as well as the feedback of the remote teller video, this method not only improves the efficiency and security of remote authorization, but also optimizes the working environment of the remote teller.

[0065] Specifically, the remote authorization terminal can also be called the agent terminal. The agent terminal adds an agent video screen (the first screen) and a camera on the basis of the existing counter system. The agent video screen displays the business projection screen of the self-service device, the videos of the customer and the teller. At the same time, the camera captures the teller's image and transmits it to the video screen (the second screen) of the self-service device. The original agent business screen displays the business authorization document. When the remote authorization center successfully generates a video signaling and sends it to the client, and establishes a video connection with the client, the remote authorization terminal will receive the real-time video image of the user and the user business image transmitted by the client. The real-time video image of the user, that is, the real-time video stream of the customer in front of the self-service device, will be displayed on the first screen (remote video display screen) of the remote authorization terminal, enabling the remote teller to clearly observe the customer's behavior, expression and the surrounding environment, verify the customer's identity, and judge the security of the transaction environment. The user business image, that is, the projection of the transaction interface or the user operation interface currently displayed on the self-service device, will be displayed on the second screen (business operation and monitoring screen) of the remote authorization terminal. This image provides the remote teller with a complete view of the transaction details, such as the transaction type, amount, time, and the information entered by the user, etc., which is the direct basis for the remote teller to conduct transaction review. At the same time, the camera of the remote authorization terminal starts to work, capturing the real-time video image of the remote teller. This video stream is encoded into an efficient and secure format and sent back to the client through WebRTC or similar real-time communication technology, and is displayed on the video screen of the client, realizing the face-to-face interaction between the remote teller and the customer, and enhancing the service experience and trust.

[0066] In some alternative embodiments, the above step S301 can be implemented through the following steps: Step S3011: Receive the remote authorization inquiry instruction sent by the client, generate a reply message and send the reply message to the client, so that the client generates a video connection request and sends it to the remote authorization terminal when the reply message indicates that the remote authorization mode is enabled for the target transaction. Wherein, the remote authorization inquiry instruction is used to inquire whether the remote authorization mode is enabled for the target transaction, the reply message is the information indicating whether the remote authorization mode is enabled for the target transaction, and the remote authorization mode means the mode in which the remote teller of the remote authorization terminal conducts transaction authorization; Step S3012: Receive the video connection request sent by the client. This method effectively integrates the resources of the self-service device and the remote authorization center through the processing flow of remote authorization inquiry and video connection request.

[0067] In the specific implementation process, when a user attempts to execute a target transaction on a self-service device and the transaction requires remote authorization, the self-service device sends a remote authorization inquiry instruction to the remote authorization center. This instruction carries the basic information of the target transaction and is used to inquire whether the transaction supports the remote authorization mode. After receiving the remote authorization inquiry instruction, the remote authorization center queries its internal database or configuration rules to determine whether the target transaction has indeed enabled the remote authorization mode. If it is supported, an affirmative reply message is generated indicating that remote authorization can be performed; if it is not supported, a negative reply message is generated indicating that authorization cannot be performed remotely. These reply messages are sent back to the client in a timely manner. After receiving the reply message from the remote authorization center, if the message indicates that the target transaction has enabled the remote authorization mode, the self-service device will enter a waiting state until the user performs the first predefined operation - usually pressing a dedicated "remote authorization" button. This triggers the generation and sending of a video connection request to establish a video connection with the remote authorization center. The remote authorization center receives and processes the video connection request in step S3012. The system automatically or after confirmation by a remote teller generates video signaling, including information such as the video connection address, for establishing a video connection with the client. The establishment of this connection is the key to the remote authorization process, ensuring the smoothness of subsequent real-time video transmission.

[0068] In some alternative embodiments, after receiving the remote authorization request sent by the client, the method further includes step S306: receiving an authorization application document sent by the client, where the authorization application document is obtained by the client from the user's user data and generated based on the user data, the user data being image data representing the user's identity information, and the authorization application document at least including the user data and information about the target transaction initiated by the user; step S307: displaying the authorization application document to enable the remote teller to compare the current user video and the user data. This method ensures the security and accuracy of the remote authorization operation by the remote authorization center receiving and displaying the authorization application document and the remote teller performing video comparison verification of the user identity, while also optimizing the identity verification process and enhancing the customer experience and trust.

[0069] Specifically, when the remote authorization center receives a remote authorization request sent by the client, the client will simultaneously generate and send an authorization application document. This document contains the image data of the user's identity information and the detailed information of the target transaction. After the authorization application document is received by the remote authorization center, it will be parsed and associated with the real-time video image of the user being presented. The system of the remote authorization center will automatically push the display interface of the authorization application document to the interface of the remote teller, so that the remote teller can view the user's identity information and transaction details in detail. When conducting video review, the remote teller will compare the image of the user's identity information in the authorization application document with the user in the current user video image. This process may include comparing the user's facial features, identity documents, and any specific authentication information related to the transaction. Through video comparison, the remote teller can confirm the authenticity of the user's identity and whether it matches the information in the authorization application document.

[0070] In some alternative embodiments, after receiving the remote authorization request sent by the client, the method further includes step S308: receiving a remote teller call instruction sent by the client, allocating the remote teller to the client, and sending the real-time image of the remote teller to the client, wherein the remote teller is pre-registered at the remote authorization end. This method optimizes the scheduling of remote tellers through the above, enhancing the user's trust and sense of participation.

[0071] In the specific implementation process, when the remote authorization center receives a remote authorization request sent by the client, the next step is to receive the authorization application document from the client. The authorization application document contains the image data of the user's identity information and the specific target transaction information initiated by the user, and is an important basis for the remote teller to conduct identity verification and transaction review. These data are transmitted to the remote authorization center through an encrypted channel, ensuring the security of the information. After receiving the authorization application document, the remote authorization center presents it to the remote teller on standby. The desktop interface of the remote teller will display the content of the user's real-time video stream and the authorization application document, enabling the remote teller to simultaneously observe the user's real-time video, compare it with the user data in the authorization application document, and conduct detailed identity verification and transaction verification. This process ensures the accuracy and security of remote authorization. When the remote teller is ready to conduct the review, the remote authorization center dynamically allocates the remote teller and associates it with the registered information, establishing a real-time image connection between the remote teller and the client. The real-time image of the remote teller is encoded and transmitted through WebRTC or similar technologies, ensuring high-quality video calls and enhancing the sense of interaction between the remote teller and the user. At the same time, the client will also display the real-time image of the remote teller, forming a "face-to-face" authorization scenario and enhancing the user experience.

[0072] In order to enable those skilled in the art to more clearly understand the technical solution of this application, the implementation process of the transaction remote authorization method of this application will be described in detail below in combination with specific embodiments.

[0073] This embodiment relates to a specific transaction remote authorization method. As Figure 4 shown, it includes the following steps:

[0074] Step S1: The self-service device (client) triggers an authorization request during the transaction process and determines whether the transaction remote authorization is enabled. If it is not enabled, the on-site review and authorization by the teller at the branch will be carried out. If it is enabled, a remote authorization will be initiated, and an automatic initiation and a remote video request will be made;

[0075] Step S2: Prioritize routing to call the digital teller (digital human), establish a dialogue with the digital teller, and the digital teller and the user have a dialogue, including asking questions and guiding the user to perform preparatory operations before authorization;

[0076] Step S3: Initiate a video request with the remote teller (remote authorization end). The routing system automatically assigns an idle remote teller and determines whether the assignment is successful. In the case of success, establish a video and screen projection between the visitor and the remote teller and perform video recording. In the case of failure, call the queue and try to assign a remote teller again; The audio and video architecture diagram is as Figure 5 shown. The visitor browser and the agent browser are respectively set with the WebRTC audio and video SDK. A WebSocket long connection session is established with the visitor browser and the agent browser through the developed video signaling gateway module. After the long connection session is established, the Session Description Protocol (SDP) is used to exchange the video signaling of the self-service device and the agent device, that is, the supported media codec protocol / network requirements / encryption, etc. The network negotiates and exchanges each other's network conditions, such as protocol clusters, IPs, ports, types, etc. After the exchange of media and network negotiation data, the Coturn media service is responsible for forwarding the audio and video communication media streams after the session has been established. Each terminal sends the audio and video streams to be shared to the media server, and the media streams are forwarded through the Coturn media service, thereby establishing two-way audio and video communication between the visitor side and the agent side. In addition, for the long connections of the visitor, the agent browser and the signaling service, a random load balancing strategy implemented by nginx is adopted. In the case where the visitor and the agent browser are connected to different signaling servers, redis is used as the data bus to realize the communication between multiple signaling services;

[0077] Step S4: The self-service device initiates a remote authorization request and transfers the authorized business application pdf document (business authorization application document), and the document includes photos of the front and back of the ID card, the ID card photo, the customer on-site photo, and transaction information, etc.;

[0078] Step S5: The remote teller receives an authorization request in the authorization system, and a pop-up window displays the business application document. The remote teller authorizes based on the business application form, the on-site customer image, and the screen projection of the customer's business operation interface;

[0079] Step S6: The self-service device receives the authorization result from the remote teller, and determines whether the authorization result authorizes this transaction. If so, if the authorization is passed, the self-service device continues with the subsequent steps of the transaction. If the authorization fails, the branch teller conducts on-site review and authorization.

[0080] This embodiment relates to a specific multi-screen display schematic diagram, as Figure 6 shown, the self-service device (client) includes a remote teller video screen (the first screen of the client), a business screen (the second screen of the client), and a camera. The seat end includes a seat video screen and a seat business screen (the second screen of the remote authorization end), as well as a camera. The seat video screen includes the screen projection of the self-service device, the remote teller video, and the customer video (the first screen of the remote authorization end).

[0081] This embodiment also relates to a specific system interaction timing diagram, as Figure 7 shown, in addition to involving the self-service device system (client) and the business handling system (remote authorization end), it also includes intermediate processing systems such as a remote service system, a file management system, and a digital teller system, including the following steps:

[0082] Step S6: The remote teller logs in to the business handling system in advance and registers as an idle teller with the remote service system;

[0083] Step S7: The customer conducts a transaction on the self-service device, enters the transaction process that requires authorization, and queries the remote service center system to determine whether the transaction supports remote authorization;

[0084] Step S8: If the transaction enables remote authorization, the self-service device initiates an audio and video connection request with the remote teller, requests the remote service center system to allocate a digital teller, the digital employee system allocates digital human resources, and returns the push stream address of the digital human video;

[0085] Step S9: The self-service device end pulls up the video from the push stream address and establishes a video conversation with the digital employee;

[0086] Step S10: The self-service device sends transaction information to drive the digital human in this transaction process, such as prompting the user to take a photo, insert a card, asking the customer to confirm information, etc. At the same time, the digital human conducts intent recognition by identifying the user's voice to drive the process, helping the customer complete the information confirmation and guidance work before remote teller authorization;

[0087] Step S11: Request the remote service center system to allocate an idle remote teller;

[0088] Step S12: After matching an idle remote teller, display a ringing animation in the business processing system;

[0089] Step S13: After the remote teller clicks to answer, the customer completes video signaling interaction with the remote teller through the remote service center system, and establishes a video and screen mirroring connection;

[0090] Step S14: The self-service device system synthesizes identity and business review image files and uploads them to the file management system, including the customer's ID card information, network verification results, ID card photo, on-site photos, and scanned images of the front and back of the ID card. Send an authorization notice transaction to the business processing system through the remote service center system with the review file index number;

[0091] Step S15: After receiving the self-service device authorization request, the business processing system downloads the business documents from the file management system through the review file index number and displays them. After the remote teller reviews, perform fingerprint or token authorization;

[0092] Step S16: The business processing system notifies the self-service system of the authorization result;

[0093] Step S17: After the self-service device receives the authorization result, judge remote authorization. If it is rejected, the transaction ends; if it passes, continue the transaction process.

[0094] The embodiment of the present application also provides a transaction remote authorization device. It should be noted that the transaction remote authorization device in the embodiment of the present application can be used to execute the transaction remote authorization method provided by the embodiment of the present application. This device is used to implement the above-mentioned embodiments and preferred implementation manners, and those that have been described will not be repeated. As used below, the term "module" can be a combination of software and / or hardware that can achieve a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware is also possible and contemplated.

[0095] The following introduces the transaction remote authorization device provided by the embodiment of the present application.

[0096] Figure 8 It is a schematic diagram of the transaction remote authorization device according to the embodiment of the present application. As Figure 8 shown, it is applied to the client, and the client is communicatively connected to the remote authorization end. The device includes:

[0097] The first generation unit 10 is configured to generate a video connection request in response to a first predetermined operation of the user and send it to the remote authorization end, so that the remote authorization end generates video signaling and sends it to the client to establish a video connection with the client. Wherein, the video connection request is used to request to establish a video connection with the remote authorization end, and the video signaling includes at least a video connection address;

[0098] Specifically, the client can be a self-service device (such as an ITM or an STM). When a customer encounters a situation that requires remote authorization while performing a certain transaction on the self-service device, the self-service device system will generate a video connection request in response to the customer's operation (the first predetermined operation), automatically trigger the remote authorization process, and send the video connection request to the remote authorization end (the remote authorization end). This request contains the basic information required to establish a video connection, such as the source of the request, the customer's basic information, etc., but the core lies in the indication to establish a video connection with the remote authorization end. After receiving the video connection request, the remote authorization end will generate a video signaling containing the video connection address. The video connection address is data that uniquely identifies the video session between the remote teller and the self-service device, and it is implemented through real-time communication technologies such as WebRTC. The remote authorization end sends this video signaling back to the self-service device, which then parses the signaling, obtains the video connection address, and establishes two-way audio and video communication with the remote teller. The video signaling mainly includes the media information that needs to be exchanged between the two parties that need to establish a video, including media type, codec, network configuration, etc. The interaction of the video signaling is the exchange of audio and video media information that needs to be completed between the customer and the remote teller ends, and this exchange is forwarded through the remote service center system. The establishment of two-way audio and video and screen mirroring between the client and the remote authorization end uses WebRTC technology, which can be built into the browser and can achieve real-time communication through the browser without using any plugins. The process of establishing a webrtc video is as follows: for the establishment of webrtc video, first, the media negotiation and network negotiation data exchange between the self-service device and the remote seat are carried out, and a WebSocket long connection session with the visitor's browser and the seat's browser is established through the developed video signaling gateway module. After the long connection session is established, the Session Description Protocol (SDP) is used to exchange the media codec protocols / network requirements / encryption, etc. supported by the self-service device and the seat device, and the network negotiation exchanges each other's network conditions, that is, the video signaling exchange, such as protocol family, IP, port, type, etc. After the exchange of media and network negotiation data. In addition, for the long connections of the visitor, the seat browser and the signaling service, through the random load balancing strategy implemented by nginx, in the case where the visitor and the seat browser are connected to different signaling servers, redis is used as the data bus to achieve communication between multiple signaling services.

[0099] A second generation unit 20, configured to generate a remote authorization request and send it to the remote authorization terminal, so that the remote authorization terminal acquires and displays the current user video of the client, and generates an authorization result in response to a second predetermined operation of a remote teller and sends it to the client, where the remote authorization request is used to request the remote authorization terminal to perform remote authorization on a target transaction initiated by the user, the authorization result indicates whether to perform remote authorization on the target transaction, and the second predetermined operation is issued by the remote teller after reviewing the current user video.

[0100] Specifically, when a customer on a self-service device (ITM, STM) makes a remote authorization request for a certain transaction, the self-service device system will generate a remote authorization request containing customer transaction information, the customer's real-time video, and the operation interface screen projection, and send it to the remote authorization terminal. After receiving the request, the remote authorization terminal automatically starts the video review platform and displays the customer's real-time video and the operation interface screen projection to the remote teller for review. During the review process, the remote teller generates an authorization result by clicking a specific authorization button (the second predetermined operation) based on the customer identity verification, operation compliance, etc. in the video. If the remote teller believes that the transaction is compliant and can be authorized, the system will generate a "authorization passed" result; otherwise, if there are problems with the transaction or it cannot be authorized, the system will generate a "authorization rejected" result. This authorization result is then fed back by the remote authorization terminal to the self-service device system to complete the remote authorization process.

[0101] In this embodiment, in response to the user's first predetermined operation, a video connection request is generated and sent to the remote authorization terminal, so that the remote authorization terminal generates a video signaling and sends it to the client to establish a video connection with the client. Then, a remote authorization request is generated and sent to the remote authorization terminal, so that the remote authorization terminal acquires and displays the current user video of the client, and generates an authorization result in response to the second predetermined operation of the remote teller and sends it to the client. Compared with the prior art, in the remote authorization process, the static image of the user terminal is remotely reviewed to determine whether to authorize, but the static image is difficult to accurately perceive the customer's operation process and on-site environment in real time, resulting in security risks in remote review. In this application, by establishing a video connection between the client and the remote authorization terminal, the remote teller reviews the current user video, and the client generates an authorization result and sends it to the client, thereby completing the remote authorization process and improving the security of remote authorization. Therefore, it can alleviate the problem of high remote review risk in the prior art and reduce the risk of remote authorization for financial transaction services.

[0102] In the specific implementation process, the client includes a first screen, a second screen, and a camera. The above method further includes a sending unit, a display unit, and a receiving unit. The sending unit is configured to obtain the user's real-time video image through the camera, obtain the user's service image, and send the user's real-time video image and the user's service image to the remote authorization end; the display unit is configured to receive the remote real-time video image sent by the remote authorization end and display the remote real-time video image on the first screen; the receiving unit is configured to receive the first predetermined operation of the user through the second screen. This method realizes the real-time video transmission between the client and the remote authorization end through the above steps, enhances the sense of presence and interactivity in the remote authorization process, improves the accuracy and security of authorization, and at the same time optimizes the flexibility and convenience of operation.

[0103] Specifically, a video screen (first screen) and a camera are added to the existing equipment (printer, ID card scanner, fingerprint scanner, signature board, etc.) of the client (such as a self-service device terminal), and the remote teller video can be displayed on the upper screen of the self-service device, and the user's on-site real-time picture and sound can be transmitted to the remote authorization end. The specific position can be: the camera is located above the first screen, and the second screen is located below the first screen. In the specific implementation process, other arrangements can also be used. When remote authorization is required, the camera on the self-service device captures the user's real-time video screen, and at the same time, the device obtains the interface screen of the user's current business through screen capture technology. These two-way picture data are compressed and encoded, and transmitted to the remote authorization end in real time through a secure network channel, providing the remote teller with an intuitive on-site operating environment and transaction details. In the specific implementation process, this process is called media stream forwarding, and the Coturn media service is used to forward the audio and video communication media stream after the session has been established. Each terminal sends the audio and video stream to be shared to the media server, and the media stream is forwarded through the Coturn media service, thereby establishing two-way audio and video communication between the visitor end and the seat end. At the remote authorization end, after the remote teller's remote authorization end receives the user's real-time video and business screen from the self-service device, it is presented on the remote teller's screen through the video display module. The remote teller can clearly observe the user's real-time operation and business processing interface, so as to make accurate authorization judgments. At the same time, the first screen of the self-service device also receives and displays the real-time video screen of the remote teller. This two-way video connection not only strengthens the interaction between the remote teller and the customer, making the authorization process more humane, but also provides a real-time feedback mechanism for remote authorization. Customers can intuitively see the remote teller's response, which enhances their sense of trust and security. In addition, the second screen of the self-service device is used to receive the user's predetermined operations, such as the user's input, confirmation or cancellation instructions during the transaction authorization process. This design ensures the independence and security of user operations during the transaction authorization process, and avoids the risk of leakage caused by the display of sensitive information on a single screen.

[0104] In some alternative embodiments, the above first generation unit includes a sending module and a generating module. The sending module is configured to generate a remote authorization inquiry instruction, send the remote authorization inquiry instruction to the remote authorization end, so that the remote authorization end generates a reply message and sends the reply message to the client. Wherein, the remote authorization inquiry instruction is used to inquire whether the target transaction enables the remote authorization mode, and the reply message is information indicating whether the target transaction enables the remote authorization mode. The remote authorization mode represents a mode in which a remote teller at the remote authorization end conducts transaction authorization; the generating module is configured to receive the reply message sent by the remote authorization end, and in the case that the reply message indicates that the target transaction enables the remote authorization mode, in response to the predetermined operation of the user, generate the video connection request and send it to the remote authorization end. This method automatically inquires and determines whether the target transaction enables the remote authorization mode through the above steps, which not only improves the flexibility and security of remote authorization, but also enhances the user service experience.

[0105] Specifically, when a customer attempts to execute a certain transaction (target transaction) on a self-service device (ITM, STM) and the system detects that authorization is required, the self-service device system will automatically generate a remote authorization inquiry instruction. This inquiry instruction contains specific information about the target transaction, such as transaction type, transaction amount, etc., and is encrypted and sent to the remote authorization end. After receiving the inquiry instruction, the remote authorization end determines whether the target transaction enables the remote authorization mode based on internal preset rules or database queries. If the target transaction supports remote authorization, the remote authorization end generates an affirmative reply message indicating that the transaction can be authorized by the remote teller; otherwise, a negative reply message is generated indicating that the transaction needs to follow an offline or other authorization path. The remote authorization end sends the reply message back to the self-service device system through a secure network channel. After receiving the reply message from the remote authorization end, the self-service device system will analyze the content of the message. If the reply message indicates that the target transaction has enabled the remote authorization mode, the system will enter a standby state, waiting for further predetermined operations by the user, such as pressing the authorization request button. Once it detects that the user has performed a predetermined operation, such as clicking a specified button to initiate the process of the target transaction that requires authorization, the self-service device system will immediately generate a video connection request and send it to the remote authorization end through a secure channel to trigger the remote authorization process.

[0106] In some other alternative embodiments, after generating a remote authorization request and sending it to the remote authorization terminal, the method further includes a third generation unit and a first sending unit. The third generation unit is configured to obtain the user data of the user and generate an authorization application document according to the user data, where the user data is image data representing the user's identity information, and the authorization application document at least includes the user data and information about the target transaction initiated by the user; the sending unit is configured to send the authorization application document to the remote authorization terminal, so that the remote authorization terminal obtains and displays the authorization application document, and further enables the remote teller to compare the current user video and the user data. By automatically processing the user data and generating an authorization application document containing key information through the above steps for the review by the remote authorization terminal, this method not only improves the efficiency and compliance of remote authorization, but also optimizes the review process of the remote teller and strengthens the traceability of business operations.

[0107] In the specific implementation process, when the self-service device detects a transaction that requires remote authorization, while generating a video connection request, the system starts to collect user data, including but not limited to image data of the user's identity information (such as front and back scans of the ID card, on-site photos of the user, online verification results, etc.). This data is processed in a structured manner and automatically filled into the authorization application document template to generate an authorization application document containing user identity verification information and detailed information about the target transaction. The camera and scanning device of the self-service device capture the user's ID card information, on-site photos of the user, etc.; perform OCR (Optical Character Recognition) processing on the image data to extract key information on the ID card, and at the same time perform facial recognition on the on-site photos of the user to ensure the integrity of the information; automatically fill the structured user data and target transaction information (such as transaction type, amount, time, etc.) into the preset authorization application document template; the system generates an authorization application document and digitally signs it to ensure the authenticity and integrity of the document; the authorization application document is sent to the remote authorization terminal through a secure network channel. After receiving the document in the authorization review system, the remote teller displays it to facilitate the remote teller to make a comparison and determine whether they are consistent. If they are consistent, authorization is granted; otherwise, authorization is not granted.

[0108] In some other alternative embodiments, after generating a video connection request and sending it to the remote authorization terminal, the method further includes a first sending unit, which is configured to generate a remote teller call instruction and send the remote teller call instruction to the remote authorization terminal, so that the remote authorization terminal allocates the remote teller and sends the real-time image of the remote teller to the client, where the remote teller is pre-registered in the remote authorization terminal. By allocating the remote teller through the above steps, this method can achieve intelligent scheduling of the remote teller and optimize the utilization of remote teller resources.

[0109] Specifically, when the self-service device system successfully generates a remote authorization request and sends it to the remote authorization end, the system will further trigger the generation of a remote teller call instruction. This instruction contains the demand information for the remote teller, such as transaction type, priority, etc., which is encrypted and sent to the remote authorization end through a secure network channel. After the remote authorization end receives the remote teller call instruction, it will automatically start the intelligent scheduling algorithm. The algorithm takes into account parameters such as the current status of the remote teller (such as whether it is busy), skill matching (whether it is familiar with a specific transaction type), and response time to select the most suitable remote teller for assignment. After the remote teller is assigned a task, his device will immediately start video signaling and establish a real-time image transmission connection with the self-service device. The real-time image screen of the remote teller is encoded into an efficient and secure video stream through WebRTC or similar technologies and transmitted to the first screen of the self-service device. This real-time image transmission ensures effective visual communication between the remote teller and the customer, and enhances the interactivity and affinity of remote authorization.

[0110] In actual application, before assigning a remote teller, the remote authorization end can first inquire and guide through the digital human. That is, after establishing a video connection, first call the digital human (such as a virtual customer service) to establish a dialogue with the digital human. The digital human and the user have a dialogue, inquiring and guiding the user's operation. Based on real-life video recordings, the virtual human uses machine learning technology to build a model of human speech, lip movements, expressions and actions. By synthesizing the shape and sound of the portrait, the digital human image is driven by speech recognition and speech synthesis technology, making it present a realistic and natural communication form. In terms of speech recognition, dual decoding technology is used. The high-frequency space is the space formed by SMLTA decoding, and the low-frequency space is the confusing sound space formed by CTC decoding. It has high generalization coverage and integrates the semantic nbest screening strategy to ultimately improve the recognition rate of the decoding process. In terms of speech synthesis, the lip movement synthesis of the chin and face is integrated, and the high-precision texture synthesis is integrated, and the accuracy rate of lip movement naturalness is 98.40%. The process of establishing a digital human video is as follows:

[0111] 1) The self-service terminal device calls the digital human, and the routing module requests the digital employee system to allocate digital human resources according to the business volume and digital human resource situation, and returns the address information of the digital human audio and video push and pull streams;

[0112] 2) The terminal device and the digital teller service each push their own audio and video streams from the media forwarding service and pull the other party's audio and video streams;

[0113] 3) Establishing a business signaling forwarding channel between the two parties in the media forwarding service;

[0114] 4) The digital human broadcasts the welcome message and drives the nodes of the business transaction process to guide the customer to handle the transaction, such as prompting the user to insert the card, confirming whether it is the user himself / herself, guiding the identity recognition operation, etc.;

[0115] 5) Identify the user's intention in real time and drive the transaction process, such as automatically opening the transaction process, transferring to an artificial agent, hanging up, and consulting questions when identifying that the user is handling a transaction.

[0116] The transaction remote authorization device includes a processor and a memory. The above first generation unit, second generation unit, etc. are all stored in the memory as program units, and the corresponding functions are realized by the processor executing the above program units stored in the memory. The above modules are all located in the same processor; or, the above modules are respectively located in different processors in any combination form.

[0117] The processor contains a kernel, and the kernel retrieves the corresponding program unit from the memory. One or more kernels can be set, and the risk of remote authorization for financial transaction services is reduced by adjusting the kernel parameters.

[0118] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of, for example, read-only memory (ROM) or flash memory (flash RAM), and the memory includes at least one storage chip.

[0119] Obviously, those skilled in the art should understand that the above modules or steps of the present invention can be implemented by a general-purpose computing device. They can be concentrated on a single computing device or distributed on a network composed of multiple computing devices. They can be implemented by program code executable by the computing device. Thus, they can be stored in a storage device and executed by the computing device. And in some cases, the steps shown or described can be executed in a different order than here, or they can be separately made into individual integrated circuit modules, or multiple modules or steps among them can be made into a single integrated circuit module to implement. In this way, the present invention is not limited to any specific combination of hardware and software.

[0120] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0121] This application is described with reference to the flowcharts and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It should be understood that each flow and / or block in the flowchart and / or block diagram, and the combination of flows and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing device to generate a machine, such that the instructions executed by the processor of the computer or other programmable data processing device produce means for implementing the functions specified in one process Figure 1 one process or multiple processes and / or blocks Figure 1 or means for implementing the functions specified in multiple blocks.

[0122] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, such that the instructions stored in the computer-readable memory produce a manufactured article including instruction means that implement the functions specified in one process Figure 1 one process or multiple processes and / or blocks Figure 1 or means for implementing the functions specified in multiple blocks.

[0123] These computer program instructions can also be loaded onto a computer or other programmable data processing device, such that a series of operation steps are executed on the computer or other programmable device to generate a computer-implemented process, so that the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one process Figure 1 one process or multiple processes and / or blocks Figure 1 or means for implementing the functions specified in multiple blocks.

[0124] In a typical configuration, a computing device includes one or more processors (CPUs), an input / output interface, a network interface, and a memory.

[0125] The memory may include non-permanent memory in the form of computer-readable media, random access memory (RAM), and / or non-volatile memory, such as read-only memory (ROM) or flash memory. The memory is an example of computer-readable media.

[0126] A computer-readable medium includes both permanent and non-permanent, removable and non-removable media and can implement information storage by any method or technology. The information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette tapes, magnetic disk storage or other magnetic storage devices, or any other non-transitory medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer-readable medium does not include transitory computer-readable media, such as modulated data signals and carrier waves.

[0127] It should also be noted that the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "comprising an..." does not exclude the presence of additional identical elements in the process, method, article or device comprising the element.

[0128] From the above description, it can be seen that the above embodiments of the present application achieve the following technical effects:

[0129] 1) In the transaction remote authorization method of the present application, in response to a first predetermined operation of the user, a video connection request is generated and sent to the remote authorization end, so that the remote authorization end generates a video signaling and sends it to the client to establish a video connection with the client. Then, a remote authorization request is generated and sent to the remote authorization end, so that the remote authorization end obtains and displays the current user video of the client, and generates an authorization result in response to a second predetermined operation of the remote teller and sends it to the client. Compared with the prior art, in the remote authorization process, the static image of the user end is remotely reviewed to determine whether to authorize, but the static image is difficult to accurately perceive the operation process and on-site environment of the customer in real time, resulting in security risks in remote review. In the present application, by establishing a video connection between the client and the remote authorization end, the remote teller reviews the current user video, and the client generates an authorization result and sends it to the client, thereby completing the remote authorization process and improving the security of remote authorization. Therefore, it can alleviate the problem of high remote review risk in the prior art and reduce the risk of remote authorization in financial transaction services.

[0130] The above are only the preferred embodiments of the present application and are not intended to limit the present application. For those skilled in the art, various changes and modifications can be made to the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included within the protection scope of the present application.

Claims

1. A method for remote authorization of transactions, characterized in that, Applied to a client, the client is communicatively connected to a remote authorization end, including: In response to a first predetermined operation of a user, generating a video connection request and sending it to the remote authorization end, so that the remote authorization end generates a video signaling and sends it to the client to establish a video connection with the client. Wherein, the video connection request is used to request to establish a video connection with the remote authorization end, and the video signaling at least includes a video connection address; Generating a remote authorization request and sending it to the remote authorization end, so that the remote authorization end acquires and displays the current user video of the client, and generates an authorization result in response to a second predetermined operation of a remote teller and sends it to the client. Wherein, the remote authorization request is used to request the remote authorization end to perform remote authorization on a target transaction initiated by the user, the authorization result indicates whether to perform remote authorization on the target transaction, and the second predetermined operation is issued by the remote teller after reviewing the current user video.

2. The transaction remote authorization method according to claim 1, wherein The client includes a first screen, a second screen and a camera. After the remote authorization end generates a video signaling and sends it to the client to establish a video connection with the client, the method further includes: Acquiring a user real-time video image through the camera, and acquiring a user service image, and sending the user real-time video image and the user service image to the remote authorization end; Receiving a remote real-time video image sent by the remote authorization end, and displaying the remote real-time video image on the first screen; Receiving the first predetermined operation of the user through the second screen.

3. The transaction remote authorization method according to claim 1, wherein In response to a first predetermined operation of a user, generating a video connection request and sending it to the remote authorization end, including: Generating a remote authorization inquiry instruction, sending the remote authorization inquiry instruction to the remote authorization end, so that the remote authorization end generates a reply message and sends the reply message to the client. Wherein, the remote authorization inquiry instruction is used to inquire whether the remote authorization mode is enabled for the target transaction, the reply message is information indicating whether the remote authorization mode is enabled for the target transaction, and the remote authorization mode means a mode in which a remote teller of the remote authorization end performs transaction authorization; Receiving the reply message sent by the remote authorization end, and in the case where the reply message indicates that the remote authorization mode is enabled for the target transaction, generating the video connection request and sending it to the remote authorization end in response to the predetermined operation of the user.

4. The transaction remote authorization method according to claim 1, characterized in that After generating a remote authorization request and sending it to the remote authorization end, the method further includes: Acquiring user data of the user, and generating an authorization application document according to the user data. Wherein, the user data is image data representing the identity information of the user, and the authorization application document at least includes the user data and information about the target transaction initiated by the user; Sending the authorization application document to the remote authorization end, so that the remote authorization end acquires and displays the authorization application document, and further enabling the remote teller to compare the current user video and the user data.

5. The transaction remote authorization method according to claim 1, wherein After generating a video connection request and sending it to the remote authorization terminal, the method further includes: Generating a remote teller call instruction, sending the remote teller call instruction to the remote authorization terminal, so that the remote authorization terminal allocates the remote teller and sends a real-time image of the remote teller to the client, wherein the remote teller is pre-registered in the remote authorization terminal.

6. A method for remote authorization of transactions, characterized in that, Applied to the remote authorization terminal, the remote authorization terminal is communicatively connected to the client and includes: Receiving a video connection request sent by the client, generating a video signal and sending it to the client to establish a video connection with the client, wherein the video connection request is generated in response to a first predetermined operation of the user and is used to request to establish a video connection with the remote authorization terminal, and the video signal at least includes a video connection address; Receiving a remote authorization request sent by the client, obtaining and displaying the current user video of the client, generating an authorization result in response to a second predetermined operation of the remote teller and sending it to the client, wherein the remote authorization request is used to request the remote authorization terminal to remotely authorize a target transaction initiated by the user, the authorization result indicates whether to remotely authorize the target transaction, and the second predetermined operation is issued by the remote teller after reviewing the current user video.

7. The transaction remote authorization method according to claim 6, wherein The remote authorization terminal at least includes a first screen, a second screen and a camera. After generating a video signal and sending it to the client to establish a video connection with the client, the method further includes: Receiving the real-time user video screen and the user service screen sent by the client, displaying the real-time user video screen on the first screen, and displaying the user service screen on the second screen; Obtaining a remote real-time video screen through the camera and sending the remote real-time video screen to the client.

8. The transaction remote authorization method according to claim 6, wherein Receiving the video connection request sent by the client includes: Receiving a remote authorization inquiry instruction sent by the client, generating a reply message and sending the reply message to the client, so that the client generates a video connection request and sends it to the remote authorization terminal when the reply message indicates that the target transaction enables the remote authorization mode, wherein the remote authorization inquiry instruction is used to inquire whether the target transaction enables the remote authorization mode, the reply message is information indicating whether the target transaction enables the remote authorization mode, and the remote authorization mode means a mode in which a remote teller of the remote authorization terminal conducts transaction authorization; Receiving the video connection request sent by the client.

9. The transaction remote authorization method according to claim 6, wherein After receiving the remote authorization request sent by the client, the method further includes: Receiving an authorization application document sent by the client, wherein the authorization application document is generated by the client obtaining user data of the user and according to the user data, the user data is image data representing the identity information of the user, and the authorization application document at least includes the user data and information about the target transaction initiated by the user; Display the authorized application document so that the remote teller can compare the current user video and the user data.

10. The transaction remote authorization method according to claim 6, wherein After receiving the remote authorization request sent by the client, the method further includes: Receiving a remote teller call instruction sent by the client, allocating the remote teller to the client, and sending a real-time image of the remote teller to the client, where the remote teller is pre-registered at the remote authorization end.

Images