Remote business handling method and system based on Internet video

By using WebSocket long connection and independent message communication channels in the remote video service of the financial insurance industry, the problem of difficulty in combining call center capabilities with counter business systems in the existing technology is solved, and the client APP and customer service personnel are realized. video calls and business processing reduce system coupling and development costs, and improve business processing efficiency.

CN114945081BActive Publication Date: 2024-11-12CHINA LIFE INSURANCE CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210255406.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-03-15
Publication Date
2024-11-12
Estimated Expiration
2042-03-15

AI Technical Summary

Technical Problem

The existing remote video services cannot effectively combine call center capabilities with counter business systems in the financial insurance industry, resulting in the inability to realize the complete processing of large-scale and high-risk services in remote video mode, and relying on external video components to lead to the system. High coupling degree, high development cost, difficult to control independently and reuse quickly.

Method used

Design a remote service management method and system based on Internet video. By establishing a long WebSocket connection between the client APP and the call center subsystem, assigning target customer service personnel, and establishing an independent message communication channel outside the video call to realize business The delivery of instructions and the display of execution results reduces dependence on external video components and reduces the coupling between the call center subsystem and the service subsystem.

Benefits of technology

It realizes independent communication of messages during video calls, reduces system coupling, improves business processing efficiency and flexibility, reduces dependence on external call center capability platforms, and supports the client APP and target customer service personnel. Video calls and business processing simplify business processes and reduce development costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114945081B_ABST
    Figure CN114945081B_ABST
Patent Text Reader

Abstract

The present application provides a remote business processing method and system based on Internet video, wherein the backend service component assigns a target customer service staff to the user according to the user information and creates a video call connection, and sends business instruction information to the client APP according to the user's business needs. When the business processing is completed, the video call connection is hung up. The remote business processing method provided in the present application can establish a message communication independent of the video while the client APP establishes a video call with the target customer service staff, so as to get rid of the dependence on external video components. It effectively reduces the coupling degree between the call center subsystem and the business subsystem, and at the same time ensures that the call center subsystem and the business subsystem are quickly connected, without the need to integrate the business subsystem into the external call center capability platform, thereby reducing the dependence on the external call center capability platform.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of communication technology, and in particular to a remote business processing method and system based on Internet video. Background Art

[0002] In the financial insurance industry, the online self-service method of the client mobile APP is gradually replacing the manual service method of the traditional counter business hall. The establishment of remote video and manual business processing through the client mobile APP provides great convenience for customers who are in foreign countries, VIPs, the elderly, office workers and other customer groups who are inconvenient to go to offline business halls, while protecting financial risks and achieving efficient and convenient customer service. However, for service items involving large amounts, high risks, and important rights and interests of customers, self-service processing through the client APP is usually not allowed, and customers still need to go to offline counter business halls for manual processing and manual review.

[0003] In addition to the online self-service method of the client mobile APP, in the financial insurance industry, most of them provide telephone services, online voice services or online text services, but they can only meet the customer's consulting needs and simple business handling. For large-amount and high-risk businesses, they still need to be handled offline at the counter. In terms of remote video services, the industry generally only provides information changes and identity verification services in the province where the customer information belongs, and cannot well combine call center capabilities, remote video capabilities and counter business systems. Summary of the invention

[0004] In view of this, the purpose of this application is to propose a remote business handling method and system based on Internet video.

[0005] Based on the above purpose, the present application provides a remote business handling method based on Internet video, which is applied to a remote business handling system, wherein the remote business handling system includes a business subsystem and a call center subsystem, wherein the call center subsystem includes a front-end functional component and a back-end service component, wherein the front-end functional component is embedded in the business subsystem, and the method includes:

[0006] In response to receiving a video call request sent by a user through a client APP, the backend service component assigns a target customer service staff to the user according to the user information;

[0007] The backend service component calls the external video component to create a video call connection between the user and the target customer service staff;

[0008] According to the business needs of the user, the backend service component sends business instruction information to the client APP, and the user executes the business instruction information and generates an execution result;

[0009] In response to receiving the execution result sent by the client APP, the backend service component forwards it to the front-end page of the business subsystem for display;

[0010] Whether the business processing is completed is determined based on the execution result displayed on the front-end page of the business subsystem. In response to the completion of the business processing, the back-end service component calls the external video component to hang up the video call connection.

[0011] Optionally, a first WebSocket long connection is established between the client APP and the backend service component through a remote video service page of the external video component set on the client APP;

[0012] The backend service component assigns a target customer service staff to the user according to the user information, including:

[0013] In response to the absence of a candidate customer service personnel in the service resource pool in the backend service component, the backend service component sends a waiting message to the user through the first WebSocket persistent connection;

[0014] In response to the existence of the candidate customer service personnel in the service resource pool in the backend service component, the backend service component selects the candidate customer service personnel who matches the user from all the candidate customer service personnel as the target customer service personnel, and sends a message to join the video conference to the user through the first WebSocket long connection.

[0015] Optionally, after the backend service component calls the external video component to create a video call connection between the user and the target customer service staff, the process further includes:

[0016] Disconnect the first WebSocket persistent connection through the remote video service page.

[0017] Optionally, in response to receiving a state switching request sent by a customer service staff through the front-end functional component, the back-end service component judges the state switching request;

[0018] In response to the state switching request being in a serviceable state, adding the customer service staff to the service resource pool as the candidate customer service staff through a distributed lock;

[0019] In response to the state switching request being a non-serviceable state and the customer service staff being already in the service resource pool, the customer service staff is removed from the service resource pool through a distributed lock.

[0020] Optionally, in response to the fact that there is no candidate customer service personnel in the service resource pool in the backend service component, the backend service component sends a waiting message to the user through the first WebSocket persistent connection, further comprising:

[0021] The backend service component adds the user to the waiting resource pool through a distributed lock.

[0022] Optionally, the target customer service staff establishes a second WebSocket persistent connection between the business subsystem and the backend service component through the frontend functional component; after the backend service component assigns a target customer service staff to the user according to the user information, the method further includes:

[0023] The backend service component sends the user information of the user to the front-end page of the business subsystem for display through the second WebSocket long connection.

[0024] Optionally, the backend service component calls an external video component to create a video call connection between the user and the customer service staff, including:

[0025] The backend service component calls the external video component to create a video conference room, and invites the user and the target customer service staff to enter the video conference room.

[0026] Optionally, a third WebSocket persistent connection between the client APP and the backend service component is established through an implicit webview page created in the client APP;

[0027] The sending of the business instruction information to the client APP through the backend service component includes:

[0028] The target customer service staff sends a business instruction request to the backend service component through the frontend function component;

[0029] In response to receiving the business instruction request, the backend service component queries the server in the backend service component corresponding to the establishment of the third WebSocket persistent connection according to the target customer service personnel information, and sends the business instruction request to the server;

[0030] The server sends the business instruction information corresponding to the business instruction request to the client APP through the third WebSocket long connection.

[0031] Optionally, in response to receiving the execution result sent by the client APP, the backend service component forwards it to the front-end page of the business subsystem for display, including:

[0032] The backend service component sends the execution result to the front-end page of the business subsystem for display through the second WebSocket long connection.

[0033] Based on the same inventive concept, the present application also provides a remote business handling system based on Internet video, the system includes a business subsystem and a call center subsystem, the call center subsystem includes a front-end functional component and a back-end service component, the front-end functional component is embedded in the business subsystem,

[0034] The business subsystem is configured to provide relevant business handling functions according to the business needs of the user;

[0035] The front-end functional component is configured to be embedded in the business subsystem in the form of a floating button to establish a connection between the business subsystem and the back-end service component;

[0036] The backend service component is configured to, in response to receiving a video call request sent by a user through a client APP, assign a target customer service staff to the user according to the user information;

[0037] Calling an external video component to create a video call connection between the user and the target customer service staff;

[0038] According to the business needs of the user, business instruction information is sent to the client APP, and the user executes the business instruction information and generates an execution result;

[0039] In response to receiving the execution result sent by the client APP, forward it to the front-end page of the business subsystem for display; determine whether the business processing is completed based on the execution result displayed on the front-end page of the business subsystem; in response to the completion of the business processing, call the external video component to hang up the video call connection.

[0040] As can be seen from the above, the present application provides a remote business processing method and system based on Internet video, wherein the remote business processing system includes a business subsystem and a call center subsystem, wherein the call center subsystem includes a front-end functional component and a back-end service component, wherein the front-end functional component is embedded in the business subsystem, and in response to receiving a video call request sent by a user through a client APP, the back-end service component assigns a target customer service personnel to the user according to the user information; the back-end service component calls an external video component to create a video call connection between the user and the target customer service personnel; according to the business needs of the user, business instruction information is sent to the client APP through the back-end service component, and the user executes the business instruction information and generates an execution result; in response to receiving the execution result sent by the client APP, the back-end service component forwards it to the front-end page of the business subsystem for display; according to the execution result displayed on the front-end page of the business subsystem, it is determined whether the business processing is completed, and in response to the completion of the business processing, the back-end service component calls the external video component to hang up the video call connection. The remote business handling method provided by this application can establish a message communication independent of the video while establishing a video call between the client APP and the target customer service personnel, so as to get rid of the dependence on external video components. It effectively reduces the coupling degree between the call center subsystem and the business subsystem, and ensures that the call center subsystem and the business subsystem are quickly connected, without the need to integrate the business subsystem into the external call center capability platform, reducing the dependence on the external call center capability platform. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the technical solutions in the present application or related technologies, the drawings required for use in the embodiments or related technical descriptions are briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0042] Figure 1 A flowchart of a remote business handling method based on Internet video according to an embodiment of the present application;

[0043] Figure 2 A flowchart of a method for allocating target customer service personnel to a user according to an embodiment of the present application;

[0044] Figure 3 A flowchart of a method for switching service status by a customer service staff in an embodiment of the present application;

[0045] Figure 4A flowchart of a method for a backend service component of an embodiment of the present application to send business instruction information to the client APP;

[0046] Figure 5 This is a structural diagram of a remote business processing system based on Internet video according to an embodiment of the present application. DETAILED DESCRIPTION

[0047] In order to make the objectives, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below in combination with specific embodiments and with reference to the accompanying drawings.

[0048] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present application should be the usual meanings understood by people with ordinary skills in the field to which the present application belongs. The "first", "second" and similar words used in the embodiments of the present application do not represent any order, quantity or importance, but are only used to distinguish different components. "Including" or "comprising" and similar words mean that the elements or objects appearing in front of the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connect" or "connected" and similar words are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0049] As described in the background technology, in the existing technical solutions for remote video services, the control of "call center capabilities", "remote video capabilities" and "business system capabilities" is relatively scattered and divided. Only the main technical means of call center capabilities or the network communication methods for establishing video connections are focused on. The results are often achieved through voice communication after video connection, ignoring media information interaction and remote business handling capabilities, failing to form a complete and comprehensive remote video service system, and failing to well realize the remote video service capabilities of customers handling business without leaving home.

[0050] The applicant found that the composition and communication interactions of the various functions of existing remote video services mostly rely on mature technologies or SDK components provided by external manufacturers. Once there is a need to build new business, it is difficult to carry out transformation. It is often necessary to contact external manufacturers again and purchase supporting transformation, which consumes a lot of development costs, is not conducive to independent control of internal technology, and it is also difficult to achieve rapid reuse of existing results.

[0051] Compared with traditional telephone hotline customer service, remote video services can see real people through video, but they mainly provide consulting services or simple business handling. They do not have the ability to facilitate similar "online business halls", and customers still need to go to the counter in person to handle business.

[0052] Generally, video services will use the existing external call center capability platform, do technical development on the platform, integrate business functions, or simply connect the external call center with the company's business system. Service personnel need to use two systems at the same time, one for answering calls and assigning customers, and the other for handling business or querying customer information. Both situations have limitations, are not conducive to the rapid reuse of results, and are also cumbersome to use.

[0053] Based on this, the present application provides a remote business handling method and system based on Internet video to solve the above problems.

[0054] The embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0055] The present application provides a remote business handling method based on Internet video, which is applied to a remote business handling system. The remote business handling system includes a business subsystem and a call center subsystem. The call center subsystem includes a front-end functional component and a back-end service component. The front-end functional component is embedded in the business subsystem. Figure 1 , the method comprises the following steps:

[0056] Step S101: In response to receiving a video call request sent by a user through a client APP, the backend service component assigns a target customer service staff to the user according to the user information.

[0057] When a customer needs to handle business via video, he / she sends a video call request through the client APP, which can be a mobile client, including electronic devices such as a client and a tablet computer. After receiving the video call request, the call center subsystem assigns a matching target customer service staff to the user through the backend service component to handle the video business for the user.

[0058] Step S102: The backend service component calls an external video component to create a video call connection between the user and the target customer service staff.

[0059] After receiving the video call request, the backend service component calls the external video component to create a video call connection between the user and the target customer service staff. The external video component can provide an interface to the backend server, allowing the backend service component to call its interface, including creating a video conference room, inviting people to join the meeting, conference management, and video recording. After the call center subsystem assigns a customer and a target customer service staff, it calls the function of creating a video conference room, and then pulls the target service staff into the created video conference room. At the same time, the call center subsystem can call the conference management function to check whether there is already one participant in the video conference room. If there is one participant, the second participant is automatically invited to join the meeting. The first participant is the target customer service staff, and the second participant is the user. The service provider of the external video component will also provide an SDK program component, which can be introduced into the client APP to enable the client APP to have video call capabilities, or directly provide a video client.

[0060] Step S103: according to the business needs of the user, business instruction information is sent to the client APP through the backend service component, and the user executes the business instruction information and generates an execution result.

[0061] After the video connection is established, the target customer service staff receives the business requirements raised by the user, selects the relevant business instruction function in the front-end functional component, and sends a business instruction request to the back-end service component. The back-end service component sends the business instruction information contained in the business instruction request to the client APP. The user performs relevant operations on the client APP according to the business instruction information and generates execution results.

[0062] Step S104: In response to receiving the execution result sent by the client APP, the backend service component forwards it to the front-end page of the business subsystem for display. The target customer service staff can see the execution result through the front-end page of the business subsystem, make judgments on it, and provide the user with the next service.

[0063] Step S105: judging whether the service processing is completed according to the execution result displayed on the front-end page of the service subsystem, and in response to the completion of the service processing, the back-end service component calls the external video component to hang up the video call connection. If all the service needs of the user are completed, both parties can hang up the video call separately.

[0064] In some embodiments, a first WebSocket long connection between the client APP and the backend service component is established through a remote video service page of the external video component set on the client APP;

[0065] The backend service component assigns a target customer service staff to the user according to the user information. Figure 2 , including the following steps:

[0066] Step S201: In response to the absence of candidate customer service personnel in the service resource pool in the backend service component, the backend service component sends a waiting message to the user through a first WebSocket long connection.

[0067] Step S202: In response to the existence of the candidate customer service personnel in the service resource pool in the backend service component, the backend service component selects the candidate customer service personnel who matches the user from all the candidate customer service personnel as the target customer service personnel, and sends a message to join the video conference to the user through the first WebSocket long connection.

[0068] Specifically, in the page of the client APP remote video service, a first WebSocket long connection is established. The js program code of the client APP remote video service page establishes a WebSocket instance and creates a first WebSocket long connection. The communication protocol is ws or wss. The first WebSocket long connection address is the IP plus internal path of the server in the corresponding backend service component. It is forwarded by the nginx server in the backend service component and maintains connection and communication with the server of the war package program deployed in the backend service component.

[0069] When users use remote video services through the client APP, they can customize the allocation rules according to business needs, complete task allocation, and designate a target customer service staff. For example, based on the customer's geographical location, the city of the branch where the business was recently handled, the purchase management agency of the most recent financial product, the customer service staff number of the most recent video service, and other information, you can find a resource pool that meets the required conditions, select the target customer service staff from the candidate customer service staff in the resource pool, and if there are no idle service staff in the resource pool, you can flexibly trigger queuing, appointment reminders, or cross-institutional scheduling.

[0070] The following is a specific example to illustrate the process of assigning a target customer service staff to a user:

[0071] 1) A customer with ID number 110107XXX recently purchased a financial management product, which is managed by Beijing 110000. He needs to make a video call through the client APP to handle the XYZ service of CAA business. The customer APP clicks "Video Call", which triggers the JS method of the APP page and sends a video call request to the backend service component of the call center.

[0072] 2) After receiving the video call request, the backend service component spells out the CAA_110000_XYZ string based on the customer information, and checks whether there are any candidate customer service personnel in the service resource pool CAA_110000_XYZ_USER.

[0073] 3) If there are candidate customer service personnel in the service resource pool CAA_110000_XYZ_USER, the candidate customer service personnel in the resource pool can be allocated to the user according to the rules set by the business (such as the service personnel with the longest ready duration being given priority allocation, etc.), and the candidate customer service personnel are released from the resource pool at the same time.

[0074] 4) If there are no candidate customer service personnel in CAA_110000_XYZ_USER, the current customer service personnel is busy and the user needs to queue up. First, a distributed lock is obtained through Redis to prevent multiple network requests from reaching the backend service component at the same time. When it is necessary to join or remove the resource pool, there will be conflicts between the front and back. In this embodiment, the setsn method of Redis can be used. The backend service component sends a waiting message to the user through the first WebSocket long connection, for example, it shows that there are 5 people in the queue ahead and the estimated waiting time is 3 minutes and 50 seconds. At this time, the user enters the corresponding resource pool. When the first user in front is answered, the server notifies the client APP front-end page of the remaining 4 users through WebSocket broadcast, and dynamically updates the number of people in the queue ahead and the estimated waiting time.

[0075] 5) If the distributed lock is obtained, the string CAA_110000_XYZ_CUSTOMER is concatenated according to the user information. This string exists in Redis as a key value, and the data type is a List list. Each data in the list corresponds to the information of a user. The user-related information with the certificate number 110107XXX is converted to a String string type and added to the CAA_110000_XYZ_CUSTOMER waiting resource pool. If the distributed lock cannot be obtained, it means that a thread is already adding / removing the resource pool. The current thread can be allowed to sleep for 10 milliseconds and then try to obtain the Redis distributed lock again. The order of users in the resource pool represents the order of the user queue. When the system assigns a video service personnel to the user, the backend service component notifies the client APP front-end page to join the conference room through a WebSocket message. The client APP front-end page calls the video SDK component introduced in the APP through the js bridge to complete the joining action and close the first WebSocket long connection of the current page.

[0076] In some embodiments, after the backend service component calls the external video component to create a video call connection between the user and the target customer service personnel, the method further includes: disconnecting the first WebSocket persistent connection through a remote video service page. After the user enters the video conference, the user can disconnect the first WebSocket persistent connection through the remote video service page.

[0077] In some embodiments, reference Figure 3 , also includes:

[0078] Step S301: In response to receiving a state switching request sent by a customer service staff through the front-end functional component, the back-end service component judges the state switching request.

[0079] Step S302: In response to the state switching request being a serviceable state, adding the customer service personnel to the service resource pool as the candidate customer service personnel through a distributed lock; in response to the state switching request being an unserviceable state and the customer service personnel is already in the service resource pool, removing the customer service personnel from the service resource pool through a distributed lock.

[0080] Specifically, the status of customer service personnel can be refined differently according to management needs, but it can be roughly divided into two categories. The serviceable status includes ready; the unserviceable status includes not ready, busy, and on a call.

[0081] When the customer service staff clicks the relevant status button of the computer floating bar, the js code method of the front-end functional component is triggered, and a status switching request is sent to the back-end service component. The front-end functional component is composed of html, css, and js files to provide the floating window button function and style.

[0082] The server of the backend service component determines whether it is in the "serviceable state" based on the state parameters in the state switching request. If so, the customer service staff is placed in the corresponding resource pool (for example, for the AAA business system, Beijing 110000 organization, BBB category, the service staff's work number and other information are placed in the resource pool with AAA_110000_BBB_USER as the key value).

[0083] The resource pool can be managed through the remote dictionary service Redis. For example:

[0084] When a service person in Beijing institution 110000, institution employee number 181009, who uses the CAA business system to handle the XYZ service, clicks the "Ready" button in the floating bar, a state switching request is sent to the server of the backend service component. The service area determines that the "Ready" state is a "serviceable state" and first obtains a distributed lock. If a distributed lock is obtained, the relevant information of the customer service employee number 181009 can be converted to a String string type and added to the resource pool CAA_110000_XYZ_USER. This string exists as a key value in Redis, and the data type is a List list. Each data in the list corresponds to a service person information.

[0085] After adding the resource pool, release the Redis distributed lock. If the distributed lock cannot be obtained, it means that a thread is already adding / removing the resource pool. You can let the current thread sleep for 10 milliseconds and try to obtain the Redis distributed lock again. If the status clicked by the customer service staff on the front end of the computer business subsystem is "unavailable for service", the string CAA_110000_XYZ_USER is also assembled according to the above method, and the Redis distributed lock is obtained. If the customer service staff is in the resource pool, the customer service staff will be removed from the resource pool and the Redis lock will be released.

[0086] In some embodiments, the target customer service staff establishes a second WebSocket persistent connection between the business subsystem and the backend service component through the frontend functional component; after the backend service component assigns a target customer service staff to the user according to the user information, the method further includes:

[0087] The backend service component sends the user information of the user to the front-end page of the business subsystem for display through the second WebSocket long connection.

[0088] Specifically, in the business subsystem, since the front-end functional component of the call center subsystem has been embedded, when the target customer service staff clicks the "Sign In" button, a second WebSocket persistent connection is established for the business subsystem page. Here, the js program code of the front-end functional component establishes a WebSocket instance and creates a persistent connection. The protocol is ws or wss. The persistent connection address is the IP of the server of the back-end service component plus the internal path. It is forwarded by the nginx server of the back-end service component and maintains a connection with the server of the deployed war package program of the back-end service component. The second WebSocket persistent connection communication will be maintained until the target service staff clicks the "Sign Out" button. When the system assigns a customer to the target service staff, the back-end service component sends the user information to the front-end page of the business subsystem through a persistent connection message and displays it.

[0089] In some embodiments, the backend service component calls the external video component to create a video call connection between the user and the customer service staff, including:

[0090] The backend service component calls the external video component to create a video conference room, and invites the user and the target customer service staff to enter the video conference room.

[0091] Specifically, after the call center subsystem assigns a customer and a target customer service staff, it calls the function of creating a video conference room, and then pulls the target service staff into the created video conference room. At the same time, the call center subsystem can call the conference management function to check whether there is already a participant in the video conference room. If there is a participant, the second participant is automatically invited to join the meeting. The first participant is the target customer service staff, and the second participant is the user. The service provider of the external video component will also provide an SDK program component, which can be introduced into the client APP to enable the client APP to have video call capabilities, or directly provide a video client.

[0092] In some embodiments, a third WebSocket long connection between the client APP and the backend service component is established by an implicit webview page created in the client APP;

[0093] The backend service component sends the service instruction information to the client APP, refer to Figure 4 , including the following steps:

[0094] Step S401: The target customer service staff sends a business instruction request to the backend service component through the front-end functional component.

[0095] Step S402, in response to receiving the business instruction request, the backend service component queries the server in the backend service component corresponding to the establishment of the third WebSocket long connection according to the target customer service personnel information, and sends the business instruction request to the server.

[0096] Step S403: The server sends the business instruction information corresponding to the business instruction request to the client APP through the third WebSocket long connection.

[0097] It should be noted that after joining the video conference room, an implicit webview page with a length and width of 0 is created on the current client APP window through the native capabilities of the APP, and a third WebSocket long connection is established on the implicit page. Here, the js program code of the implicit page establishes a WebSocket instance and creates a long connection. The protocol is ws or wss. The long connection address is the ip plus internal path of the server of the backend service component, which is forwarded by the nginx server of the backend service component and maintains connection and communication with the server of the deployment war package program of the backend service component. The third WebSocket long connection communication will be maintained until the user hangs up the video. When the customer service staff clicks the button of the front-end functional component embedded in the business subsystem, for example, clicks the "Upload Certificate" button. The back-end service component notifies the client APP front-end implicit page through a WebSocket message, and calls the js bridge such as the pop-up window of the client APP and opens a new page through the page to complete the relevant business functions. In this way, the interaction of text and media information is realized, and it does not depend on the video service provider.

[0098] Specifically, on the computer side, the target customer service staff clicks the "Collect Information" icon button in the floating bar to trigger the js code method of the front-end functional component and send a network request to the back-end service component of the call center.

[0099] After forwarding by the Nginx server, the server of the backend service component receives the network request for "collecting information". According to the target customer service personnel information in the request message, the user information of the client APP that is currently talking to the target customer service personnel is queried in the Redis server. According to the user information, the server IP of the backend service component that establishes a long connection with the implicit page of the client APP call is queried, and the message is forwarded to the server IP. After receiving the forwarded message, the server IP finds the long connection MyWebSocket object established by the implicit page in the client APP call from the WebSocketMap, and sends the long connection message of "collecting information" to the implicit page in the client APP call.

[0100] The client APP implicit page receives a long connection message. According to the type of message, it determines to execute the "data collection" program logic, calls the native js bridge of the client APP, performs pop-up windows and opens a new page. The new page can cover the video window. The content displayed on the new page may include: picture upload area, picture collection prompt, picture browsing area, picture delete button, picture upload button, etc.

[0101] In the new page, the user clicks the picture upload area, calls the native js bridge of the client APP, opens the camera or album, selects the picture, and the client transcodes and compresses the picture, and sends the compressed base64 picture back to the new page through the callback method.

[0102] In the new page, the picture just taken / selected in the album is displayed. Click the "Upload" button to trigger the implicit page js code method, send a network request to the backend service component, and upload the base64 picture to the server of the backend service component.

[0103] After the server receives the base64 image, it can choose to store it in the database table using the clob format, store it in the NARS mounted on the server, or upload it to the built media server.

[0104] If the computer counter needs to retrieve images, you can click the "Image Retrieval" button in the floating bar of the computer front-end functional component to send a network request to the server of the back-end service component and return the image query result. You can also find the target customer service staff of the current call based on the user information after the image arrives at the server of the back-end service component, query the WebSocket long connection IP address established by the front-end page component of the target customer service staff, and send a message to the front-end page of the business subsystem to process and display the base64 image.

[0105] In some embodiments, in response to receiving the execution result sent by the client APP, the backend service component forwards it to the front-end page of the business subsystem for display, including:

[0106] The backend service component sends the execution result to the front-end page of the business subsystem for display through the second WebSocket long connection.

[0107] Specifically, during a video call, when a user completes an action, such as face recognition failure or successful ID upload, the backend service component sends the user action to the business subsystem front end through the second WebSocket persistent connection message and displays it. When a user completes media upload through the client APP, the backend service component sends the media information uploaded by the user, such as ID card pictures and financial product purchase receipt pictures, to the business subsystem front end and displays it through the second WebSocket persistent connection message.

[0108] It should be noted that the method of the embodiment of the present application can be performed by a single device, such as a computer or server. The method of this embodiment can also be applied to a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only perform one or more steps in the method of the embodiment of the present application, and the multiple devices will interact with each other to complete the described method.

[0109] It should be noted that the above describes some embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the above embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0110] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present application also provides a remote business processing system based on Internet video.

[0111] refer to Figure 5 The remote business handling system based on Internet video includes a business subsystem and a call center subsystem. The call center subsystem includes a front-end functional component and a back-end service component. The front-end functional component is embedded in the business subsystem.

[0112] The business subsystem 501 is configured to provide relevant business handling functions according to the business needs of the user;

[0113] The front-end functional component 502 is configured to be embedded in the business subsystem in the form of a floating button to establish a connection between the business subsystem and the back-end service component;

[0114] The backend service component 503 is configured to, in response to receiving a video call request sent by a user through a client APP, assign a target customer service staff to the user according to the user information;

[0115] Calling an external video component to create a video call connection between the user and the target customer service staff;

[0116] According to the business needs of the user, business instruction information is sent to the client APP, and the user executes the business instruction information and generates an execution result;

[0117] In response to receiving the execution result sent by the client APP, forward it to the front-end page of the business subsystem for display; determine whether the business processing is completed based on the execution result displayed on the front-end page of the business subsystem; in response to the completion of the business processing, call the external video component to hang up the video call connection.

[0118] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present application (including the claims) is limited to these examples. In line with the concept of the present application, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of the different aspects of the embodiments of the present application as described above, which are not provided in detail for the sake of simplicity.

[0119] Although the present application has been described in conjunction with specific embodiments thereof, many alternatives, modifications and variations of these embodiments will be apparent to those skilled in the art in light of the foregoing description.

[0120] The embodiments of the present application are intended to cover all such substitutions, modifications and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present application should be included in the scope of protection of the present application.

Claims

1. A remote business handling method based on Internet video, characterized in that: Applied to a remote business processing system, the remote business processing system includes a business subsystem and a call center subsystem, the call center subsystem includes a front-end functional component and a back-end service component, the front-end functional component is embedded in the business subsystem, and the method includes: In response to receiving a video call request sent by a user through a client APP, the backend service component assigns a target customer service staff to the user according to the user information; The backend service component calls the external video component to create a video call connection between the user and the target customer service staff; According to the business needs of the user, the backend service component sends business instruction information to the client APP, and the user executes the business instruction information and generates an execution result; In response to receiving the execution result sent by the client APP, the backend service component forwards it to the front-end page of the business subsystem for display; Determining whether the service processing is completed according to the execution result displayed on the front-end page of the service subsystem, and in response to the completion of the service processing, the back-end service component calls the external video component to hang up the video call connection; Establishing a first WebSocket long connection between the client APP and the backend service component through a remote video service page of the external video component set on the client APP; The backend service component assigns a target customer service staff to the user according to the user information, including: In response to the absence of a candidate customer service personnel in the service resource pool in the backend service component, the backend service component sends a waiting message to the user through the first WebSocket persistent connection; In response to the existence of the candidate customer service personnel in the service resource pool in the backend service component, the backend service component selects the candidate customer service personnel matching the user from all the candidate customer service personnel as the target customer service personnel, and sends a message of joining the video conference to the user through the first WebSocket long connection; The method further comprises: In response to receiving a state switching request sent by a customer service staff through the front-end functional component, the back-end service component judges the state switching request; In response to the state switching request being in a serviceable state, adding the customer service staff to the service resource pool as the candidate customer service staff through a distributed lock; In response to the state switching request being an unserviceable state and the customer service staff being in the service resource pool, removing the customer service staff from the service resource pool through a distributed lock; The target customer service staff establishes a second WebSocket long connection between the business subsystem and the backend service component through the front-end functional component; after the back-end service component assigns the target customer service staff to the user according to the user information, it also includes: The backend service component sends the user information of the user to the frontend page of the business subsystem for display through the second WebSocket long connection; Establishing a third WebSocket long connection between the client APP and the backend service component by an implicit webview page created in the client APP; sending business instruction information to the client APP by the backend service component includes: The target customer service staff sends a business instruction request to the backend service component through the frontend function component; In response to receiving the business instruction request, the backend service component queries the server in the backend service component corresponding to the establishment of the third WebSocket persistent connection according to the target customer service personnel information, and sends the business instruction request to the server; The server sends the business instruction information corresponding to the business instruction request to the client APP through the third WebSocket long connection.

2. The method according to claim 1, characterized in that After the backend service component calls the external video component to create a video call connection between the user and the target customer service staff, the method further includes: Disconnect the first WebSocket persistent connection through the remote video service page.

3. The method according to claim 1, characterized in that In response to the fact that there is no candidate customer service personnel in the service resource pool in the backend service component, the backend service component sends a waiting message to the user through the first WebSocket long connection, further comprising: The backend service component adds the user to the waiting resource pool through a distributed lock.

4. The method according to claim 1, characterized in that: The backend service component calls the external video component to create a video call connection between the user and the customer service staff, including: The backend service component calls the external video component to create a video conference room, and invites the user and the target customer service staff to enter the video conference room.

5. The method according to claim 1, characterized in that In response to receiving the execution result sent by the client APP, the backend service component forwards it to the front-end page of the business subsystem for display, including: The backend service component sends the execution result to the front-end page of the business subsystem for display through the second WebSocket long connection.

6. A remote business handling system based on Internet video, characterized in that: The system includes a business subsystem and a call center subsystem. The call center subsystem includes a front-end functional component and a back-end service component. The front-end functional component is embedded in the business subsystem. The business subsystem is configured to provide relevant business handling functions according to the business needs of users; The front-end functional component is configured to be embedded in the business subsystem in the form of a floating button to establish a connection between the business subsystem and the back-end service component; The backend service component is configured to, in response to receiving a video call request sent by a user through a client APP, assign a target customer service staff to the user according to the user information; Calling an external video component to create a video call connection between the user and the target customer service staff; According to the business needs of the user, business instruction information is sent to the client APP, and the user executes the business instruction information and generates an execution result; In response to receiving the execution result sent by the client APP, forwarding it to the front-end page of the business subsystem for display; judging whether the business processing is completed according to the execution result displayed on the front-end page of the business subsystem, and in response to the completion of the business processing, calling the external video component to hang up the video call connection; Establishing a first WebSocket long connection between the client APP and the backend service component through a remote video service page of the external video component set on the client APP; The backend service component assigns a target customer service staff to the user according to the user information, including: In response to the absence of a candidate customer service personnel in the service resource pool in the backend service component, the backend service component sends a waiting message to the user through the first WebSocket persistent connection; In response to the existence of the candidate customer service personnel in the service resource pool in the backend service component, the backend service component selects the candidate customer service personnel matching the user from all the candidate customer service personnel as the target customer service personnel, and sends a message of joining the video conference to the user through the first WebSocket long connection; The method also includes: In response to receiving a state switching request sent by a customer service staff through the front-end functional component, the back-end service component judges the state switching request; In response to the state switching request being in a serviceable state, adding the customer service staff to the service resource pool as the candidate customer service staff through a distributed lock; In response to the state switching request being an unserviceable state and the customer service staff being in the service resource pool, removing the customer service staff from the service resource pool through a distributed lock; The target customer service staff establishes a second WebSocket long connection between the business subsystem and the backend service component through the front-end functional component; after the back-end service component assigns the target customer service staff to the user according to the user information, it also includes: The backend service component sends the user information of the user to the frontend page of the business subsystem for display through the second WebSocket long connection; Establishing a third WebSocket persistent connection between the client APP and the backend service component by using an implicit webview page created on the client APP; sending business instruction information to the client APP by using the backend service component, including: The target customer service staff sends a business instruction request to the backend service component through the frontend function component; In response to receiving the business instruction request, the backend service component queries the server in the backend service component corresponding to the establishment of the third WebSocket persistent connection according to the target customer service personnel information, and sends the business instruction request to the server; The server sends the business instruction information corresponding to the business instruction request to the client APP through the third WebSocket long connection.