Audio and Video-Based Screen Sharing Method, System, Device and Medium

Abstract

The present application discloses an audio-video-based screen sharing method, system, device and medium, which relates to the field of computer technology. The method includes: receiving a remote control request sent by a service end and forwarding it to a seat end; creating a remote control connection between the service end and the seat end based on a remote control notification corresponding to the remote control request sent by the seat end; respectively creating a first window and a second window for displaying the desktop of the seat end at the service end and the seat end; receiving a desktop control instruction sent by the service end and sending it to the seat end to enable the seat end to perform corresponding operations on the desktop of the seat end in the second window; obtaining interface information of the first window based on a sharing instruction sent by the service end; generating and sending a shared interface for displaying the interface information to the client and the service end. The method provided by the present application enables a salesman and a customer to share software or file information of the seat end, improving the efficiency of business handling.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular, to an audio-video based screen sharing method, system, device, and medium. Background Art

[0002] In the financial business scenario, to improve the business processing efficiency, bank clerks can choose to communicate with customers remotely through screen sharing; during this process, clerks may encounter situations where they need to use software programs or document materials within the bank to communicate with customers, and these data files usually can only be called and viewed by the seat personnel at the seat end.

[0003] In the related art, when encountering the above problems, seat personnel are generally invited to join the remote session together, and the seat personnel will give explanations. However, this is limited by the idle state of the seat personnel. When the seat personnel are not convenient to participate in the session, customers need to wait, which will inevitably affect the business progress and customer experience. Summary of the Invention

[0004] To solve or partially solve the problems existing in the related art, this application provides an audio-video based screen sharing method, system, device, and medium, which can enable clerks to share the desktop information at the seat end during the process of remotely sharing the screen with customers.

[0005] In the first aspect of this application, an audio-video based screen sharing method is provided, which is characterized in that it is applied to the central server of a remote sharing platform. The remote sharing platform further includes: a client, a business end, and a seat end; the method includes:

[0006] Receiving a remote control request sent by the business end and forwarding it to the seat end;

[0007] Based on the remote control notification corresponding to the remote control request sent by the seat end, creating a remote control connection between the business end and the seat end;

[0008] Respectively creating a first window and a second window for displaying the seat end desktop at the business end and the seat end;

[0009] Receiving a desktop control instruction sent by the business end and sending it to the seat end to make the seat end perform corresponding operations on the seat end desktop in the second window;

[0010] Based on the sharing instruction sent by the business end, obtaining the interface information of the first window;

[0011] Generating and sending a shared interface for displaying the interface information to the client and the business end.

[0012] Optionally, the remote control request includes: a control target, service information, and customer information; forwarding the remote control request to the agent side includes:

[0013] If the remote control request meets the preset non-audit conditions, generate a connection instruction;

[0014] Send the remote control request and the connection instruction to an idle agent side.

[0015] Optionally, the remote control request includes: a control target, service information, and customer information; creating a remote control connection between the service side and the agent side based on the remote control notification corresponding to the remote control request sent by the agent side includes:

[0016] Create a remote control connection between the service side and the agent side based on the remote control notification corresponding to the remote control request generated by the agent side according to the notification creation operation performed by the agent personnel.

[0017] Optionally, receiving the desktop control instruction sent by the service side and sending it to the agent side to enable the agent side to perform corresponding operations on the agent desktop in the second window includes:

[0018] Receive the desktop control instruction sent by the service side;

[0019] Send the desktop control instruction to the agent side and receive the specified control instruction generated by the agent side based on the specified operation performed by the agent personnel in the second window;

[0020] Determine the target control object on the agent desktop in the first window according to the specified control instruction;

[0021] Receive the target object control instruction generated by the service side based on the target object control operation performed by the salesman in the first window;

[0022] Send the target object control instruction to the agent side to enable the agent side to perform corresponding operations on the agent desktop in the second window.

[0023] Optionally, obtaining the interface information of the first window based on the sharing instruction sent by the service side includes:

[0024] Receive the sharing instruction sent by the service side and send it to the agent side;

[0025] Obtain the interface information of the first window based on the sharing notification corresponding to the sharing instruction sent by the agent side.

[0026] Optionally, the method further includes:

[0027] When receiving the pause control instruction sent by the agent terminal, stop sending the desktop control instruction to the agent terminal;

[0028] When receiving the pause sharing instruction sent by the agent terminal, stop obtaining the interface information.

[0029] Optionally, obtaining the interface information of the first window includes:

[0030] When the sharing instruction is a screenshot sharing instruction, capture the current frame image of the first window as the interface information;

[0031] When the sharing instruction is a video sharing instruction, obtain the video frame data of the first window as the interface information.

[0032] The second aspect of the present application provides an audio-video-based screen sharing system, which is applied to the central server of a remote sharing platform. The remote sharing platform further includes: a client, a service terminal, and an agent terminal; the system includes:

[0033] An information processing module, configured to receive a remote control request sent by the service terminal and forward it to the agent terminal;

[0034] A remote control module, configured to:

[0035] Based on the remote control notification corresponding to the remote control request sent by the agent terminal, create a remote control connection between the service terminal and the agent terminal;

[0036] Create a first window and a second window for displaying the agent terminal desktop on the service terminal and the agent terminal respectively;

[0037] Receive the desktop control instruction sent by the service terminal and send it to the agent terminal, so that the agent terminal performs corresponding operations on the agent terminal desktop in the second window;

[0038] An interface processing module, configured to:

[0039] Based on the sharing instruction sent by the service terminal, obtain the interface information of the first window;

[0040] Generate and send a shared interface for displaying the interface information to the client and the service terminal.

[0041] The third aspect of the present application provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the method described above is implemented.

[0042] A fourth aspect of the present application provides a computer-readable storage medium, characterized in that a computer program is stored thereon, and when the computer program is executed, the method described above is implemented.

[0043] In the screen sharing method provided by the embodiments of the present application, during the process of remote screen sharing between a salesman and a customer, when the salesman encounters a situation where he needs to call and view software or files on the agent side to share the screen with the customer, he can send a remote control request through the business side to establish a remote control connection between the business side and the agent side through the central server, so that the salesman can remotely control the software or files on the agent side at the business side. Further, when the salesman finds the required information, he can send a sharing instruction, and use the central server to obtain the corresponding interface information to generate a shared interface and send it to the client side; the method provided by the present application enables the salesman and the customer to share software or file information on the agent side, improving the business handling efficiency while ensuring the customer experience.

[0044] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] By describing the exemplary embodiments of the present application in more detail in conjunction with the drawings, the above and other objects, features and advantages of the present application will become more obvious. Among them, in the exemplary embodiments of the present application, the same reference numerals generally represent the same components.

[0046] Figure 1 is a flowchart showing the method of screen sharing based on audio and video according to an embodiment of the present application;

[0047] Figure 2 is a display diagram showing the first window and the second window according to an embodiment of the present application;

[0048] Figure 3 is a schematic diagram of the second window according to an embodiment of the present application;

[0049] Figure 4 is a schematic diagram of the interface of the business side display screen according to an embodiment of the present application;

[0050] Figure 5 is a schematic diagram showing the selection of a control object according to an embodiment of the present application;

[0051] Figure 6 is a schematic diagram of the module structure of a screen sharing system based on audio and video according to an embodiment of the present application;

[0052] Figure 7 is a schematic diagram of the structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0053] Embodiments of the present application will be described in more detail below with reference to the accompanying drawings. Although embodiments of the present application are shown in the drawings, it should be understood that the present application can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to make the present application more thorough and complete, and to fully convey the scope of the present application to those skilled in the art.

[0054] The terms used in the present application are for the purpose of describing specific embodiments only and are not intended to limit the present application. The singular forms "a", "the" and "said" used in the present application and the appended claims are also intended to include the plural forms unless the context clearly dictates otherwise. It should also be understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

[0055] It should be understood that although the terms "first", "second", "third", etc. may be used in the present application to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Thus, the features defined with "first" and "second" may explicitly or implicitly include one or more of such features. In the description of the present application, "a plurality" means two or more unless otherwise specifically defined.

[0056] Embodiments of the present application will be described below with reference to the accompanying drawings.

[0057] The purpose of the present application is to provide a screen sharing method, system, device and medium based on audio and video, which can enable a salesman to share the desktop information of the agent side during the process of remote screen sharing with a customer.

[0058] The above screen sharing method is applied to the central server of a remote sharing platform, and the remote sharing platform further includes a client side, a business side and an agent side.

[0059] Please refer to Figure 1 , Figure 1 which is a flowchart of the screen sharing method. The screen sharing method may include the following steps:

[0060] Step 101: Receive a remote control request sent by the business side and forward it to the agent side.

[0061] During the process of a salesman having a remote conversation with a customer, when it is necessary to call internal bank software programs, document materials, etc. to share the screen with the customer, since these software materials are not set on the business side and can only be called and viewed on the agent side, at this time, the salesman can send a remote control request from the business side to the agent side, applying for temporary remote control of the agent side desktop, and then obtaining relevant materials to communicate further with the customer.

[0062] The remote control request can be a trigger instruction. After the salesman triggers this instruction through the business side, it is received by the central server and forwarded to the agent side.

[0063] Exemplarily, the remote control request can also include: control target, business information, and customer information.

[0064] Among them, the control target is the software and / or files on the agent side desktop, that is, the target software and / or files that the salesman is going to remotely control on the agent side desktop; the business information can include: business type, salesman information; the business type is used to represent what kind of business the salesman is currently handling, such as agency business, wealth management business, securities investment, custody business, etc.; the salesman information can include information such as the salesman's name, position, rank, etc.; the customer information can include information such as the customer's name, occupation, historical business handling situation, etc.

[0065] When the salesman creates a remote control request on the business side, the specific information included in the remote control request can be reasonably set according to needs. For example, the created remote control request can specifically include: control target, business type, and the customer's historical business handling situation.

[0066] Step 102: Create a remote control connection between the business side and the agent side based on the remote control notification corresponding to the remote control request sent by the agent side.

[0067] In some scenarios, the central server can create a remote control connection between the business side and the agent side based on the remote control notification corresponding to the remote control request generated by the agent side according to the notification creation operation performed by the agent personnel.

[0068] When the central server sends the remote control request to the agent side, the agent personnel on the agent side can review the remote control request. After the agent personnel review and approve, they can perform a notification creation operation on the agent side. The agent side generates a corresponding remote control notification and sends it to the central server, and then the central server creates a remote control connection between the business side and the agent side.

[0069] In some scenarios, the remote control request can also be reviewed by the central server and then sent to the agent side; correspondingly, in one embodiment, in terms of forwarding the remote control request to the agent side, the central server can perform the following operations:

[0070] If the remote control request meets the preset conditions for exemption from review, a connection instruction is generated;

[0071] The remote control request and the connection instruction are sent to the agent terminal in the idle state.

[0072] Among them, the remote control request includes the above-mentioned control target, service information, and customer information; in the application, the preset conditions for exemption from review can be set according to at least one of the control target, service information, and customer information.

[0073] For example, the conditions for exemption from review can be set according to the confidentiality level of the control target; in the application, software and files on the agent terminal desktop can be classified according to the confidentiality situation, such as being divided into first-level confidentiality, second-level confidentiality, and third-level confidentiality from high to low according to the confidentiality level; when the control target belongs to a file or software classified as first-level or second-level confidentiality, it means that the agent personnel need to review the remote control request, and when the control target belongs to third-level confidentiality, the agent personnel do not need to review the remote control request.

[0074] The conditions for exemption from review can also be set according to the level of the salesman in the service information; in the application, salesmen can be divided into ordinary salesmen, intermediate salesmen, senior salesmen, and sales managers, etc. according to their positions, work experience, and work performance; when the central server determines that the salesman is a senior salesman or a sales manager based on the service information, it can be determined that the corresponding remote control request meets the conditions for exemption from review.

[0075] The conditions for exemption from review can also be set according to the historical business handling situation in the customer information; in the application, customers can be divided into ordinary customers, high-quality customers, and high-end customers according to their historical business handling situations; when the central server determines that the current customer is a high-end customer based on the customer information, it can be determined that the corresponding remote control request meets the conditions for exemption from review.

[0076] It can be understood that the above examples are only for illustrative purposes and are not specific limitations. The conditions for exemption from review can be flexibly set according to the actual situation; for example, the conditions for exemption from review can also be set by combining the business type in the service information and the historical business handling situation in the customer information. When the central server determines based on the service information and the customer information that the business currently handled by the customer belongs to the historical business that has been handled before, it can be determined that the remote control request meets the conditions for exemption from review.

[0077] Furthermore, when the central server determines that the remote control request meets the preset conditions for exemption from review, a connection instruction can be generated and sent to the agent terminal in the idle state together with the remote control request, for creating a remote control connection between the service end and the agent end.

[0078] Among them, the idle state is used to represent that the desktop of the seat end is in an unmanipulated state, that is, the seat personnel at the seat end do not perform operations based on the desktop of the seat end. In the application, the central server can judge whether the seat end is in the idle state according to the application states of the mouse and keyboard at the seat end. For example, when the unused time of the mouse and keyboard at the seat end is greater than the preset time, it can be considered that the seat end is currently in the idle state. The application states of the mouse and keyboard at the seat end can be obtained through corresponding monitoring tools, such as enabling the corresponding monitoring program to monitor whether the mouse and keyboard at the seat end are used and the usage time, etc.

[0079] It can be understood that the central server can determine the receiving object among multiple seat ends. For example, when only sending a remote control request, it can determine the seat end that has not participated in the remote control connection among multiple seat ends and use it as the receiving object. When sending a remote control request and a connection instruction, it can determine the seat end in the idle state among multiple seat ends and select a seat end in the idle state as the receiving object.

[0080] In the embodiment of the present application, the method of using the central server to review whether the remote control request meets the conditions for exemption from review can effectively improve the business handling efficiency. In the application, when the seat personnel are inconvenient to process the remote control request, such as in the cases of phone communication, attending meetings, reporting work, etc., at this time the seat end is in the idle state, and the central server sends the remote control request and the connection instruction to this seat end, which can not only improve the utilization rate of idle devices, but also avoid affecting the working state of other seat personnel who are manipulating the desktop of the seat end.

[0081] Step 103: Create a first window and a second window for displaying the desktop of the seat end at the service end and the seat end respectively.

[0082] As Figure 2 shown, Figure 2 is a display schematic diagram of the first window and the second window. Figure 2 A, B, C, D, E, and F in it are used to represent software or files in the desktop of the seat end. After a remote control connection is established between the service end and the seat end, the central server creates a first window 201 and a second window 202 for displaying the desktop of the seat end at the service end and the seat end respectively.

[0083] After establishing the remote control connection, the central server can obtain the image change data (video frame data) of the desktop of the seat end. For example, the seat end sends video frame data to the central server according to a preset rule after the remote control connection is created. Among them, the image pixels, the number of image frames, etc. in the preset rule can be flexibly set according to the actual situation. After the central server obtains the video frame data of the desktop of the seat end, it sends it to the service end, and the service end displays it in the first window 201 after receiving the video frame data.

[0084] It should be noted that, please refer to Figure 3 , Figure 3 which is a schematic diagram of the second window; when creating the second window in the display screen of the agent terminal, the original desktop of the agent terminal will be reduced according to a preset ratio and displayed in the second window of the display screen, as shown in Figure 3 . The dashed box part 203 in it represents the desktop of the agent terminal, which is displayed in the second window 202. Correspondingly, the part of the desktop of the agent terminal displayed in the first window 201 is similar to Figure 3 203 in it, and the entire second window 202 in the display screen of the agent terminal will not be displayed in the first window 201.

[0085] Step 104: Receive the desktop control instruction sent by the service terminal and send it to the agent terminal, so that the agent terminal performs corresponding operations on the desktop of the agent terminal in the second window.

[0086] In the application, the service terminal serves as the control terminal and the agent terminal serves as the controlled terminal; the salesman can operate the mouse and keyboard in the first window of the service terminal to trigger the desktop control instruction, such as controlling the mouse to open a file. Further, the central server can forward the desktop control instruction to the agent terminal so that the agent terminal performs corresponding operations according to the instruction; after receiving the desktop control instruction, the agent terminal can use the API (Application Programming Interface) to simulate the operations of the mouse and keyboard locally, thereby realizing the remote control of the desktop of the agent terminal.

[0087] Step 105: Obtain the interface information of the first window based on the sharing instruction sent by the service terminal.

[0088] During the process of the salesman remotely controlling the desktop of the agent terminal, when finding the required information (the information that needs to be shared with the customer on the screen), the salesman can trigger the sharing instruction based on the first window. After receiving the sharing instruction, the central server obtains the interface information of the first window.

[0089] Among them, the sharing instruction can be a screenshot sharing instruction or a video sharing instruction.

[0090] When the sharing instruction is a screenshot sharing instruction, the central server intercepts the current frame image of the first window as the interface information; when the sharing instruction is a video sharing instruction, the central server obtains the video frame data of the first window as the interface information.

[0091] In one embodiment, when the salesman needs to share the desktop information of the agent terminal with the customer, the salesman can first conduct a review through the agent personnel; correspondingly, the above-mentioned obtaining the interface information of the first window based on the sharing instruction sent by the service terminal may include:

[0092] Receive the sharing instruction sent by the service terminal and send it to the agent terminal;

[0093] Obtain the interface information of the first window based on the sharing notification corresponding to the sharing instruction sent by the agent terminal.

[0094] In the application, the salesman can trigger a sharing instruction at the business terminal, and the central server sends the sharing instruction to the agent terminal. Then, the agent personnel determine whether to share the information of the current agent terminal desktop with the client. If sharing is agreed, the corresponding sharing notification can be sent through the agent terminal. After receiving the sharing notification, the central server obtains the interface information of the first window.

[0095] Among them, after receiving the sharing instruction, the agent terminal can pop up a confirmation window on the agent terminal screen, and the agent personnel click "Yes" or "No"; when clicking "Yes", it means agreeing to share, and "No" means refusing to share. At the same time, the central server sends a refusal sharing notification to the business terminal.

[0096] In the embodiment of the present application, by the method that the agent personnel finally determine whether to share the agent terminal desktop information with the customer, it can effectively avoid the situation that due to the salesman's mis-sending of the sharing instruction, the information that should not be shared is shared to the client, avoiding affecting the customer experience and ensuring information security at the same time.

[0097] Step 106: Generate and send a sharing interface for displaying the interface information to the client and the business terminal.

[0098] When the salesman conducts a remote session with the customer, a remote sharing connection is established between the business terminal and the client through the central server. The central server can receive the pre-sharing interface sent by the business terminal and send it to the client; when the central server obtains the interface information of the first window, it can generate a second pre-sharing interface for displaying the interface information, and then splice the pre-sharing interface and the second pre-sharing interface to obtain the sharing interface, and finally send the sharing interface to the business terminal and the client; thus, the purpose of sharing the information of the agent terminal desktop with the customer can be achieved.

[0099] Further, it should be noted that since the business terminal establishes a remote sharing connection with the client at the same time and a remote control connection with the agent terminal, when limited by the size of the business terminal screen, the salesman can adjust the size and position of the sharing interface and the first window on the business terminal display screen.

[0100] As Figure 4 shown, Figure 4It is a schematic diagram of the interface of the business - end display screen. The business - end can split - screen display the shared interface 401 and the first window 201 on the display screen 402. At the same time, the salesman can also adjust the size and position of the shared interface 401 or the first window 201, such as shrinking, moving, etc. It can be understood that when the interface of the shared interface 401 or the first window 201 is shrunk, although not all the content in the interface can be displayed, the content itself has not changed. For example, since the interface information is simultaneously displayed in the shared interface 401 and the first window 201, when the shared interface 401 is shrunk (such as due to split - screen display), the interface information in the shared interface 401 is not displayed on the display screen 402, but the interface information can be viewed by sliding in the shared interface 401.

[0101] In the screen - sharing method provided by the embodiments of the present application, during the process of remote screen sharing between the salesman and the customer, when the salesman encounters a situation where it is necessary to call and view the software or files on the agent - end to conduct screen sharing with the customer, a remote control connection can be established between the business - end and the agent - end through the central server, enabling the salesman to remotely control the software or files on the agent - end at the business - end. And when the salesman finds the required information, the interface information can be obtained through the central server to generate a shared interface and sent to the client - end. Thus, the salesman and the customer can share the software or file information on the agent - end, improving the business - handling efficiency while ensuring the customer experience.

[0102] In addition, the business - end and the agent - end can be connected through the intranet. At the same time, in the present application, the central server is used to establish a remote control connection between the business - end and the client - end without relying on a third - party software, so the information security can be further ensured.

[0103] In one embodiment, to prevent the salesman from incorrectly opening files or software outside the permissions during the process of remotely controlling the agent - end desktop, the agent staff can limit the control objects of the salesman. Correspondingly, the above - mentioned receiving the desktop control instruction sent by the business - end and sending it to the agent - end to make the agent - end execute corresponding operations on the agent - end desktop in the second window may include:

[0104] Receiving the desktop control instruction sent by the business - end;

[0105] Sending the desktop control instruction to the agent - end and receiving the specified control instruction generated by the agent - end based on the specified operation executed by the agent staff in the second window;

[0106] Determining the target control object of the agent - end desktop in the first window according to the specified control instruction;

[0107] Receiving the target object control instruction generated by the business - end based on the target object control operation executed by the salesman in the first window;

[0108] Send a control instruction for the target object to the agent side to make the agent side perform corresponding operations on the agent desktop in the second window.

[0109] In the application, after the central server sends the desktop control instruction to the agent side, the agent side can display a prompt message (such as a pop-up reminder) on the screen based on the desktop control instruction to remind the agent personnel; further, the agent personnel can perform specified operations in the second window to select software and / or files on the agent desktop. After the selection is completed, the agent side can generate a corresponding specified control instruction. After the central server receives the specified control instruction, it can determine the corresponding software and / or file in the first window of the service side as the target control object; then, the salesman can perform a target object control operation in the first window, such as clicking the mouse to open the file that is the target control object. The service side can generate a corresponding target object control instruction; the central server forwards the target object control instruction to the agent side to make the agent side perform corresponding operations on the agent desktop in the second window.

[0110] Please refer to Figure 5 , Figure 5 For a schematic diagram of selecting the control object; the agent personnel can use methods such as clicking the mouse in the second window 202 to select software and files on the agent desktop, such as Figure 5 E and F in the dotted box. After that, the agent personnel can click the "Specify" button in the second window to make the agent side send a corresponding specified control instruction.

[0111] In the embodiment of the present application, the agent personnel can select the control object of the salesman, which can effectively prevent the salesman from opening files or software that should not be shared with customers during the process of remotely controlling the agent desktop; especially when the above sharing instruction is a video sharing instruction, it can ensure that some internal information of the agent side will not be leaked to customers during the screen sharing process, and can prevent the salesman from opening some irrelevant files or software from affecting the customer experience.

[0112] In one embodiment, the agent personnel can also pause the remote control operation of the salesman as needed; correspondingly, the above screen sharing method may further include the following steps:

[0113] When receiving the pause control instruction sent by the agent side, stop sending the desktop control instruction to the agent side;

[0114] When receiving the pause sharing instruction sent by the agent side, stop obtaining the interface information.

[0115] In the application, the seat staff can, according to the actual situation, for example, when the seat terminal receives a file or notice sent by other devices, trigger a pause control instruction and / or a pause sharing instruction to the central server through the second window, so as to pause the remote control operation and / or the interface sharing operation of the salesman. In addition, after receiving the pause control instruction and / or the pause sharing instruction, the central server can also send a corresponding pause notice to the business terminal to remind the salesman.

[0116] In the embodiments of the present application, by sending a pause control instruction and / or a pause sharing instruction, the seat staff can not only respond in time to emergencies such as the salesman's operation errors, but also process important information or notices sent by other devices in time, reducing the operation risk while reducing the impact on the work of the seat staff caused by the salesman's remote control of the seat terminal desktop.

[0117] Corresponding to the foregoing method embodiments for implementing application functions, the present application also provides a screen sharing system, device, medium and corresponding embodiments.

[0118] Please refer to Figure 6 , Figure 6 which is a schematic diagram of the module structure of an audio and video-based screen sharing system shown in the embodiments of the present application.

[0119] The above screen sharing system is applied to the central server of a remote sharing platform, and the remote sharing platform further includes: a client, a business terminal and a seat terminal; the system includes:

[0120] An information processing module 61, configured to receive a remote control request sent by the business terminal and forward it to the seat terminal;

[0121] A remote control module 62, configured to:

[0122] Create a remote control connection between the business terminal and the seat terminal based on a remote control notice corresponding to the remote control request sent by the seat terminal;

[0123] Create a first window and a second window for displaying the seat terminal desktop on the business terminal and the seat terminal respectively;

[0124] Receive a desktop control instruction sent by the business terminal and send it to the seat terminal to make the seat terminal perform corresponding operations on the seat terminal desktop in the second window;

[0125] An interface processing module 63, configured to:

[0126] Obtain the interface information of the first window based on the sharing instruction sent by the business terminal;

[0127] Generate and send a shared interface for displaying the interface information to the client and the business terminal.

[0128] In some embodiments, the remote control request includes: a control target, service information, and customer information; in terms of forwarding the remote control request to the agent side, the information processing module 61 is specifically configured to:

[0129] If the remote control request meets the preset conditions for exemption from review, generate a connection instruction;

[0130] Send the remote control request and the connection instruction to an idle agent side.

[0131] In some embodiments, the remote control request includes: a control target, service information, and customer information; in terms of creating a remote control connection between the service side and the agent side based on the remote control notification corresponding to the remote control request sent by the agent side, the information processing module 61 is specifically configured to:

[0132] Create a remote control connection between the service side and the agent side based on the remote control notification corresponding to the remote control request generated by the agent side according to the operations performed by the agent personnel for the notification.

[0133] In some embodiments, in terms of receiving the desktop control instruction sent by the service side and sending it to the agent side to enable the agent side to perform corresponding operations on the agent desktop in the second window, the remote control module 62 is specifically configured to:

[0134] Receive the desktop control instruction sent by the service side;

[0135] Send the desktop control instruction to the agent side, and receive the specified control instruction generated by the agent side based on the specified operations performed by the agent personnel in the second window;

[0136] Determine the target control object on the agent desktop in the first window according to the specified control instruction;

[0137] Receive the target object control instruction generated by the service side based on the target object control operations performed by the salesperson in the first window;

[0138] Send the target object control instruction to the agent side to enable the agent side to perform corresponding operations on the agent desktop in the second window.

[0139] In some embodiments, in terms of obtaining the interface information of the first window based on the sharing instruction sent by the service side, the interface processing module 63 is specifically configured to:

[0140] Receive the sharing instruction sent by the service side, and send it to the agent side;

[0141] Obtain the interface information of the first window based on the sharing notification corresponding to the sharing instruction sent by the agent side.

[0142] In some embodiments, the above system further includes:

[0143] A pause control module, configured to:

[0144] When receiving a pause control instruction sent by the agent terminal, stop sending desktop control instructions to the agent terminal;

[0145] When receiving a pause sharing instruction sent by the agent terminal, stop acquiring interface information.

[0146] In some embodiments, in terms of acquiring the interface information of the first window, the interface processing module 63 is specifically configured to:

[0147] When the sharing instruction is a screenshot sharing instruction, capture the current frame image of the first window as the interface information;

[0148] When the sharing instruction is a video sharing instruction, acquire the video frame data of the first window as the interface information.

[0149] Regarding the system in the above embodiments, the specific manners in which each module performs operations have been described in detail in the embodiments related to the method, and will not be elaborated herein again.

[0150] An electronic device is further provided in an embodiment of the present application. Please refer to Figure 7 , the electronic device 7000 includes a memory 7010 and a processor 7020.

[0151] The processor 7020 may be a central processing unit (CPU), or may also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0152] The memory 7010 may include various types of storage units, such as system memory, read-only memory (ROM), and permanent storage devices. Among them, the ROM may store static data or instructions required by the processor 7020 or other modules of the computer. The permanent storage device may be a readable and writable storage device. The permanent storage device may be a non-volatile storage device that does not lose the stored instructions and data even when the computer is powered off. In some embodiments, the permanent storage device employs a mass storage device (such as a magnetic or optical disk, flash memory) as the permanent storage device. In some other embodiments, the permanent storage device may be a removable storage device (such as a floppy disk, optical drive). The system memory may be a readable and writable storage device or a volatile readable and writable storage device, such as dynamic random access memory. The system memory may store some or all of the instructions and data required by the processor during operation. In addition, the memory 7010 may include any combination of computer-readable storage media, including various types of semiconductor storage chips (such as DRAM, SRAM, SDRAM, flash memory, programmable read-only memory), and magnetic disks and / or optical disks may also be used. In some embodiments, the memory 7010 may include a removable storage device that is readable and / or writable, such as a compact disc (CD), read-only digital versatile disc (such as DVD-ROM, dual-layer DVD-ROM), read-only Blu-ray disc, super density disc, flash memory card (such as SD card, min SD card, Micro-SD card, etc.), magnetic floppy disk, etc. Computer-readable storage media do not include carrier waves and instantaneous electronic signals transmitted wirelessly or by wire.

[0153] Executable code is stored on the memory 7010, and when the executable code is processed by the processor 1020, it may cause the processor 7020 to execute some or all of the methods described above.

[0154] In addition, the method according to the present application may also be implemented as a computer program or a computer program product, which includes computer program code instructions for executing some or all of the steps of the above method according to the present application.

[0155] Alternatively, the present application may also be implemented as a computer-readable storage medium (or a non-transitory machine-readable storage medium or a machine-readable storage medium), on which executable code (or a computer program or computer instruction code) is stored. When the executable code (or the computer program or computer instruction code) is executed by a processor of an electronic device (or a server, etc.), it causes the processor to execute some or all of the steps of the above method according to the present application.

[0156] The embodiments of the present application have been described above. The above description is exemplary and not exhaustive, and is also not limited to the disclosed embodiments. Many modifications and variations are obvious to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The choice of terms used herein is intended to best explain the principles of the embodiments, practical applications, or improvements to the technology in the market, or to enable other ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A screen sharing method based on audio and video, characterized in that: A central server applied to a remote sharing platform, wherein the remote sharing platform further comprises: a client, a service end and an agent end; the method comprises: Receive the remote control request sent by the service end, and forward it to the agent end; Creating a remote control connection between the service end and the agent end based on a remote control notification corresponding to the remote control request sent by the agent end; Creating a first window and a second window displaying the desktop of the agent end at the service end and the agent end respectively; After the remote control connection is established, the central server can obtain the video frame data of the agent's desktop; after obtaining the video frame data of the agent's desktop, the central server sends it to the service end, and the service end displays the video frame data in the first window after receiving it; receiving a desktop control instruction sent by the service end and sending the instruction to the agent end, so as to cause the agent end to perform a corresponding operation on the agent end desktop of the second window; Based on the sharing instruction sent by the service end, acquiring interface information of the first window; Generate and send a shared interface displaying the interface information to the client and service end; In terms of forwarding remote control requests to the agent side, the central server can perform the following operations: If the remote control request meets the preset audit-free conditions, a connection instruction is generated; Send remote control request and connection command to the idle agent terminal; The remote control request includes a control target, business information and customer information; the preset audit exemption condition is set according to at least one of the control target, business information and customer information; When the central server determines that the remote control request meets the preset conditions for exemption from review, it can generate a connection instruction and send it together with the remote control request to the idle agent end to create a remote control connection between the business end and the agent end; the idle state is used to indicate that the agent end desktop is in an uncontrolled state; when the mouse and keyboard of the agent end have not been used for longer than the preset time, it is determined that the agent end is currently in an idle state.

2. The screen sharing method according to claim 1, characterized in that: The remote control request includes: a control target, service information and customer information; the remote control notification corresponding to the remote control request sent by the agent end, creating a remote control connection between the service end and the agent end, includes: A remote control connection between the service end and the agent end is established based on a remote control notification corresponding to the remote control request generated by the agent end according to a notification creation operation performed by the agent.

3. The screen sharing method according to claim 1, characterized in that: The receiving of the desktop control instruction sent by the service end and sending the instruction to the agent end so as to make the agent end perform a corresponding operation on the agent end desktop of the second window includes: Receiving a desktop control instruction sent by the service end; Sending the desktop control instruction to the agent terminal, and receiving a designated control instruction generated by the agent terminal based on a designated operation performed by the agent in the second window; Determine a target control object of the agent end desktop in the first window according to the specified control instruction; receiving a target object control instruction generated by the business end based on a target object control operation performed by a business operator in the first window; The target object control instruction is sent to the agent terminal to enable the agent terminal to perform a corresponding operation on the agent terminal desktop of the second window.

4. The screen sharing method according to claim 1, characterized in that: The acquiring the interface information of the first window based on the sharing instruction sent by the service end includes: Receive the sharing instruction sent by the service end, and send it to the agent end; Based on the sharing notification corresponding to the sharing instruction sent by the agent terminal, interface information of the first window is obtained.

5. The screen sharing method according to claim 1, characterized in that: Also includes: When receiving the pause control instruction sent by the seat end, stop sending the desktop control instruction to the seat end; When receiving the pause sharing instruction sent by the seat end, stop obtaining the interface information.

6. The screen sharing method according to any one of claims 1 to 5, characterized in that: The acquiring the interface information of the first window includes: When the sharing instruction is a screenshot sharing instruction, capturing a current frame image of the first window as the interface information; When the sharing instruction is a video sharing instruction, video frame data of the first window is obtained as interface information.

7. A screen sharing system based on audio and video, characterized in that: A central server applied to a remote sharing platform, wherein the remote sharing platform further comprises: a client, a service end and an agent end; the system comprises: An information processing module, used for receiving the remote control request sent by the service end and forwarding it to the agent end; Remote control module for: Creating a remote control connection between the service end and the agent end based on a remote control notification corresponding to the remote control request sent by the agent end; Creating a first window and a second window displaying the desktop of the agent end at the service end and the agent end respectively; After the remote control connection is established, the central server can obtain the video frame data of the agent's desktop; after obtaining the video frame data of the agent's desktop, the central server sends it to the service end, and the service end displays the video frame data in the first window after receiving it; receiving a desktop control instruction sent by the service end and sending the instruction to the agent end, so as to cause the agent end to perform a corresponding operation on the agent end desktop of the second window; Interface processing module, used for: Based on the sharing instruction sent by the service end, acquiring interface information of the first window; Generate and send a shared interface displaying the interface information to the client and service end; In terms of forwarding remote control requests to the agent side, the central server can perform the following operations: If the remote control request meets the preset audit-free conditions, a connection instruction is generated; Send remote control request and connection command to the idle agent terminal; The remote control request includes a control target, business information and customer information; the preset audit exemption condition is set according to at least one of the control target, business information and customer information; When the central server determines that the remote control request meets the preset conditions for exemption from review, it can generate a connection instruction and send it together with the remote control request to the idle agent end to create a remote control connection between the business end and the agent end; the idle state is used to indicate that the agent end desktop is in an uncontrolled state; when the mouse and keyboard of the agent end have not been used for longer than the preset time, it is determined that the agent end is currently in an idle state.

8. An electronic device, characterized in that: The method comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method according to any one of claims 1 to 6 when executing the computer program.

9. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed, the method according to any one of claims 1 to 6 is implemented.

Images