Interactive conference management method and system

Abstract

The embodiment of the invention relates to the technical field of the Internet, and particularly discloses an interactive conference management method and system, and the method comprises the steps: obtaining a target file shared by a conference and the information of participants, determining the network performance scores of the participants based on the information of the participants, determining a first class of participants and a second class of participants according to the network performance scores, the target file is sent to the terminal of the second type of conventioneers, a screenshot video stream and a sharing operation instruction are obtained when the sharing operation on the target file is detected, the screenshot video stream is sent to the terminal of the first type of conventioneers, the sharing operation instruction is sent to the terminal of the second type of conventioneers, and the screenshot video stream is displayed by the terminal of the first type of conventioneers. In the embodiment of the invention, the terminals of the second type of conventioneers operate the target file according to the sharing operation instruction, and the video stream does not need to be decoded, so that the time difference between the terminals of the second type of conventioneers and the terminals of the first type of conventioneers with better network performance for displaying the document sharing picture is shortened, and the synchronization performance of the document sharing picture is improved.

Description

Technical Field

[0001] The present invention belongs to the field of Internet technology, and in particular relates to an interactive conference management method and system. Background Art

[0002] With the development of network and communication technology, online meetings have emerged, allowing people to hold online meetings.

[0003] In some online meetings, a participant needs to share the screen to achieve document sharing and online interaction. Desktop sharing is to take continuous screenshots of the sharer's screen at a preset frequency to obtain a video stream, which is distributed to each participant. After receiving the video stream, each participant's terminal decodes and displays it. However, due to the different terminal devices and network performance used by each participant, the efficiency of video processing is also different, resulting in a large delay in the content of the shared screen displayed by each participant, causing the images displayed on the screens of each participant to be out of sync. Summary of the invention

[0004] The purpose of the embodiments of the present invention is to provide an interactive conference management method and system, aiming to solve the problem of asynchronous screen display of each participant when sharing screen in an online conference.

[0005] To achieve the above objectives, the embodiments of the present invention provide the following technical solutions: An interactive conference management method specifically comprises the following steps: Get the target file shared in the conference and the information of each participant; Determine a network performance score for each participant based on the information of the participant, and determine a first category of participants and a second category of participants according to the network performance score, wherein the network performance of the first category of participants is better than the network performance of the second category of participants; sending the target file to the terminal of the second type of participant; When a target participant's sharing operation on the target file is detected, obtaining a screenshot video stream and a sharing operation instruction of the target participant's terminal; The screenshot video stream is sent to the terminal of the first type of participant, and the sharing operation instruction is sent to the terminal of the second type of participant. The terminal of the first type of participant displays the screenshot video stream when receiving the screenshot video stream, and the terminal of the second type of participant loads the target file and operates the target file according to the sharing operation instruction when receiving the sharing operation instruction.

[0006] As a further limitation of the technical solution of the embodiment of the present invention, before obtaining the target file shared in the conference and the information of each participant, the following steps are specifically included: The conference reservation information is received, wherein the reservation information includes the storage address of the target file and the participant ID.

[0007] As a further limitation of the technical solution of the embodiment of the present invention, obtaining the target file shared in the conference and the information of each participant specifically includes the following steps: When a conference establishment event is detected, the storage address of the target file and the participant ID are read from the reservation information; The target file is read from the storage address, and the terminal hardware information, network bandwidth and network delay of the participant are obtained through the participant ID to serve as the participant information.

[0008] As a further limitation of the technical solution of the embodiment of the present invention, determining the network performance score of each participant based on the information of the participant, and determining the first category of participants and the second category of participants according to the network performance score specifically includes the following steps: Inputting the information of the participant into a preset scoring model to obtain a network performance score of the participant; Participants whose network performance scores are greater than a threshold are determined as first-category participants, and participants whose network performance scores are less than or equal to the threshold are determined as second-category participants.

[0009] As a further limitation of the technical solution of the embodiment of the present invention, the information of the participant includes terminal hardware information, network bandwidth and network delay of the terminal used by the participant, and determining the network performance score of each participant based on the information of the participant specifically includes the following steps: Inputting the terminal hardware information into a terminal scoring model to obtain a hardware score; Determine the network bandwidth score and the network delay score in the preset network bandwidth score table and network delay score table; The network performance score of the participant is calculated using the hardware score, the network bandwidth score, the network delay score and the preset weight.

[0010] As a further limitation of the technical solution of the embodiment of the present invention, when a target participant's sharing operation on the target file is detected, obtaining the screenshot video stream and sharing operation instruction of the terminal of the target participant specifically includes the following steps: When a target participant's sharing operation on the target file is detected, a screenshot interface is called to take a screenshot of the target participant's terminal desktop according to a preset period to obtain a screenshot video stream; The application program that opens the target file is monitored through a preset hook program to hook the sharing operation instruction corresponding to the sharing operation.

[0011] As a further limitation of the technical solution of the embodiment of the present invention, before sending the screenshot video stream to the terminal of the first type of participant and sending the sharing operation instruction to the terminal of the second type of participant, the following steps are specifically included: The screenshot video stream is stored in a video pool preconfigured for the conference, wherein the screenshot video stream received first in the video pool is stored at the top of the video pool, and the screenshot video stream received later is stored at the bottom of the video pool; The sharing operation instructions are stored in an instruction pool preconfigured for the conference, in which the sharing operation instructions received first are stored at the top of the instruction pool, and the sharing operation instructions received later are stored at the bottom of the instruction pool.

[0012] As a further limitation of the technical solution of the embodiment of the present invention, each screenshot video stream and sharing operation instruction has a timestamp, and sending the screenshot video stream to the terminal of the first type of participant, and sending the sharing operation instruction to the terminal of the second type of participant, specifically includes the following steps: Extracting target screenshot video stream and target sharing operation instruction with the same timestamp from the video pool and the instruction pool respectively; Sending the target screenshot video stream to the terminals of the first type of participants; The target sharing operation instruction is sent to the terminals of the first category of participants.

[0013] An interactive conference management system, specifically comprising the following units: A target file and participant information acquisition unit, used to acquire the target file shared in the conference and the information of each participant; a participant classification unit, configured to determine a network performance score of each participant based on the information of the participant, and determine a first type of participant and a second type of participant according to the network performance score, wherein the network performance of the first group of participants is better than the network performance of the second group of participants; a target file sending unit, used for sending the target file to the terminal of the second type of participant; A video stream and operation instruction acquisition unit, used to acquire the screenshot video stream and sharing operation instruction of the terminal of the target participant when detecting the target participant's sharing operation on the target file; The video stream and operation instruction sending unit is used to send the screenshot video stream to the terminal of the first type of participant, and send the sharing operation instruction to the terminal of the second type of participant, the terminal of the first type of participant displays the screenshot video stream when receiving the screenshot video stream, and the terminal of the second type of participant loads the target file and operates the target file according to the sharing operation instruction when receiving the sharing operation instruction.

[0014] As a further limitation of the technical solution of the embodiment of the present invention, the following steps are specifically included: The conference reservation information receiving unit is used to receive the conference reservation information, wherein the reservation information includes the storage address of the target file and the participant ID.

[0015] Compared with the prior art, the present invention has the following beneficial effects: The embodiment of the present invention obtains the target file for conference sharing and the information of each participant, determines the network performance score of each participant based on the information of the participant, further determines the first type of participant whose network performance is better than the second type of participant according to the network performance score, and after sending the target file to the terminal of the second type of participant, when detecting the target participant's sharing operation on the target file, obtains the screenshot video stream and the sharing operation instruction of the terminal of the target participant, and sends the screenshot video stream to the terminal of the first type of participant, and sends the sharing operation instruction to the terminal of the second type of participant, thereby realizing that by dividing each participant into the first type of participant and the second type of participant according to network performance, the first type of participant with better network performance is sent a shared screenshot video stream, and the network performance is improved. The system can send sharing operation instructions to the second-category participant with lower network performance, thereby managing the participants and the data in the conference according to the network performance of the participants. When the network performance is poor, sharing operation instructions with a small amount of data are sent to the terminals of the second-category participant, so that the terminals of the second-category participant can directly operate on the target file through the sharing operation instructions to generate a shared screen. The terminals of the second-category participant do not need to decode the video stream, which improves the speed of the terminals of the second-category participant in generating document sharing screens, reduces the delay of the terminals of the second-category participant in generating document sharing screens, shortens the time difference between the terminals of the second-category participant with poor network performance and the terminals of the first-category participant with good network performance in displaying the document sharing screen, and improves the synchronization performance of all participants in displaying the document sharing screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention.

[0017] Figure 1A flow chart of an interactive conference management method provided by an embodiment of the present invention is shown.

[0018] Figure 2 A schematic diagram of interactive conference management is shown; Figure 3 The application architecture diagram of an interactive conference management system provided by an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0019] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0020] Figure 1 The flowchart of the interactive conference management method provided by the embodiment of the present invention is shown. Specifically, the interactive conference management method of the embodiment of the present invention specifically includes the following steps: Step S101, obtaining the target file to be shared in the conference and the information of each participant.

[0021] The meeting in this embodiment refers to an online or cloud-based interactive meeting. Online may refer to online networks such as the Internet, the Internet of Things, and the visual network. The interactive meeting can be achieved through a computer network combined with a camera, a microphone, a multimedia playback device, and a participant terminal. The meeting can be scheduled online first, and an online meeting can be established when the scheduled time arrives. Each participant can participate in the meeting after verifying his or her account.

[0022] When the conference host schedules a meeting, the online conference system of this embodiment can receive the conference reservation information, which includes the storage address of the target file and the participant ID. For example, user A, as the initiator or host of the meeting, can schedule a meeting on the client of the online interactive conference. When scheduling a meeting, user A can enter the meeting topic, select participants, import target files, etc. on the conference client, so that the server of the interactive conference system can receive the storage address of the target file after import and the ID of the selected participant from the conference client.

[0023] When the server detects a conference establishment event, it can read the storage address of the target file and the participant ID from the reservation information, read the target file from the storage address, and obtain the hardware information, network bandwidth and network delay of the participant's terminal through the participant ID as the participant's information, wherein the conference establishment event can be the arrival of the system time at the reservation time of the meeting, or the initiator or host of the meeting establishes the meeting, then the pre-stored target file can be read from the storage address in the reservation information of the meeting, the target file can be a file related to the conference theme used during the interaction during the meeting, the format of the target file can be an electronic document (WORD document), a presentation (PPT), etc., and the participant ID is obtained, and the participant's information is further obtained through the participant ID, which information may include hardware information such as the processor, memory, graphics processor, display screen, operating system, etc. of the terminal used by the participant, and may also include network information such as network bandwidth and network delay.

[0024] In one example, historical information of a participant may be obtained through the participant ID. For example, hardware information, network bandwidth, and network delay of a terminal used by the participant when attending historical conferences may be obtained through the participant ID.

[0025] In another example, when it is detected that a participant joins the conference through a participant ID, a request can be sent to the terminal logged in by the participant ID to obtain hardware information of the terminal logged in by the participant ID and information such as the network bandwidth and network latency of the network used.

[0026] Step S102, determining the network performance score of each participant based on the information of the participant, and determining the first category of participants and the second category of participants according to the network performance score, wherein the network performance of the first category of participants is better than the network performance of the second category of participants.

[0027] The network performance score reflects the performance of the terminal and network used by the participant. The higher the network performance score, the higher the performance of the terminal and network used by the participant.

[0028] In one embodiment, the information of the participants can be input into a preset scoring model to obtain the network performance score of the participants. For example, the scoring model can be pre-trained. The scoring model can be trained by user information with scores marked. For example, the user information used for training can include the hardware information and network information of the terminal used by the user. Then, the scoring model is trained using the existing model training method using the user information with the marked scores. After the model outputs a predicted score and the loss rate is calculated by the predicted score and the marked score, the model parameters are adjusted by the loss rate when the loss rate is greater than a threshold. The model is continuously trained using the user information until the loss rate is less than the threshold or the number of trainings reaches a preset number of times, thereby obtaining a trained scoring model. In the prediction stage, the network performance score of the participants can be obtained by inputting the hardware, network and other information of the participants of the meeting into the scoring model.

[0029] In another embodiment, the terminal hardware information of the participant can also be input into the terminal scoring model to obtain the hardware score, and the network bandwidth score and network delay score can be determined in the preset network bandwidth score table and network delay score table. The hardware score, network bandwidth score, network delay score and preset weights are used to calculate the network performance score of the participant, such as calculating the weighted sum as the network performance score, or calculating the weighted average as the network performance score.

[0030] After calculating the network performance scores of the participants, the participants whose network performance scores are greater than a threshold can be determined as first-category participants, and the participants whose network performance scores are less than or equal to the threshold can be determined as second-category participants, that is, the participants are divided into first-category participants with better network performance and second-category participants with poorer network performance according to their network performance scores.

[0031] Step S103: sending the target file to the terminals of the second type of participants.

[0032] In one embodiment, the server may send the target file directly to the terminal of the second type of participant. In another embodiment, the server may send the storage address of the target file to the terminal of the second type of participant. After the conference client on the terminal of the second type of participant receives the storage address, it downloads the target file to the local storage on the terminal of the second type of participant through the storage address.

[0033] Step S104, when a target participant's sharing operation on a target file is detected, a screenshot video stream and a sharing operation instruction of the target participant's terminal are obtained.

[0034] Any participant in the conference can initiate a sharing operation on the target file. The initiator of the sharing operation of the target file is the target participant. For example, the target participant can usually be the conference initiator or host. After the target participant selects the screen sharing operation on the conference client on the terminal, the target file is opened through the local application to achieve target file sharing. The conference client can obtain the screenshot video stream and sharing operation instructions of the target participant's terminal.

[0035] Specifically, when a target participant's sharing operation on a target file is detected, the screenshot interface is called to capture a screenshot of the target participant's terminal desktop according to a preset period to obtain a screenshot video stream, and the application that opens the target file is monitored through a preset hook program to hook the sharing operation instruction corresponding to the sharing operation.

[0036] In one example, a desktop screenshot interface can be set in a conference client. When a sharing operation is detected, the screenshot interface is triggered to capture the desktop of the target participant's terminal according to a preset period to obtain a screenshot video stream. Taking the operating system of the target participant's terminal as Windows as an example, the Windows dynamic link library file can be injected into the desktop window manager, wherein the dynamic link library file has a screen recording function, and a rendering function for displaying the desktop data in the video memory on the desktop is determined. The rendering function is replaced with a screen recording function, so that the screen recording function can receive an operation to display the desktop data, and when the conference client is running, the desktop data is output to the conference client. The conference client sends the shared desktop data as a screenshot video stream to the server through the target participant's terminal, and the server can receive the screenshot video stream.

[0037] Taking Windows as an example, the desktop window manager (DWM) is responsible for generating the desktop screen under Windows. The dynamic link library file allows programs to share the code and other resources necessary to perform special tasks. The dynamic link library file DWMCapture.dll used for desktop data collection can be injected into the desktop window manager dwm.exe. The dynamic link library file DWMCapture.dll contains a screen recording function, which can copy the desktop data in the video memory under Windows and send it to the conference guest. In Windows, the screen recording function can be: CDWMCapture::IDXGISwapChainDWM_Present.In addition, in Windows, DXGI (Microsoft DirectX Graphics Infrastructure) can be used to accelerate the provision of desktop images. DXGI is the underlying graphics device interface in user mode in the Windows system. The factory interface DXGIFactory of the graphics device interface can be generated through DXGI. The factory interface DXGIFactory contains the swap chain creation interface DXGIFactoryDWM. The swap chain creation interface DXGIFactoryDWM is used to create the swap chain interface IDXGISwapChainDWM. The swap chain interface IDXGISwapChainDWM has a virtual function table, and its virtual function table indicates the function that the swap chain interface IDXGISwapChainDWM should actually call. For example, the virtual function table contains the address of the function called by the swap chain interface IDXGISwapChainDWM. The 8th item in the virtual function table of the swap chain interface IDXGISwapChainDWM is the execution point Present where the operating system generates the desktop screen, that is, the 8th item is the address of the rendering function. The value of the 8th item in the virtual function table of the exchange link interface IDXGISwapChainDWM is modified to the address of the screen recording function CDWMCapture::IDXGISwapChainDWM_Present in the dynamic link library file DWMCapture.dll. When the desktop window manager dwm.exe calls the virtual function IDXGISwapChainDWM::Present, since the 8th item in the virtual function table has been modified to the address of the screen recording function, the desktop window manager dwm.exe first calls the screen recording function CDWMCapture::IDXGISwapChainDWM_Present of DWMCapture.dll, and copies the desktop data in the video memory through the screen recording function and outputs it to the conference client, so that the conference client obtains the desktop of the terminal of the target participant to generate a screenshot video stream and send it to the server. Of course, the above example uses the Windows operating system as an example. Other systems can refer to Windows and will not be described in detail here.

[0038] For sharing operation instructions, a hook program can be set in the conference client. The hook is a platform of Windows message processing mechanism. The conference client can set a subroutine to monitor certain messages of the specified window, and the monitored window can be created by other processes. The hook mechanism allows the application to intercept and process Windows messages or specific events. Specifically in this embodiment, the hook in the conference client can be triggered by a sharing operation, and the relevant message of opening the target file can be hooked. Taking the target file as a word document as an example, the conference client can hook the user operation on the currently opened word document (target file) through the hook, and obtain the corresponding instruction as the sharing operation instruction, such as the user's operation instructions such as clicking, dragging, scrolling, etc. on the word document through the mouse.

[0039] In one embodiment, the server can pre-configure a video pool and a command pool for each conference, and can store the received screenshot video stream in the video pool, and store the received sharing operation instruction in the command pool, wherein the screenshot video stream received first in the video pool is stored at the top of the video pool, and the screenshot video stream received later is stored at the bottom of the video pool, and the sharing operation instruction received first in the command pool is stored at the top of the command pool, and the sharing operation instruction received later is stored at the bottom of the command pool. In this way, the screenshot video stream or sharing operation instruction stored first is processed first, and the order of the screenshot video stream and the instruction is guaranteed.

[0040] Step S105, sending the screenshot video stream to the terminal of the first type of participant, and sending the sharing operation instruction to the terminal of the second type of participant, the terminal of the first type of participant displays the screenshot video stream when receiving the screenshot video stream, and the terminal of the second type of participant loads the target file and operates the target file according to the sharing operation instruction when receiving the sharing operation instruction.

[0041] In one embodiment, each screenshot video stream and sharing operation instruction has a timestamp. For example, each time a screenshot video stream is generated, the start time of the screenshot video stream is marked as a target timestamp, and the sharing operation instruction sequence in the screenshot video stream is also marked with the same target timestamp, so that each screenshot video stream and its corresponding sharing operation instruction have the same timestamp. The server can respectively extract the target screenshot video stream and target sharing operation instruction with the same timestamp from the video pool and the instruction pool, send the target screenshot video stream to the terminal of the first type of participant, and send the target sharing operation instruction to the terminal of the first type of participant.

[0042] After the terminal of the first type of participant receives the target screenshot video stream, it decodes the screenshot video stream and plays and displays it, so as to display the desktop shared by the target participant on the terminal of the first type of participant. After the sharing operation instruction initiates desktop sharing, the terminal of the second type of participant can load the pre-downloaded target file, and when receiving the target sharing operation instruction, operate the loaded target file through the target sharing operation instruction, so as to realize the synchronous operation of the target file with the target participant on the terminal of the second type of participant. Moreover, since the network performance of the second type of participant is lower than that of the first type of participant, the network bandwidth required for transmitting the sharing operation instruction to the terminal of the second type of participant is smaller than that for transmitting the screenshot video stream to the terminal of the first type of participant, the efficiency of transmitting the sharing operation instruction to the terminal of the second type of participant is improved, the transmission delay of the sharing operation instruction is shortened, and the target file operation is directly synchronized with the terminal of the target participant through the sharing operation instruction at the local terminal of the second type of participant. The terminal of the second type of participant does not need to receive and decode the screenshot video stream, and can quickly display the file sharing desktop synchronized with the terminal of the target participant, shortening the time difference for all participants to display the shared desktop of the target participant, and improving the synchronization performance of all participants in displaying the shared desktop.

[0043] like Figure 2 FIG. 1 is a schematic diagram of interactive conference management according to an embodiment of the present invention. Figure 2As shown, multiple participant terminals are connected to the server. When participant 1 terminal and participant n terminal form conference A, and participant 1 terminal as the host terminal needs to initiate target file F sharing interaction, the server first establishes a video pool and a command pool for conference A, and after determining the first type of participants and the second type of participants through the information from participant 1 terminal to participant n terminal, the server sends the target file F to the terminals of the second type of participants from participant 1 terminal to participant n terminal. After participant 1 terminal opens the target file F and initiates screen sharing, the conference client on participant 1 terminal synchronously obtains the screenshot video stream and the sharing operation instruction, and sends the screenshot video stream and the sharing operation instruction to the server. The server stores the screenshot video stream at the bottom of the video pool, stores the sharing operation instruction at the bottom of the instruction pool, and extracts the earliest target screenshot video stream and target sharing with the same timestamp from the video pool and the instruction pool. The target screenshot video stream is sent to the terminal of the first type of participant, and the target sharing operation instruction is sent to the terminal of the second type of participant. The terminal of the first type of participant decodes the received target screenshot video stream and displays it, so as to synchronously display the target document F with the same content on the terminal of participant 1 (for example, the mouse is positioned on the terminal of participant 1 to the 10th page of the target document F). After the terminal of the second type of participant receives the sharing operation instruction (for example, the mouse is positioned on the terminal of participant 1 to the 10th page of the target document F), according to the target sharing operation instruction, the terminal of the second type of participant synchronously performs the same operation on the target file F as the terminal of participant 1 on the target file F opened locally (for example, the 10th page of the target document F is positioned in the locally opened target file F), so that the terminal of the second type of participant synchronously displays the target document F with the same content on the terminal of participant 1 (both display the 10th page of the target document F).

[0044] The embodiment of the present invention obtains the target file for conference sharing and the information of each participant, determines the network performance score of each participant based on the information of the participant, further determines the first type of participant whose network performance is better than the second type of participant according to the network performance score, and after sending the target file to the terminal of the second type of participant, when detecting the target participant's sharing operation on the target file, obtains the screenshot video stream and the sharing operation instruction of the terminal of the target participant, and sends the screenshot video stream to the terminal of the first type of participant, and sends the sharing operation instruction to the terminal of the second type of participant, thereby realizing that by dividing each participant into the first type of participant and the second type of participant according to network performance, the first type of participant with better network performance is sent a shared screenshot video stream, and the network performance is improved. The system can send sharing operation instructions to the second-category participant with lower network performance, thereby managing the participants and the data in the conference according to the network performance of the participants. When the network performance is poor, sharing operation instructions with a small amount of data are sent to the terminals of the second-category participant, so that the terminals of the second-category participant can directly operate on the target file through the sharing operation instructions to generate a shared screen. The terminals of the second-category participant do not need to decode the video stream, which improves the speed of the terminals of the second-category participant in generating document sharing screens, reduces the delay of the terminals of the second-category participant in generating document sharing screens, shortens the time difference between the terminals of the second-category participant with poor network performance and the terminals of the first-category participant with good network performance in displaying the document sharing screen, and improves the synchronization performance of all participants in displaying the document sharing screen.

[0045] Figure 3 The application architecture diagram of the interactive conference management system provided by the embodiment of the present invention is shown. The interactive conference management system of this embodiment specifically includes the following units: The target file and participant information acquisition unit 301 is used to acquire the target file shared in the conference and the information of each participant; A participant classification unit 302 is used to determine a network performance score of each participant based on the information of the participant, and determine a first type of participant and a second type of participant according to the network performance score, wherein the network performance of the first group of participants is better than the network performance of the second group of participants; A target file sending unit 303, configured to send the target file to a terminal of the second type of participant; The video stream and operation instruction acquisition unit 304 is used to acquire the screenshot video stream and sharing operation instruction of the terminal of the target participant when detecting the target participant's sharing operation on the target file; The video stream and operation instruction sending unit 305 is used to send the screenshot video stream to the terminal of the first type of participant, and to send the sharing operation instruction to the terminal of the second type of participant. The terminal of the first type of participant displays the screenshot video stream when receiving the screenshot video stream, and the terminal of the second type of participant loads the target file and operates the target file according to the sharing operation instruction when receiving the sharing operation instruction.

[0046] As a further limitation of the technical solution of the embodiment of the present invention, the following steps are specifically included: The conference reservation information receiving unit is used to receive the conference reservation information, wherein the reservation information includes the storage address of the target file and the participant ID.

[0047] As a further limitation of the technical solution of the embodiment of the present invention, the target file and participant information acquisition unit 301 specifically includes the following modules: A reservation information reading module, used to read the storage address of the target file and the participant ID from the reservation information when a conference establishment event is detected; The target file and network data reading module is used to read the target file from the storage address, and obtain the terminal hardware information, network bandwidth and network delay of the participant through the participant ID as the participant information.

[0048] As a further limitation of the technical solution of the embodiment of the present invention, the participant classification unit 302 specifically includes the following modules: A network performance scoring module, used to input the information of the participant into a preset scoring model to obtain the network performance score of the participant; The participant classification module is used to determine the participants whose network performance scores are greater than a threshold as first-category participants, and to determine the participants whose network performance scores are less than or equal to the threshold as second-category participants.

[0049] As a further limitation of the technical solution of the embodiment of the present invention, the information of the participant includes the terminal hardware information, network bandwidth and network delay of the terminal used by the participant, and the participant classification unit 302 specifically includes the following modules: A hardware scoring module, used for inputting the terminal hardware information into a terminal scoring model to obtain a hardware score; A network score scoring module is used to determine the network bandwidth score and the network delay score in a preset network bandwidth score table and a network delay score table; The network performance score calculation module is used to calculate the network performance score of the participant by using the hardware score, the network bandwidth score, the network delay score and the preset weight.

[0050] As a further limitation of the technical solution of the embodiment of the present invention, the video stream and operation instruction acquisition unit 304 specifically includes the following modules: A screenshot module is used to call a screenshot interface to take a screenshot of the terminal desktop of the target participant according to a preset period when a target participant's sharing operation on the target file is detected, so as to obtain a screenshot video stream; The operation instruction monitoring module is used to monitor the application program that opens the target file through a preset hook program to hook the sharing operation instruction corresponding to the sharing operation.

[0051] As a further limitation of the technical solution of the embodiment of the present invention, the following units are specifically included: A video stream storage unit, used for storing the screenshot video stream into a video pool preconfigured for the conference, wherein the screenshot video stream received first in the video pool is stored at the top of the video pool, and the screenshot video stream received later is stored at the bottom of the video pool; The instruction storage unit is used to store the shared operation instructions in an instruction pool preconfigured for the conference, wherein the shared operation instructions received first in the instruction pool are stored at the top of the instruction pool, and the shared operation instructions received later are stored at the bottom of the instruction pool.

[0052] As a further limitation of the technical solution of the embodiment of the present invention, each screenshot video stream and sharing operation instruction has a timestamp, and the video stream and operation instruction sending unit 305 specifically includes the following modules: A video stream and operation instruction determination module, used to extract a target screenshot video stream and a target sharing operation instruction with the same timestamp from the video pool and the instruction pool respectively; A video stream sending module, used for sending the target screenshot video stream to the terminal of the first type of participant; The instruction sending module is used to send the target sharing operation instruction to the terminals of the first type of participants.

[0053] It should be understood that, although each step in the flow chart of each embodiment of the present invention is shown in sequence according to the indication of the arrow, these steps are not necessarily performed in sequence according to the order indicated by the arrow. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be performed in other orders. Moreover, at least a portion of the steps in each embodiment may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and the execution order of these sub-steps or stages is not necessarily performed in sequence, but can be performed in turn or alternately with at least a portion of other steps or sub-steps or stages of other steps.

[0054] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0055] The technical features of the above embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0056] The above embodiments only express several implementation methods of the present invention, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present invention. It should be pointed out that, for a person of ordinary skill in the art, several modifications and improvements can be made without departing from the concept of the present invention, and these all belong to the protection scope of the present invention. Therefore, the protection scope of the present invention patent shall be subject to the attached claims.

[0057] The above are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. An interactive conference management method, characterized in that: The specific steps include: Get the target file shared in the conference and the information of each participant; Determine a network performance score for each participant based on the information of the participant, and determine a first category of participants and a second category of participants according to the network performance score, wherein the network performance of the first category of participants is better than the network performance of the second category of participants; sending the target file to the terminal of the second type of participant; When a target participant's sharing operation on the target file is detected, obtaining a screenshot video stream and a sharing operation instruction of the target participant's terminal; The screenshot video stream is sent to the terminal of the first type of participant, and the sharing operation instruction is sent to the terminal of the second type of participant. The terminal of the first type of participant displays the screenshot video stream when receiving the screenshot video stream, and the terminal of the second type of participant loads the target file and operates the target file according to the sharing operation instruction when receiving the sharing operation instruction.

2. The interactive conference management method according to claim 1, characterized in that: Before obtaining the target file shared in the conference and the information of each participant, the following steps are specifically included: The reservation information of the conference is received, wherein the reservation information includes the storage address of the target file and the participant ID.

3. The interactive conference management method according to claim 2, characterized in that: Obtaining the target file shared in the conference and the information of each participant includes the following steps: When a conference establishment event is detected, the storage address of the target file and the participant ID are read from the reservation information; The target file is read from the storage address, and the terminal hardware information, network bandwidth and network delay of the participant are obtained through the participant ID to serve as the participant information.

4. The interactive conference management method according to claim 2, characterized in that: Determining a network performance score of each participant based on the information of the participant, and determining a first category of participants and a second category of participants according to the network performance score, specifically includes the following steps: Inputting the information of the participant into a preset scoring model to obtain a network performance score of the participant; Participants whose network performance scores are greater than a threshold are determined as first-category participants, and participants whose network performance scores are less than or equal to the threshold are determined as second-category participants.

5. The interactive conference management method according to claim 4, characterized in that: The information of the participant includes the terminal hardware information, network bandwidth and network delay of the terminal used by the participant, and determining the network performance score of each participant based on the information of the participant specifically includes the following steps: Inputting the terminal hardware information into a terminal scoring model to obtain a hardware score; Determine the network bandwidth score and the network delay score in the preset network bandwidth score table and network delay score table; The network performance score of the participant is calculated using the hardware score, the network bandwidth score, the network delay score and the preset weight.

6. The interactive conference management method according to any one of claims 1 to 5, characterized in that: When a target participant's sharing operation on the target file is detected, obtaining a screenshot video stream and a sharing operation instruction of the target participant's terminal specifically includes the following steps: When a target participant's sharing operation on the target file is detected, a screenshot interface is called to take a screenshot of the target participant's terminal desktop according to a preset period to obtain a screenshot video stream; The application program that opens the target file is monitored through a preset hook program to hook the sharing operation instruction corresponding to the sharing operation.

7. The interactive conference management method according to any one of claims 1 to 5, characterized in that: Before sending the screenshot video stream to the terminal of the first type of participant and sending the sharing operation instruction to the terminal of the second type of participant, the method further includes the following steps: The screenshot video stream is stored in a video pool preconfigured for the conference, wherein the screenshot video stream received first in the video pool is stored at the top of the video pool, and the screenshot video stream received later is stored at the bottom of the video pool; The sharing operation instructions are stored in an instruction pool preconfigured for the conference, in which the sharing operation instructions received first are stored at the top of the instruction pool, and the sharing operation instructions received later are stored at the bottom of the instruction pool.

8. The interactive conference management method according to claim 7, characterized in that: Each screenshot video stream and sharing operation instruction has a timestamp, and sending the screenshot video stream to the terminal of the first type of participant and sending the sharing operation instruction to the terminal of the second type of participant specifically includes the following steps: Extracting target screenshot video stream and target sharing operation instruction with the same timestamp from the video pool and the instruction pool respectively; Sending the target screenshot video stream to the terminals of the first type of participants; The target sharing operation instruction is sent to the terminals of the first category of participants.

9. An interactive conference management system, characterized in that: It includes the following units: A target file and participant information acquisition unit, used to acquire the target file shared in the conference and the information of each participant; a participant classification unit, configured to determine a network performance score of each participant based on the information of the participant, and determine a first type of participant and a second type of participant according to the network performance score, wherein the network performance of the first group of participants is better than the network performance of the second group of participants; a target file sending unit, used for sending the target file to the terminal of the second type of participant; A video stream and operation instruction acquisition unit, used to acquire the screenshot video stream and sharing operation instruction of the terminal of the target participant when detecting the target participant's sharing operation on the target file; The video stream and operation instruction sending unit is used to send the screenshot video stream to the terminal of the first type of participant, and send the sharing operation instruction to the terminal of the second type of participant, the terminal of the first type of participant displays the screenshot video stream when receiving the screenshot video stream, and the terminal of the second type of participant loads the target file and operates the target file according to the sharing operation instruction when receiving the sharing operation instruction.

10. The interactive conference management system according to claim 9, characterized in that: The specific steps include: The conference reservation information receiving unit is used to receive the conference reservation information, wherein the reservation information includes the storage address of the target file and the participant ID.

Images