Video conference information sharing method, video conference system, terminal and medium

Abstract

The invention provides an information sharing method of a video conference, a video conference system, a terminal, a storage medium and a computer program product, and the information sharing method comprises the steps: transmitting screen sharing information to a second terminal, so as to enable the second terminal to display the screen sharing information; obtaining operation information for the screen sharing information, or determining screen display updating information; generating screen display control data according to the operation information or the screen display updating information; and sending the screen display control data to the second terminal, so that the second terminal performs display control processing according to the screen display control data. According to the method and the device, a screen or a document and the like do not need to be collected in real time in the video conference, so that the amount of data needing to be transmitted in the video conference is reduced, the demand on network resources is reduced, the operation cost is saved, the timeliness of data transmission is improved, the quality of the video conference is improved, and the use experience of a user is improved.

Description

Technical Field

[0001] The present application relates to the technical field of video conferencing, and in particular to a video conferencing information sharing method, a video conferencing system, a terminal, a storage medium, and a computer program product. Background Art

[0002] A video conferencing system is a system that provides multi-person video conferencing functions to users. In a video conference, participants can share screens, files and other information as sharers, and other participants can see the information shared by the sharers in real time. For information such as desktops, windows, and documents shared in a video conference, a live broadcast mode is usually used to collect the desktops, windows, and documents shared on the sharer's screen, encode the collected data, and transmit the encoded data to the terminals of other participants through the conference server for decoding and display. For the shared desktop, window, document and other information, its display on the sharer's screen may not change for a long time, or may only change in a local area of ​​the screen. However, at present, for the desktop, window, document and other information that does not change or partially changes on the sharer's screen, the entire screen or the entire document is still collected in real time, and the collected data is encoded, and the encoded data is transmitted to the terminals of other participants through the conference server, which increases the amount of data to be transmitted in the video conference, has high requirements for network bandwidth, increases the demand for network resources, and increases operating costs; and when the amount of transmitted data is large, it may cause network congestion, reduce the timeliness of data transmission, and affect the quality of the video conference. Summary of the invention

[0003] The present disclosure provides a video conference information sharing method, a video conference system, a terminal, a storage medium and a computer program product.

[0004] According to a first aspect of the present disclosure, there is provided a method for sharing information of a video conference, which is applied to a first terminal, and includes: sending screen sharing information to a second terminal so that the second terminal displays the screen sharing information; obtaining operation information for the screen sharing information, or determining screen display update information; generating screen display control data according to the operation information or the screen display update information; and sending the screen display control data to the second terminal so that the second terminal performs display control processing according to the screen display control data.

[0005] Optionally, the screen sharing information includes an electronic document, and sending the screen sharing information to the second terminal so that the second terminal displays the screen sharing information includes: sending the electronic document to the second terminal so that the second terminal opens and displays the electronic document.

[0006] Optionally, the acquiring operation information for the screen sharing information includes: acquiring operation information corresponding to the electronic document, wherein the operation information includes a document operation instruction executed on the electronic document and first position information corresponding to the document operation instruction.

[0007] Optionally, the screen display control data includes a document display control instruction and second position information corresponding to the document display control instruction, and generating the screen display control data includes: generating the document display control instruction according to the document operation instruction; and generating the second position information according to the first position information.

[0008] Optionally, the screen sharing information includes a first image frame captured in a static screen sharing area, and sending the screen sharing information to the second terminal so that the second terminal displays the screen sharing information includes: sending the first image frame to the second terminal so that the second terminal displays the first image frame.

[0009] Optionally, determining the screen display update information includes: periodically capturing a second image frame of the screen sharing area; determining pixel value difference information between the currently captured second image frame and the previously captured second image frame or first image frame; determining whether there is a dynamic area in the currently captured second image frame based on the pixel value difference information; and when it is determined that there is a dynamic area, determining the screen display update information based on the dynamic area, wherein the screen display update information includes area range information of the dynamic area.

[0010] Optionally, the screen display control data includes a first image and area position information, and generating the screen display control data includes: generating the area position information according to the area range information; and acquiring an image located within the dynamic area in the currently acquired second image frame as the first image according to the area range information.

[0011] Optionally, the screen sharing information and the screen display control data are sent to the second terminal via a conference server.

[0012] According to a second aspect of the present disclosure, a method for sharing information in a video conference is provided, which is applied to a second terminal and includes: receiving and displaying screen sharing information sent by a first terminal; receiving screen display control data sent by the first terminal, and performing display control processing according to the screen display control data.

[0013] Optionally, the screen sharing information includes an electronic document, and the receiving and displaying the screen sharing information sent by the first terminal includes: receiving the electronic document sent by the first terminal, opening the electronic document, and displaying it.

[0014] Optionally, the screen display control data includes a document display control instruction and second position information corresponding to the document display control instruction, and the performing display control processing according to the screen display control data includes: updating the content displayed by the electronic document according to the document display control instruction and the second position information.

[0015] Optionally, the screen sharing information includes a first image frame captured by the first terminal in a static screen sharing area, and receiving and displaying the screen sharing information sent by the first terminal includes: receiving and displaying the first image frame sent by the first terminal.

[0016] Optionally, the screen display control data includes a first image and area position information, and the display control processing according to the screen display control data includes: determining an update area image in a third image frame currently displayed according to the area position information; removing the update area image from the third image frame to obtain a second image; and splicing the first image with the second image to obtain a fourth image frame and displaying it.

[0017] According to a third aspect of the present disclosure, a video conferencing system is provided, comprising: a first terminal, comprising a memory, and a processor coupled to the memory, the processor being configured to execute the information sharing method for the video conferencing applied to the first terminal based on instructions stored in the memory; a second terminal, comprising a memory, and a processor coupled to the memory, the processor being configured to execute the information sharing method for the video conferencing applied to the second terminal based on instructions stored in the memory.

[0018] According to a fourth aspect of the present disclosure, a terminal is provided, comprising: a memory; and a processor coupled to the memory, wherein the processor is configured to execute the above-mentioned video conference information sharing method based on instructions stored in the memory.

[0019] According to a fifth aspect of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and when the instructions are executed by a processor, the information sharing method for video conferencing as described above or the information sharing method for video conferencing as described above is implemented.

[0020] According to a sixth aspect of the present disclosure, a computer program product is provided, wherein the computer program product stores computer instructions, and when the computer instructions are executed by a processor, the information sharing method for video conferencing as described above or the information sharing method for video conferencing as described above is implemented.

[0021] The information sharing method, video conferencing system, terminal, storage medium and computer program product of the video conferencing disclosed herein, the first terminal obtains operation information for screen sharing information, or determines screen display update information, generates screen display control data according to the operation information or the screen display update information, and sends the screen display control data to the second terminal, so that the second terminal performs display control processing according to the screen display control data; in the video conference, there is no need to collect the screen or documents in real time, which reduces the amount of data that needs to be transmitted in the video conference, reduces the demand for network resources, saves operating costs, improves the timeliness of data transmission, improves the quality of the video conference, and improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] By describing the embodiments of the present disclosure in more detail in conjunction with the accompanying drawings, the above and other purposes, features and advantages of the present disclosure will become more apparent. The accompanying drawings are used to provide a further understanding of the embodiments of the present disclosure and constitute a part of the specification. Together with the embodiments of the present disclosure, they are used to explain the present disclosure and do not constitute a limitation of the present disclosure. The above and other purposes and advantages of the present disclosure will be further described below in conjunction with specific embodiments and with reference to the accompanying drawings. In the accompanying drawings, the same or corresponding technical features or components will be represented by the same or corresponding figure marks.

[0023] Figure 1 A flowchart of some embodiments of the information sharing method of a video conference according to the present disclosure;

[0024] Figure 2 A schematic diagram of a flow chart of generating screen display control data for an electronic document in some embodiments of the information sharing method for a video conference according to the present disclosure;

[0025] Figure 3 A schematic diagram of a process of determining screen display update information in some embodiments of the video conference information sharing method according to the present disclosure;

[0026] Figure 4 Schematic diagram of the flow of other embodiments of the information sharing method of the video conference according to the present disclosure;

[0027] Figure 5 It is a flowchart of display control processing in other embodiments of the information sharing method of the video conference according to the present disclosure;

[0028] Figure 6 Schematic diagram of modules of some embodiments of the information sharing device for video conferencing disclosed in the present invention;

[0029] Figure 7 is a schematic diagram of modules of some embodiments of the first terminal according to the present disclosure;

[0030] Figure 8 Schematic diagrams of modules of other embodiments of the information sharing device for video conferencing disclosed in the present invention;

[0031] Fig. 9 Schematic diagram of modules of some embodiments of the second terminal according to the present disclosure. DETAILED DESCRIPTION

[0032] Exemplary embodiments of the present disclosure will be described below in conjunction with the accompanying drawings. For the sake of clarity and conciseness, not all features of the embodiments are described in the specification. However, it should be understood that many implementation-specific settings must be made in the process of implementing the embodiments in order to achieve the specific goals of the developer, for example, to meet those restrictions related to the device and the service, and these restrictions may vary depending on the implementation. In addition, it should be understood that although the development work may be very complex and time-consuming, it is only a routine task for those skilled in the art who benefit from the content of this disclosure.

[0033] It should be noted that the relative arrangement of components and steps, the numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.

[0034] Those skilled in the art can understand that the terms "first" and "second" in the embodiments of the present disclosure are only used to distinguish different steps, devices or modules, etc., and neither represent any specific technical meaning nor indicate the necessary logical order between them.

[0035] It should also be understood that in the embodiments of the present disclosure, “plurality” may refer to two or more than two, and “at least one” may refer to one, two, or more than two.

[0036] It should also be understood that any component, data or structure mentioned in the embodiments of the present disclosure can generally be understood as one or more, unless explicitly limited or otherwise indicated in the context.

[0037] In addition, the term "and / or" in the present disclosure is only a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in the present disclosure generally indicates that the associated objects before and after are in an "or" relationship.

[0038] It should also be understood that the description of the various embodiments in the present disclosure focuses on the differences between the various embodiments, and the same or similar aspects thereof can be referenced to each other, and for the sake of brevity, they will not be described one by one.

[0039] At the same time, it should be understood that for the convenience of description, the sizes of the various parts shown in the drawings are not drawn according to the actual proportional relationship.

[0040] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the present disclosure, its application, or uses.

[0041] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered as part of the specification.

[0042] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0043] In addition, in order to avoid obscuring the present disclosure due to unnecessary details, only the processing steps and / or device structures closely related to at least the scheme according to the present disclosure are shown in the drawings, and other details that are not closely related to the present disclosure are omitted. It should also be noted that similar reference numerals and letters in the drawings indicate similar items, and therefore once an item is defined in one drawing, it does not need to be discussed again for subsequent drawings.

[0044] Figure 1 FIG. 1 is a flow chart of some embodiments of the method for sharing information in a video conference according to the present disclosure, wherein the method for sharing information in a video conference is applied to a first terminal. Figure 1 As shown, the video conference information sharing method includes steps S101-S104.

[0045] Step S101: sending screen sharing information to a second terminal so that the second terminal displays the screen sharing information.

[0046] The first terminal is a terminal of an information sharer of a video conference, and the information sharer may be a host of the video conference, etc. The second terminal is a terminal of other participants of the video conference, and other participants may be viewers of the video conference, etc. The first terminal and the second terminal may be a PC, a mobile phone, a tablet computer, etc. The screen sharing information may be a variety of information, such as an electronic document, an image of a desktop, etc.

[0047] Step S102, obtaining operation information for screen sharing information, or determining screen display update information. The first terminal can use a variety of methods to obtain operation information for screen sharing information and determine screen display update information.

[0048] Step S103, generating screen display control data according to the operation information or screen display update information.

[0049] Step S104: sending the screen display control data to the second terminal, so that the second terminal performs display control processing according to the screen display control data.

[0050] The first terminal may send screen sharing information and screen display control data, etc., to the second terminal through a conference server, which may include a document server, a signaling server, a media server, etc. The first terminal may also directly establish a network connection with the second terminal, and send the screen sharing information and screen display control data, etc., to the second terminal through the network connection.

[0051] The information sharing method of the video conference disclosed in the present invention comprises the following steps: a first terminal sends screen sharing information to a second terminal, obtains operation information for the screen sharing information, or determines screen display update information, generates screen display control data according to the operation information or the screen display update information, and sends the screen display control data to the second terminal, so that the second terminal performs display control processing according to the screen display control data; in the video conference, there is no need to collect the screen or documents in real time, which reduces the amount of data to be transmitted in the video conference, reduces the demand for network resources, saves operating costs, improves the timeliness of data transmission, and improves the quality of the video conference.

[0052] In some embodiments, the screen sharing information includes an electronic document, which may be in a variety of formats. The first terminal may send the electronic document to the second terminal before or during the video conference, so that the second terminal opens and displays the electronic document.

[0053] For example, the screen sharing information that the first terminal needs to share is electronic document A; before the video conference starts, the first terminal uploads the electronic document A to the document server, and the first terminal can encrypt the electronic document A.

[0054] The document server may send electronic document A to all second terminals, or the document server may send a download link of electronic document A to all second terminals, and each second terminal downloads electronic document A from the document server through the download link. After obtaining electronic document A, the second terminal stores it locally or caches it, and opens and displays electronic document A.

[0055] The first terminal obtains operation information corresponding to the electronic document, the operation information including document operation instructions executed on the electronic document, first position information corresponding to the document operation instructions, etc.; the document operation instructions executed on the electronic document include operation instructions such as page turning, marking, and scrolling; the first position information includes position information in the electronic document corresponding to the instructions such as page turning, marking, and scrolling.

[0056] Figure 2 FIG. 1 is a flow chart of generating screen display control data for an electronic document in some embodiments of the information sharing method for a video conference according to the present disclosure, such as Figure 2 As shown:

[0057] Step S201: Generate a document display control instruction according to the document operation instruction.

[0058] The first terminal generates corresponding document display control instructions according to the page turning, annotation, scrolling and other operation instructions executed on the electronic document, according to the preset document display control instruction generation rules and format, etc. The document display control instructions include page turning control, annotation control, scrolling control and other instructions.

[0059] Step S202: generating second position information corresponding to the document display control instruction according to the first position information corresponding to the document operation instruction.

[0060] The first terminal generates second position information corresponding to the document display control instruction according to the first position information corresponding to the document operation instruction and according to a preset second position information generation rule and format.

[0061] Step S203: Generate screen display control data based on the document display control instruction and the second position information.

[0062] The screen display control data includes a document display control instruction, second location information corresponding to the document display control instruction, etc.; the first terminal sends the screen display control data to the signaling server, the signaling server sends the screen display control data to each second terminal, the second terminal performs display control processing according to the screen display control data, and the second terminal can update the content displayed by the electronic document according to the document display control instruction and the second location information.

[0063] For example, the first terminal monitors the host's operation information on the electronic document A. When the host scrolls the electronic document A using the mouse wheel, the first terminal obtains the operation information corresponding to the electronic document A, and the operation information includes the scrolling operation instruction executed on the electronic document A, the first position information corresponding to the scrolling operation instruction, etc.; the first position information can be the position information of the display content of the electronic document A on the screen after the host scrolls the electronic document A.

[0064] The first terminal generates a corresponding document display control instruction according to the scrolling operation instruction and a preset generation rule and format of the document display control instruction, where the document display control instruction is a scrolling control instruction; the first terminal generates second position information corresponding to the scrolling control instruction according to the first position information corresponding to the scrolling operation instruction and a preset generation rule and format of the second position information, where the second position information is position information of the display content of the electronic document A on the screen after the electronic document A is scrolled.

[0065] The first terminal generates screen display control data based on the scrolling control instruction and the second position information, and the screen display control data includes the scrolling control instruction and the second position information, etc. The first terminal sends the screen display control data to the signaling server, and the signaling server sends the screen display control data to each second terminal; the second terminal can reproduce the operation action of the electronic document A locally according to the scrolling control instruction and the second position information, and update the content displayed by the electronic document A, so that the content of the electronic document A displayed by the first terminal and the second terminal is the same.

[0066] When the video conference ends, the first terminal sends an end conference instruction to the signaling server and deletes the uploaded electronic document in the document server. After receiving the end conference instruction sent by the signaling server, the second terminal deletes the electronic document shared by the first terminal in the local or cached state.

[0067] In the information sharing method for video conferencing in the above-mentioned embodiment, the first terminal obtains operation information for the electronic document, generates screen display control data according to the operation information, and sends the screen display control data to the second terminal, so that the second terminal performs display control processing according to the screen display control data; there is no need to collect documents in real time during the video conference, which reduces the amount of data that needs to be transmitted during the video conference, saves operating costs, improves the timeliness of data transmission, and improves the quality of the video conference.

[0068] In some embodiments, the host needs to share the desktop or window of the first terminal, and can set the desktop or window as a screen sharing area. The first terminal captures images of the static screen sharing area, and the static screen sharing area, that is, the screen display in the screen sharing area, is in a static state and does not change for a period of time. The screen sharing information includes a first image frame captured in the static screen sharing area, and the first terminal sends the first image frame to the second terminal so that the second terminal displays the first image frame.

[0069] For example, before or during a video conference, the first terminal captures an image of a static desktop, and the screen sharing information includes a first image frame B captured of the static desktop. The first terminal sends the first image frame B to a document server; the document server can send the first image frame B to all second terminals, or the document server sends a download link of the first image frame B to all second terminals, and each second terminal downloads the first image frame B from the document server through the download link. After obtaining the first image frame B, the second terminal stores it locally or caches it, opens the first image frame B and displays it.

[0070] Figure 3 FIG. 1 is a flow chart of determining screen display update information in some embodiments of the video conference information sharing method according to the present disclosure, such as Figure 3 As shown:

[0071] Step S301: periodically capture a second image frame of the screen sharing area.

[0072] A time interval for periodically capturing the second image frame may be set. If the time interval is very short, it may be considered that the first terminal captures the second image frame of the screen sharing area in real time.

[0073] Step S302: Determine pixel value difference information between the currently captured second image frame and the previously captured second image frame or first image frame.

[0074] The first terminal obtains the second image frame currently being captured; if the second image frame was captured last time, the second image frame is used as a comparison image frame; if the first image frame was captured last time (the second image frame currently being captured is the first second image frame), the first image frame is used as a comparison image frame.

[0075] The currently acquired second image frame is compared with the comparison image frame to obtain pixel value difference information between the currently acquired second image frame and the comparison image frame; the pixel value difference information includes: the pixel value difference of each corresponding pixel point in the currently acquired second image frame and the comparison image frame.

[0076] Step S303: determining whether there is a dynamic area in the second image frame currently captured according to the pixel value difference information.

[0077] Step S304: when it is determined that there is a dynamic area, screen display update information is determined according to the dynamic area, wherein the screen display update information includes area range information of the dynamic area.

[0078] If the pixel value difference between the corresponding pixel point in the currently acquired second image frame and the comparison image frame is greater than the difference threshold, then this pixel point is determined to be a dynamic pixel point; obtain one or more regions composed of dynamic pixel points, and if the area of ​​this region is greater than the area threshold, then this region is determined to be a dynamic region.

[0079] When it is determined that there are one or more dynamic areas, screen display update information is determined according to the one or more dynamic areas. The screen display update information includes area range information of the dynamic areas. The area range information may be coordinate information of the area range, etc.

[0080] The first terminal generates the regional position information according to the regional range information of the dynamic area and the preset generation rule and format of the regional position information. The first terminal obtains the image located in the dynamic area in the second image frame currently acquired as the first image according to the regional range information of the dynamic area. The first terminal generates screen display control data including the first image and the regional position information, etc. The regional position information may be the regional coordinate information corresponding to the first image, etc.

[0081] The first terminal sends the screen display control data to the second terminal. For example, the first terminal can set the same ID for the first image and the corresponding regional location information; after compressing and encoding the first image, the first terminal sends the first image and the ID to the media server; the first terminal sends the regional location information and the ID to the signaling server or the document server.

[0082] The second terminal receives the first image and ID sent by the media server, and decompresses and decodes the first image; the second terminal receives the regional location information and ID sent by the signaling server or the document server; the second terminal determines the first image and the corresponding regional location information based on the ID.

[0083] The second terminal determines the update area image in the currently displayed third image frame according to the area position information; the second terminal removes the update area image in the third image frame to obtain the second image; the second terminal splices the first image and the second image to obtain the fourth image frame and displays it.

[0084] When the video conference ends, the first terminal sends an end conference instruction to the signaling server and deletes the uploaded first image frame and other information in the document server. After receiving the end conference instruction sent by the signaling server, the second terminal deletes all image information shared by the first terminal in the local or cached state.

[0085] For example, the host needs to share the desktop of the first terminal, and the desktop of the first terminal is the screen sharing area. Before the video conference starts, when the desktop is still, the first terminal captures an image of the static desktop, and the screen sharing information includes the first image frame captured of the static desktop. The first terminal sends the first image frame to each second terminal through the document server, and the second terminal displays the first image frame.

[0086] In a video conference, the first terminal plays a video in the playback area 1 on the desktop, while other areas on the desktop remain unchanged. The first terminal captures the second image frame of the desktop in real time; if the second image frame was captured last time, the second image frame is used as a comparison image frame; if the first image frame was captured last time (the second image frame currently captured is the first second image frame), the first image frame is used as a comparison image frame.

[0087] The first terminal compares the currently acquired second image frame with the comparison image frame to obtain the pixel value difference of each corresponding pixel point in the currently acquired second image frame and the comparison image frame. If the pixel value difference of the corresponding pixel point in the currently acquired second image frame and the comparison image frame is greater than the difference threshold, the pixel point is determined to be a dynamic pixel point.

[0088] The first terminal obtains an area composed of dynamic pixels (playing area 1 or a part of playing area 1), and if the area of ​​the area is greater than the area threshold, the area is determined to be a dynamic area C. When it is determined that there is a dynamic area C, screen display update information is determined according to the dynamic area C, and the screen display update information includes coordinate information of the dynamic area C, etc.

[0089] The first terminal generates the regional position information according to the regional range information of the dynamic region C and the preset generation rule and format of the regional position information. The first terminal obtains the image located in the dynamic region C in the second image frame currently acquired according to the regional range information as the first image D. The first terminal generates screen display control data including the first image D and the regional position information, etc. The regional position information may be the regional coordinate information corresponding to the first image, etc.

[0090] The first terminal sends screen display control data to the second terminal through the media server and the signaling server or the document server. The second terminal receives the first image D (if the first image D is compressed and encoded, the first image is decompressed and decoded) and the corresponding area location information.

[0091] The second terminal determines the first image D and the corresponding regional position information, and determines the update regional image in the currently displayed third image frame according to the regional position information; the second terminal removes the update regional image in the third image frame to obtain the second image E, that is, the second image E corresponds to the desktop static area of ​​the first terminal; the second terminal splices the first image D and the second image E to obtain the fourth image frame and displays it; the second terminal splices each frame of the image according to the static part and the dynamic part, thereby realizing the splicing display of dynamic and static pictures, and can achieve the effect of playing the video played by the first terminal in the second terminal.

[0092] Figure 4 FIG. 1 is a flow chart of another embodiment of the method for sharing information in a video conference according to the present disclosure, wherein the method for sharing information in a video conference is applied to a second terminal. Figure 4 As shown, the video conference information sharing method includes steps S401-S402.

[0093] Step S401: receiving and displaying screen sharing information sent by a first terminal.

[0094] Step S402: receiving screen display control data sent by the first terminal, and performing display control processing according to the screen display control data.

[0095] In some embodiments, an electronic document sent by a first terminal is received, the electronic document is opened and displayed, a document display control instruction and location information are received, and the content displayed by the electronic document is updated according to the document display control instruction and location information.

[0096] Figure 5 FIG. 1 is a flow chart of display control processing in other embodiments of the information sharing method for video conferencing according to the present disclosure, such as Figure 5 As shown:

[0097] Step S501: receiving and displaying image frames sent by a first terminal and captured from a static screen sharing area.

[0098] Step S502: receiving a first image and region position information, and determining to update the region image according to the region position information.

[0099] Step S503: remove the update area image from the currently displayed image frame to obtain a second image.

[0100] Step S504: splice the first image and the second image to obtain a new image frame and display it.

[0101] In the information sharing method for video conferencing in the above-mentioned embodiment, the first terminal sends the first image frame corresponding to the static screen sharing area to the second terminal for display, and determines the screen display update information according to the dynamic area in the screen sharing area, and generates screen display control data, and sends the screen display control data to the second terminal, so that the second terminal performs splicing processing of dynamic images and static images according to the screen display control data, generates image frames and displays them; in the video conference, there is no need to collect the screen sharing area in real time, which reduces the amount of data that needs to be transmitted in the video conference, saves operating costs, improves the timeliness of data transmission, and improves the quality of the video conference.

[0102] In some embodiments, Figure 6 As shown, the present disclosure provides an information sharing device 60 for a video conference, which is applied to a first terminal and includes: a first sending module 61 , an information acquisition module 62 , a data generation module 63 and a second sending module 64 .

[0103] The first sending module 61 sends the screen sharing information to the second terminal so that the second terminal displays the screen sharing information. The information obtaining module 62 obtains operation information for the screen sharing information, or determines screen display update information.

[0104] The data generating module 63 generates screen display control data according to the operation information or screen display update information; the second sending module 64 sends the screen display control data to the second terminal so that the second terminal performs display control processing according to the screen display control data.

[0105] In some embodiments, the screen sharing information includes an electronic document, and the first sending module 61 sends the electronic document to the second terminal so that the second terminal opens and displays the electronic document. The information acquisition module 62 acquires operation information corresponding to the electronic document, and the operation information includes a document operation instruction executed on the electronic document, first position information corresponding to the document operation instruction, etc.

[0106] The screen display control data includes a document display control instruction, second position information corresponding to the document display control instruction, etc. The data generation module 63 generates the document display control instruction according to the document operation instruction, and the data generation module 63 generates the second position information according to the first position information.

[0107] In some embodiments, the screen sharing information includes a first image frame captured from a static screen sharing area, and the first sending module 61 sends the first image frame to the second terminal so that the second terminal displays the first image frame.

[0108] The information acquisition module 62 periodically captures the second image frame of the screen sharing area, and determines the pixel value difference information between the currently captured second image frame and the second image frame or the first image frame captured last time; the information acquisition module 62 determines whether there is a dynamic area in the currently captured second image frame based on the pixel value difference information; when the information acquisition module 62 determines that there is a dynamic area, the screen display update information is determined based on the dynamic area, and the screen display update information includes the area range information of the dynamic area.

[0109] The screen display control data includes a first image and area position information. The data generation module 63 generates the area position information according to the area range information. The data generation module 63 obtains an image located in the dynamic area in the currently acquired second image frame as the first image according to the area range information.

[0110] like Figure 7 As shown, the first terminal may include a memory 71, a processor 72, a communication interface 73 and a bus 74. The memory 71 is used to store instructions, the processor 72 is coupled to the memory 71, and the processor 72 is configured to execute the above-mentioned information sharing method for the video conference applied to the first terminal based on the instructions stored in the memory 71.

[0111] The memory 71 may be a high-speed RAM memory, a non-volatile memory, etc., and the memory 71 may also be a memory array. The memory 71 may also be divided into blocks, and the blocks may be combined into virtual volumes according to certain rules. The processor 72 may be a central processing unit CPU, or an application specific integrated circuit ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement the information sharing method for video conferencing applied to the first terminal of the present disclosure.

[0112] In some embodiments, Figure 8 As shown, the present disclosure provides an information sharing device 80 for a video conference, which is applied to a second terminal and includes a first information receiving module 81, a second information receiving module 82 and a display control module 83. The first information receiving module 81 receives and displays the screen sharing information sent by the first terminal; the second information receiving module 82 receives the screen display control data sent by the first terminal, and the display control module 83 performs display control processing according to the screen display control data.

[0113] In some embodiments, the screen sharing information includes an electronic document, and the first information receiving module 81 receives the electronic document sent by the first terminal, opens the electronic document and displays it. The screen display control data includes a document display control instruction and position information corresponding to the document display control instruction. The display control module 83 updates the content displayed by the electronic document according to the document display control instruction and the position information.

[0114] In some embodiments, the screen sharing information includes an image frame captured by the first terminal of the static screen sharing area, and the first information receiving module 81 receives and displays the image frame sent by the first terminal. The screen display control data includes the first image and the area position information, and the display control module 83 determines the update area image in the currently displayed image frame according to the area position information; the display control module 83 removes the update area image from the currently displayed image frame to obtain the second image; the display control module 83 splices the first image and the second image to obtain a new image frame and displays it.

[0115] like Fig. 9 As shown, the second terminal may include a memory 91, a processor 92, a communication interface 93 and a bus 94. The memory 91 is used to store instructions, the processor 92 is coupled to the memory 91, and the processor 92 is configured to execute the above-mentioned information sharing method for video conferencing applied to the second terminal based on the instructions stored in the memory 91.

[0116] The memory 91 may be a high-speed RAM memory, a non-volatile memory, etc., and the memory 91 may also be a memory array. The memory 91 may also be divided into blocks, and the blocks may be combined into virtual volumes according to certain rules. The processor 92 may be a central processing unit CPU, or an application specific integrated circuit ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement the information sharing method for video conferencing applied to the second terminal of the present disclosure.

[0117] In some embodiments, the present disclosure provides a video conferencing system, including a first terminal and a second terminal as in any of the above implementations.

[0118] In some embodiments, the present disclosure provides a computer-readable storage medium storing computer instructions, which, when executed by a processor, implement the information sharing method for video conferencing in any of the above embodiments.

[0119] Computer readable storage media can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can include, for example, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive enumeration) of readable storage media can include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0120] The embodiments of the present disclosure may also be a computer program product, which includes computer program instructions. When the computer program instructions are executed by a processor, the processor executes the steps of the method according to various embodiments of the present disclosure described in the above “Exemplary Method” section of this specification.

[0121] The video conferencing information sharing method, video conferencing system, terminal, storage medium and computer program product in the above-mentioned embodiments do not need real-time capture of screens or documents during video conferencing, thereby reducing the amount of data that needs to be transmitted during video conferencing, reducing the demand for network resources, saving operating costs, improving the timeliness of data transmission, improving the quality of video conferencing, and improving the user experience.

[0122] The basic principles of the present disclosure are described above in conjunction with specific embodiments. However, it should be noted that the advantages, strengths, effects, etc. mentioned in the present disclosure are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. are required by each embodiment of the present disclosure. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, and are not limiting. The above details do not limit the present disclosure to the necessity of adopting the above specific details to be implemented.

[0123] Each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the system embodiment, since it basically corresponds to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0124] The block diagrams of the devices, apparatuses, equipment, and systems involved in this disclosure are only illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagrams. As will be appreciated by those skilled in the art, these devices, apparatuses, equipment, and systems can be connected, arranged, and configured in any manner. Words such as "including," "comprising," "having," and the like are open words, referring to "including but not limited to," and can be used interchangeably therewith. The words "or" and "and" used herein refer to the words "and / or," and can be used interchangeably therewith, unless the context clearly indicates otherwise. The word "such as" used herein refers to the phrase "such as but not limited to," and can be used interchangeably therewith.

[0125] It should also be noted that in the apparatus, device and method of the present disclosure, each component or each step can be decomposed and / or recombined. Such decomposition and / or recombination should be regarded as equivalent solutions of the present disclosure.

[0126] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the aspects shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

[0127] The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present disclosure to the forms disclosed herein. Although multiple example aspects and embodiments have been discussed above, it will be appreciated by those skilled in the art that the above embodiments are merely illustrative and do not limit the scope of the present disclosure. It will be appreciated by those skilled in the art that the above embodiments may be combined, modified or replaced without departing from the scope and essence of the present disclosure.

Claims

1. A video conference information sharing method, applied to a first terminal, comprising: Sending the screen sharing information to the second terminal so that the second terminal displays the screen sharing information; Acquiring operation information for the screen sharing information, or determining screen display update information; Generate screen display control data according to the operation information or screen display update information; The screen display control data is sent to the second terminal, so that the second terminal performs display control processing according to the screen display control data.

2. The information sharing method according to claim 1, wherein: The screen sharing information includes an electronic document, and sending the screen sharing information to the second terminal so that the second terminal displays the screen sharing information includes: The electronic document is sent to a second terminal so that the second terminal opens and displays the electronic document.

3. The information sharing method according to claim 2, wherein: The obtaining of operation information for the screen sharing information includes: Operation information corresponding to the electronic document is acquired, wherein the operation information includes a document operation instruction executed on the electronic document and first position information corresponding to the document operation instruction.

4. The information sharing method according to claim 3, wherein: The screen display control data includes a document display control instruction and second position information corresponding to the document display control instruction, and generating the screen display control data includes: Generating the document display control instruction according to the document operation instruction; The second location information is generated according to the first location information.

5. The information sharing method according to claim 1, wherein: The screen sharing information includes a first image frame captured from a static screen sharing area, and sending the screen sharing information to a second terminal so that the second terminal displays the screen sharing information includes: The first image frame is sent to the second terminal, so that the second terminal displays the first image frame.

6. The information sharing method according to claim 5, wherein: Determining the screen display update information includes: Periodically collecting a second image frame of the screen sharing area; Determine pixel value difference information between the currently acquired second image frame and the previously acquired second image frame or first image frame; Determining whether there is a dynamic area in the second image frame currently acquired according to the pixel value difference information; In the case where it is determined that the dynamic area exists, the screen display update information is determined according to the dynamic area, wherein the screen display update information includes area range information of the dynamic area.

7. The information sharing method according to claim 6, wherein the screen display control data comprises the first image and the area position information, and the generating the screen display control data comprises: Generate the regional location information according to the regional range information; According to the area range information, an image located within the dynamic area is acquired in the currently acquired second image frame as the first image.

8. The information sharing method according to any one of claims 1 to 7, wherein: The screen sharing information and the screen display control data are sent to the second terminal through the conference server.

9. A video conference information sharing method, applied to a second terminal, comprising: Receiving and displaying the screen sharing information sent by the first terminal; Receive screen display control data sent by the first terminal, and perform display control processing according to the screen display control data.

10. The information sharing method according to claim 9, wherein: The screen sharing information includes an electronic document, and the receiving and displaying of the screen sharing information sent by the first terminal includes: The electronic document sent by the first terminal is received, and the electronic document is opened and displayed.

11. The information sharing method according to claim 10, wherein: The screen display control data includes a document display control instruction and second position information corresponding to the document display control instruction, and the display control processing according to the screen display control data includes: The displayed content of the electronic document is updated according to the document display control instruction and the second position information.

12. The information sharing method according to claim 9, wherein: The screen sharing information includes a first image frame captured by the first terminal in a static screen sharing area, and the receiving and displaying of the screen sharing information sent by the first terminal includes: The first image frame sent by the first terminal is received and displayed.

13. The information sharing method according to claim 12, wherein: The screen display control data includes a first image and area position information, and the display control processing according to the screen display control data includes: Determining an update region image in a third image frame currently displayed according to the region position information; removing the update region image from the third image frame to obtain a second image; The first image and the second image are spliced ​​together to obtain a fourth image frame and display it.

14. A video conferencing system, comprising: A first terminal, comprising a memory and a processor coupled to the memory, wherein the processor is configured to execute the information sharing method of the video conference according to any one of claims 1 to 8 based on instructions stored in the memory; The second terminal includes a memory and a processor coupled to the memory, wherein the processor is configured to execute the video conference information sharing method according to any one of claims 9 to 13 based on instructions stored in the memory.

15. A terminal, comprising: Memory; and a processor coupled to the memory, wherein the processor is configured to execute the video conference information sharing method according to any one of claims 1 to 13 based on instructions stored in the memory. 16 . A computer-readable storage medium storing computer instructions, wherein the instructions, when executed by a processor, implement the video conference information sharing method according to claim 1 .

17. A computer program product, wherein the computer program product stores computer instructions, and when the computer instructions are executed by a processor, the method for sharing information in a video conference as claimed in any one of claims 1 to 13 is implemented.

Images