Method, system, terminal, server and storage medium for marking a video conference

Abstract

The embodiment of the present disclosure provides a marking method, system, terminal, server and storage medium for video conference. The method comprises the following steps: a first terminal outputs a video conference image, wherein the video conference image comprises a marking area defined by a marking frame; the first terminal receives a marking input in the marking area; and the first terminal sends the marking to a server, so that the server sends the marking to a second terminal, and the second terminal displays the video conference image with the marking.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the field of video conferencing, and in particular to a marking method, system, terminal, server and storage medium for video conferencing. BACKGROUND

[0002] In a video conference, a participant can share a screen or a file as a sharer, and other participants can see the content shared by the sharer in real time.

[0003] Generally, only the sharer can mark the shared content, and such a conference is more suitable for one-way sharing of content from the sharer to other participants, but not suitable for discussion and interaction among multiple participants. SUMMARY

[0004] Embodiments of the present disclosure provide a marking method, system, terminal, server and storage medium for video conferencing, to solve the problem that only the sharer can mark in the related art, which is not suitable for discussion and interaction among multiple participants. The technical solution is as follows:

[0005] In a first aspect, a marking method for video conferencing is provided, and the method comprises:

[0006] A first terminal outputs a video conference image, and the video conference image comprises a marking area defined by a marking frame;

[0007] The first terminal receives a mark input in the marking area;

[0008] The first terminal sends the mark to a server, so that the server sends the mark to a second terminal, so that the second terminal displays a video conference image with the mark.

[0009] Optionally, the first terminal outputs a video conference image, comprising:

[0010] Obtaining marking area setting information;

[0011] Drawing the marking frame based on the marking area setting information, to output the video conference image with the marking area.

[0012] Optionally, the marking area setting information comprises at least one of the following parameters:

[0013] The number of marking areas, the position of each marking area, the shape of each marking area, the size of each marking area, and the border attribute of each marking area.

[0014] Optionally, the video conference image further comprises a shared area, which is a region shared by the first terminal for a picture provided by a first sharer.

[0015] The mark area is located in the shared area, or the mark area is located outside the shared area.

[0016] Optionally, when the mark area is located outside the shared area, the mark area has a function of sharing a picture provided by a second sharer.

[0017] Optionally, when the first terminal is an initiating terminal of the video conference,

[0018] The method further comprises:

[0019] obtaining a mark area permission setting instruction, the mark area permission setting instruction being used to indicate a mark area use permission of each terminal participating in the conference;

[0020] sending the mark area permission setting instruction to the server, so that the server controls the use permission of each terminal participating in the conference to the mark area.

[0021] Optionally, the use permission comprises at least one of the following:

[0022] a viewing permission and a marking permission.

[0023] Optionally, the first terminal sends the mark to the server, comprising:

[0024] compositing the mark into the video conference image;

[0025] sending the video conference image with the mark composited to the server;

[0026] or,

[0027] sending the mark and the association information between the mark and the image to the server, so that the server composites the mark into the video conference image.

[0028] In a second aspect, a mark method of a video conference is provided, and the method comprises:

[0029] a server receives a mark sent by a first terminal, the mark being input from a mark area defined by a mark frame in a video conference image output by the first terminal;

[0030] the server sends the mark to a second terminal, so that the second terminal displays the video conference image with the mark.

[0031] Optionally, the server sends the mark to the second terminal, comprising:

[0032] compositing the mark into the video conference image;

[0033] sending the video conference image with the mark to the second terminal;

[0034] or,

[0035] sending the mark and the association information of the mark and the image to the second terminal, so that the second terminal composites the mark into a video conference image.

[0036] Optionally, before the server sends the mark to the second terminal, the method further comprises:

[0037] determining a terminal having a mark area viewing permission;

[0038] The server sending the mark to the second terminal comprises:

[0039] In response to the second terminal being a terminal having a mark area viewing permission, sending the mark to the second terminal.

[0040] Optionally, before the determination of the terminal having the mark area viewing permission, the method further comprises:

[0041] receiving a mark area permission setting instruction sent by an initiating terminal of a video conference, the mark area permission setting instruction being used to indicate a mark area use permission of each terminal participating in the conference, the use permission comprising a viewing permission.

[0042] Optionally, the use permission further comprises a mark permission, and the method further comprises:

[0043] generating a mark area permission message according to the mark area permission setting instruction;

[0044] sending the mark area permission message to the second terminal to indicate whether the second terminal has the mark permission.

[0045] Optionally, the use permission further comprises a mark permission, and the server sending the mark to the second terminal comprises:

[0046] In response to the first terminal having the mark permission, sending the mark to the second terminal.

[0047] Optionally, the method further comprises:

[0048] In response to the first terminal not having the mark permission, discarding the mark.

[0049] In a third aspect, a terminal is provided, comprising a processor and a memory;

[0050] The memory is configured to store a computer program.

[0051] The processor is configured to execute the computer program stored in the memory to implement the video conference marking method of any one of the first aspect.

[0052] In a fourth aspect, a server is provided, the server comprising a processor and a memory;

[0053] The memory is configured to store a computer program.

[0054] The processor is configured to execute the computer program stored in the memory to implement the video conference marking method of any one of the second aspect.

[0055] In a fifth aspect, a video conference system is provided, the video conference system comprising the terminal of the third aspect and the server of the fourth aspect.

[0056] In a sixth aspect, a computer readable storage medium is provided, the computer readable storage medium storing computer instructions, the stored computer instructions being executable by a processor to implement the video conference marking method of any one of the first or second aspect.

[0057] The technical solution provided by the embodiments of the present disclosure has the following beneficial effects:

[0058] In the embodiments of the present disclosure, a scheme is provided, in which each participant can mark or modify shared content. A marking area is set in a video conference image for a user to mark. After marking, the server transmits the marking to other terminals for display, so that each terminal can mark the picture. The scheme solves the problem in the related art that only the sharer can mark, which causes the problem that it is not suitable for multiple participants to discuss and interact. BRIEF DESCRIPTION OF DRAWINGS

[0059] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present disclosure, and other drawings can be obtained by those skilled in the art without creative effort.

[0060] Figure 1 is a flowchart of a video conference marking method provided by the embodiments of the present disclosure;

[0061] Figure 2 is a marking schematic diagram provided by the embodiments of the present disclosure;

[0062] Figure 3 is a flowchart of a video conference marking method provided by the embodiments of the present disclosure;

[0063] Figure 4 is a flowchart of a marking method of a video conference provided by an embodiment of the present disclosure;

[0064] Figure 5 is a schematic diagram of an interface of a video conference provided by an embodiment of the present disclosure;

[0065] Figure 6 is another schematic diagram of an interface of a video conference provided by an embodiment of the present disclosure;

[0066] Figure 7 is a flowchart of a marking method of a video conference provided by an embodiment of the present disclosure;

[0067] Figure 8 is a flowchart of a marking method of a video conference provided by an embodiment of the present disclosure;

[0068] Figure 9 is a flowchart of a marking method of a video conference provided by an embodiment of the present disclosure;

[0069] Figure 10 is a schematic diagram of a permission setting menu provided by an embodiment of the present disclosure;

[0070] Figure 11 is a flowchart of a marking method of a video conference provided by an embodiment of the present disclosure;

[0071] Figure 12 is a flowchart of a marking method of a video conference provided by an embodiment of the present disclosure;

[0072] Figure 13 is a structural schematic diagram of a video conference system provided by an embodiment of the present disclosure;

[0073] Figure 14 is a block diagram of a terminal provided by an embodiment of the present disclosure;

[0074] Figure 15 is a block diagram of a server provided by an embodiment of the present disclosure;

[0075] Figure 16 is a structural schematic diagram of a computer device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0076] In order to make the purpose, technical solutions and advantages of the present disclosure clearer, the embodiments of the present disclosure will be further described in detail below with reference to the drawings.

[0077] Figure 1 is a flowchart of a marking method of a video conference provided by an embodiment of the present disclosure. Referring to Figure 1 , the method comprises:

[0078] 101: The first terminal outputs a video conference image, and the video conference image includes a marked area defined by a marking frame.

[0079] The first terminal is any terminal participating in the video conference. The first terminal participates in the video conference through a video conference application or a video conference webpage. Taking the video conference application as an example, the video conference application is used to output the video conference image.

[0080] The marking frame is a pattern drawn in the video conference application, and the area in the marking frame is the marked area, which can be used for marking.

[0081] 102: The first terminal receives the marking input in the marked area.

[0082] The video conference image output by the video conference application includes the marked area. A user can mark in the marked area through a tool in the video conference application, such as a brush tool, so that the terminal receives the marking input by the user.

[0083] In addition, the marking can also be a text input or other forms. The text input can be handwritten by a brush or input by a keyboard, and the present disclosure does not limit this.

[0084] 103: The first terminal sends the marking to a server, so that the server sends the marking to a second terminal, so that the second terminal displays the video conference image with the marking.

[0085] When the terminal sends the marking, the terminal actually sends information of the marking, such as coordinates of each point on the marking, a sequence of each point, and attributes of the marking, such as color, thickness, and line type.

[0086] Figure 2 The marking schematic diagram provided in the embodiment of the present disclosure, referring to FIG. 2, line thickness and color of markings of different participants in the video conference can be the same or different. For example, marking thickness of participant A and participant B is different, and line type of marking of participant B and participant C is different. Figure 2

[0087] The second terminal and the first terminal are different terminals.

[0088] In the embodiment of the present disclosure, a scheme that each participant can mark or modify shared content is provided. A marking area is set in a video conference image for a user to mark. After marking, the marking is transmitted to other terminals through a server for display, so that each terminal can mark the image. The problem that only a sharer can mark in the related art, which causes that multiple participants cannot discuss and interact, is solved.

[0089] Figure 3 ​is a flowchart of a marking method of a video conference provided by an embodiment of the present disclosure. Referring to Figure 3 The method comprises:

[0090] 201: The server receives a mark sent by a first terminal. The mark is input from a mark area defined by a mark frame in a video conference image output by the first terminal.

[0091] 202: The server sends the mark to a second terminal, so that the second terminal displays the video conference image with the mark.

[0092] The second terminal and the first terminal are different terminals.

[0093] In the embodiment of the present disclosure, a scheme is provided, in which each participant can mark or modify shared content. A mark area is set in a video conference image for a user to mark. After marking, the server transmits the mark to other terminals for display, so that each terminal can mark the image. The problem that only the sharer can mark in the related art, which causes the problem that it is not suitable for multiple participants to discuss and interact, is solved.

[0094] Figure 4 is a flowchart of a marking method of a video conference provided by an embodiment of the present disclosure. Referring to Figure 4 The method comprises:

[0095] 301: A first terminal outputs a video conference image. The video conference image comprises a mark area defined by a mark frame.

[0096] Exemplarily, step 301 can comprise:

[0097] Obtaining mark area setting information;

[0098] Drawing a mark frame based on the mark area setting information, to output the video conference image with the mark area.

[0099] The mark area setting information is obtained, and the drawing of the mark frame is implemented according to the mark area setting information, so as to realize the display of the mark area.

[0100] Here, when the first terminal is an initiating terminal of the video conference (i.e., a conference administrator), the mark area setting information can be obtained by receiving a mark area setting instruction input by a user through a mark area setting function in a video conference application. The mark area setting instruction provides the mark area setting information. That is, the initiating terminal of the video conference can define a markable mark area. In addition, the first terminal can also send the mark area setting instruction to the server.

[0101] When the first terminal is only a participant of the video conference, the manner of obtaining the marker area setting information can be receiving a marker area setting instruction sent by the server, the marker area setting instruction providing the marker area setting information.

[0102] Exemplarily, the marker area setting information comprises at least one of the following parameters:

[0103] the number of the marker areas, the position of each marker area, the shape of each marker area, the size of each marker area, and the border attribute of each marker area.

[0104] For example, the number of the marker areas ranges from 1 to N, N is a positive integer greater than 1, and the value of N can be determined according to terminal performance, network speed, etc. The better the terminal performance and the faster the network speed, the larger the value of N can be.

[0105] The setting of the marker area is realized through the above setting parameters of the marker area, and the border attribute can include color, thickness, line type, and whether to hide, etc.

[0106] Here, the border hiding of the marker area means that the border is hidden when there is no operation, and the border is displayed when there is operation. When the border of the marker area is hidden, the border of the marker area will appear only when there is operation in the marker area, such as mouse movement or clicking in the marker area or touch operation of the touchpad in the marker area. If there is no continuous operation for a certain period of time (for example, 3 seconds), the border of the marker area disappears.

[0107] Figure 5 is a schematic diagram of an interface of a video conference provided by an embodiment of the present disclosure, referring to Figure 5 The number of the marker areas can be multiple, for example, 3. The positions of the 3 marker areas are isolated from each other, and the shapes of the 3 marker areas are all rectangles. Among them, the sizes of the marker areas B and C are the same, and the size of the marker area A is different. Of course, Figure 5 The above is only an example of the marker area, and is not a limitation on the marker area.

[0108] Exemplarily, the video conference image further comprises a shared area, which is a region shared by the first terminal and provided by a first sharer.

[0109] As shown in Figure 5 , the marker area is located in the shared area. At this time, the size of each shared area cannot exceed the shared area, and different shared areas do not intersect.

[0110] Figure 6 is another schematic diagram of an interface of a video conference provided by an embodiment of the present disclosure, referring to Figure 6 The marker area is located outside the shared area.

[0111] In the embodiment of the present disclosure, the marker area can be in the shared area or outside the shared area, and the setting is flexible.

[0112] Exemplarily, when the mark area is located outside the sharing area, the mark area has the function of sharing the picture provided by the second sharer. The mark area is outside the sharing area, and in addition to realizing marking, content sharing can also be realized. That is, during a video conference, multiple users can share simultaneously.

[0113] The video conference initiator or the authorized participant can display the content to be shared in the mark area, including pictures, videos, documents (such as PPT, WORD, EXCEL, etc.), and the shared content is only displayed in the fixed mark area. If the shared content is not displayed, the mark area can be displayed in a single color background, which can be used as a markable whiteboard.

[0114] In this case, the mark area and other areas are independent, and there is no any subordinate or dependent relationship. The position, size, shape, etc. of the mark area can be fixed or freely set, and no limitation is made.

[0115] It should be noted that when the mark area is located in the sharing area, the mark and the conference video image of the sharing area can be sent separately or synthesized together; and when the mark area is located outside the sharing area, the mark and the conference video image of the sharing area can be sent separately, and the mark and the conference video image of the mark area can be sent separately or synthesized together. That is, when it is subsequently explained whether the mark and the conference video image are sent separately or synthesized together, the conference video image can refer to the conference video image in the sharing area, or the conference video image in the mark area.

[0116] Again referring to Figure 5 and Figure 6 , the video conference image includes a chat area, a participant list display area, and other areas in addition to the sharing area and the mark area.

[0117] 302: The first terminal receives the mark input in the mark area.

[0118] The video conference image output by the video conference application includes a mark area, and a user can mark in the mark area through a tool in the video conference application, such as a brush tool, so that the terminal receives the mark input by the user.

[0119] 303: The first terminal sends the mark and the association information of the mark and the image to the server; the server receives the mark and the association information of the mark and the image sent by the first terminal, and the mark is input in the mark area defined by the mark box in the video conference image output by the first terminal.

[0120] Among them, when the terminal sends the mark, it actually sends the information of the mark, such as the coordinates of each point on the mark, and the attributes of the mark, such as color, thickness, line type, etc.

[0121] In addition, the terminal also records the time when each point of the mark is generated, so that when the mark and the video conference image are synthesized, the mark and the video conference image can be synthesized according to the same time.

[0122] Here, the association information between the mark and the image can be the time when each point of the mark is generated, or the number of the video conference image corresponding to the generation of each point of the mark.

[0123] 304: The server synthesizes the mark into the video conference image.

[0124] The server synthesizes the mark and the video conference image according to the association information between the mark and the image, for example, synthesizes the point of the mark generated at the first time and the video frame with the same time stamp, so that when the terminal outputs the video conference image, the generation and modification of the mark can present a dynamic effect.

[0125] For another example, the point of the mark and the video frame corresponding to the number of the video conference image corresponding to the mark are synthesized.

[0126] The video conference image (video frame) is provided by a sharer of the video conference, for example, a third terminal. After the server receives the mark uploaded by the first terminal and the video conference image uploaded by the third terminal, the server synthesizes the two and then transmits the mark-synthesized video conference image to the second terminal.

[0127] For another example, the first terminal is the sharer of the video conference, and the first terminal uploads the mark and the video conference image to the server separately.

[0128] 305: The server sends the mark-synthesized video conference image to the second terminal; and the second terminal receives the mark-synthesized video conference image.

[0129] Among them, the second terminal and the first terminal are different terminals.

[0130] 306: The second terminal outputs the mark-synthesized video conference image.

[0131] In the embodiment of the disclosure, after the first terminal transmits the mark to the server, the server synthesizes the mark into the video conference image and then transmits the mark-synthesized video conference image to the second terminal, so that the second terminal can directly output the video conference image containing the mark. In this embodiment, the first terminal uploads the mark, the server is responsible for the synthesis of the mark and the video conference image, and then sends the mark-synthesized video conference image to the second terminal.

[0132] Figure 7 is a flowchart of a mark method of a video conference provided by an embodiment of the disclosure. Referring to Figure 7 , the method comprises:

[0133] 401: The first terminal outputs a video conference image, the video conference image including a marked area defined using a marked frame.

[0134] The details of this step are described in step 301.

[0135] 402: The first terminal receives a mark input in the marked area.

[0136] The details of this step are described in step 302.

[0137] 403: The first terminal sends the mark and the association information between the mark and the image to the server; the server receives the mark and the association information between the mark and the image sent by the first terminal, the mark being input in the marked area defined using the marked frame in the video conference image output by the first terminal.

[0138] Here, when sending the mark, the terminal actually sends the information of the mark, such as the coordinates of each point on the mark, and the attributes of the mark, such as color, thickness, line type, etc.

[0139] In addition, the terminal also records the time when each point on each mark is generated, so that when the mark and the video conference image are synthesized, the mark and the video conference image can be synthesized according to the same time.

[0140] 404: The server sends the mark and the association information between the mark and the image to the second terminal; the second terminal receives the mark and the association information between the mark and the image sent by the server.

[0141] Step 404 only sends the mark and the association information between the mark and the image, without synthesizing the mark into the video conference image.

[0142] 405: The second terminal synthesizes the mark into the video conference image.

[0143] The second terminal synthesizes the mark and the video conference image according to the association information between the mark and the image, for example, synthesizes the point of the mark generated at the first time and the video frame with the same time stamp, so that when the terminal outputs the video conference image, the generation and modification of the mark can present a dynamic effect.

[0144] It is worth noting that if the second terminal is a sharer of the video conference, the second terminal can only synthesize the mark into the locally generated video conference image.

[0145] If the second terminal is a participant of the video conference, the second terminal also needs to receive the video conference image sent by the server, and then synthesize.

[0146] 406: The second terminal outputs the video conference image synthesized with the mark.

[0147] In the embodiment of the present disclosure, after the first terminal transmits the mark to the server, the server transmits the mark to the second terminal, so that the second terminal can synthesize the mark into the video conference image, and then output the video conference image containing the mark. In this embodiment, the first terminal uploads the mark, the server sends the mark to the second terminal, and then the second terminal synthesizes the mark and the video conference image.

[0148] Figure 8 is a flowchart of a mark method of a video conference provided by an embodiment of the present disclosure. Referring to Figure 8 , the method comprises:

[0149] 501: The first terminal outputs a video conference image, and the video conference image comprises a mark area defined using a mark frame.

[0150] For details of this step, see step 301.

[0151] 502: The first terminal receives a mark input in the mark area.

[0152] For details of this step, see step 302.

[0153] 503: The first terminal synthesizes the mark into the video conference image.

[0154] In the embodiment of the present disclosure, the first terminal is a sharer of the video conference, so that the first terminal can directly synthesize the mark into the video conference image to be uploaded.

[0155] The first terminal synthesizes the mark and the video conference image according to the association information of the mark and the image, for example, synthesizes the point of the mark generated at the first time and the video frame with the same time stamp, so that the generation and modification of the mark can present a dynamic effect when the terminal outputs the video conference image.

[0156] 504: The first terminal sends the video conference image synthesized with the mark to the server; and the server receives the video conference image synthesized with the mark.

[0157] 505: The server sends the video conference image synthesized with the mark to the second terminal; and the second terminal receives the video conference image synthesized with the mark sent by the server.

[0158] 506: The second terminal outputs the video conference image synthesized with the mark.

[0159] In the embodiment of the present disclosure, after the first terminal transmits the synthesized video conference image with the mark to the server, the server transmits the synthesized video conference image with the mark to the second terminal, so that the second terminal can directly output the video conference image with the mark. In this embodiment, the first terminal performs marking and video conference image synthesis, and then uploads the synthesized video conference image with the mark, and the server sends the synthesized video conference image with the mark to the second terminal.

[0160] Figure 9 is a flowchart of a marking method of a video conference provided by an embodiment of the present disclosure. Referring to Figure 9 , the method comprises:

[0161] 601: The first terminal acquires a mark area permission setting instruction, the mark area permission setting instruction being used to indicate the mark area use permission of each terminal participating in the conference, and the use permission comprising a viewing permission.

[0162] Here, the video conference application has a mark area permission setting function, and when the first terminal is the initiating terminal of the video conference, the user can input the mark area permission setting instruction through the permission setting menu corresponding to the mark area permission setting function. That is, the initiating terminal of the video conference can manage the permission of the mark area.

[0163] Among them, the viewing permission (or referred to as visible permission) includes two cases that the terminal has the viewing permission and the terminal does not have the viewing permission. When the terminal has the viewing permission, the participant can see the content in the mark area, and when the terminal does not have the viewing permission, the participant cannot see the mark content in the mark area.

[0164] Figure 10 is a schematic diagram of a permission setting menu provided by an embodiment of the present disclosure, referring to Figure 10 , the initiating terminal of the video conference can set the permission for all members participating in the conference or for each participant respectively. For example, each participant can set the viewing permission and the marking permission respectively, and the selection indicates that the corresponding permission is possessed.

[0165] Each mark area can be set with a permission individually, and each mark area corresponds to a permission setting menu respectively, which is displayed only when the setting is performed, and is hidden automatically after the setting is completed. The mark area permission setting menu is only visible and operable by the initiating terminal of the video conference. The initiating terminal of the video conference has the viewing permission and the marking permission by default, and does not need to be set.

[0166] 602: The first terminal sends the mark area permission setting instruction to the server. The server receives the mark area permission setting instruction.

[0167] After receiving the instruction, the server can save the instruction, so as to manage the permission of the terminal according to the content in the instruction.

[0168] 603: The first terminal sends the mark to the server; the server receives the mark sent by the first terminal, and the mark is input from the mark area defined by the mark frame in the video conference image output by the first terminal.

[0169] Here, the way of transmitting the mark between the first terminal and the server can refer to the corresponding steps in Figure 4 , Figure 7 or Figure 8 .

[0170] 604: The server executes the mark area permission setting instruction to determine the terminal with the mark area viewing permission.

[0171] For example, referring to Figure 10 , the terminals with the viewing permission are participant A and participant B.

[0172] Exemplarily, after receiving the mark area permission setting instruction, the server can locally establish a permission indication table, and set an identification bit for each terminal for various permissions, for example, a viewing permission identification bit is set for each terminal, 1 indicating that the terminal has the viewing permission, and 0 indicating that the terminal does not have the viewing permission, so as to facilitate the server to quickly determine whether the terminal has the viewing permission.

[0173] 605: The server sends the mark to the terminal with the viewing permission.

[0174] When the terminals with the viewing permission are participant A and participant B, the server sends the mark to the terminals corresponding to participant A and participant B. At this time, the terminals of participant A and participant B can normally display the mark in the mark area, while participant C cannot display the mark in the mark area, and the mark area can be displayed as blank at this time.

[0175] Here, the way of transmitting the mark between the server and the terminal with the viewing permission can refer to the corresponding steps in Figure 4 , Figure 7 or Figure 8 .

[0176] In the embodiments of the present disclosure, the terminal sends the permission setting instruction to the server to indicate the viewing permission of each terminal, and the server sends the mark to the terminal with the viewing permission, thereby realizing the management of the viewing permission.

[0177] Figure 11 is a flowchart of a mark method of a video conference provided by the embodiments of the present disclosure. Referring to Figure 11 , the method comprises:

[0178] 701: The first terminal obtains a mark area permission setting instruction, and the mark area permission setting instruction is used to indicate the mark area use permission of each terminal participating in the conference, and the use permission further includes a mark permission.

[0179] The marking permission is whether the participant can mark in the marking area. When the terminal has the marking permission, the participant can mark in the marking area. When the terminal does not have the marking permission, the participant cannot mark in the marking area. When the viewing permission of a certain terminal is set to no viewing permission, the marking permission is automatically set to no marking permission.

[0180] When the viewing permission of a certain terminal is set to no viewing permission, the marking permission is automatically set to no marking permission.

[0181] Here, the marking permission can include a marking adding permission and a marking modifying permission. The marking adding permission refers to the permission of adding a mark in the marking area, and the marking modifying permission refers to the permission of modifying a mark in the marking area. In the embodiment of the present disclosure, the marking adding permission and the marking modifying permission can be set simultaneously, and in other embodiments, the two can also be set separately.

[0182] Exemplarily, the marking modifying permission is also different for different terminals. For example, the terminal of an ordinary participant can only erase the content marked by himself, and the conference initiator can modify (for example, erase) all the marked content. The position information of the modified mark is uploaded to the server, and the server system updates the mark to other terminals according to the position information of the modified mark.

[0183] The switching of the marking and modifying operations can be in many ways, such as through different keys. When the marking key is selected, the marking can be started, and when the modifying key is selected, the erasing operation can be performed.

[0184] Referring again to Figure 10 , the permission setting of the terminal can set the marking permission in addition to the viewing permission.

[0185] 702: The first terminal sends a marking area permission setting instruction to the server. The server receives the marking area permission setting instruction.

[0186] The detailed content of this step is described in step 602.

[0187] 703: The server sends a marking area permission message to the second terminal to indicate whether the second terminal has the marking permission; and the second terminal receives the marking area permission message sent by the server.

[0188] 704: The second terminal determines whether to provide the marking and marking modifying functions according to the marking area permission message.

[0189] Exemplarily, after receiving the marking area permission message, the second terminal can determine whether it has the marking and marking modification function, and if it has the above function, the function is provided in the video conference application. If it does not have the above function, the function is not provided in the video conference application, for example, when the function is not provided, the brush of the marking area in the video conference application cannot be used, etc.

[0190] For the participants, when having the marking permission, the participants can mark in the marking area through peripherals (such as a mouse, a touchpad), etc. The marking method is writing (such as clicking the left mouse button at the position to be marked, moving the mouse to draw the shape to be marked, using the touchpad, pressing at the position to be marked, and moving to draw the shape to be marked), and the content (the position information of the marking) of the marking is uploaded to the server (the cloud) through the network connected by the terminal corresponding to the participant, and the marking is distributed to other participants by the server.

[0191] In the embodiment of the present disclosure, the second terminal provides or does not provide the marking and marking modification function to the user according to whether it has the marking permission.

[0192] In the embodiment of the present disclosure, by determining the permission of each participant for each marking area, such as viewing, marking, or modifying, etc., the participants can enjoy the operation permission corresponding to the area, which can more adapt to various video conference scenes, and bring more convenient and smooth communication experience to the participants.

[0193] Figure 12 is a flowchart of a marking method of a video conference provided by the embodiment of the present disclosure. Referring to Figure 12 , the method comprises:

[0194] 801: The first terminal acquires a marking area permission setting instruction, and the marking area permission setting instruction is used to indicate the marking area use permission of each terminal participating in the conference, and the use permission further comprises a marking permission.

[0195] The detailed content of this step is described in step 701.

[0196] 802: The first terminal sends the marking area permission setting instruction to the server. The server receives the marking area permission setting instruction.

[0197] The detailed content of this step is described in step 602.

[0198] 803: The first terminal sends the marking to the server. The server receives the marking sent by the first terminal, and the marking is input from the marking area defined by the marking frame in the video conference image output by the first terminal.

[0199] 804: The server determines whether the first terminal has the marking permission according to the marking area permission setting instruction.

[0200] For example, after receiving the marking area permission setting instruction, the server can locally establish a permission indication table, and set an identification bit for each terminal for various permissions, for example, the marking permission identification bit corresponding to each terminal is set, 1 indicates that the terminal has marking permission, and 0 indicates that the terminal does not have marking permission, so that the server can quickly determine whether the terminal has marking permission.

[0201] Similarly, the server can also receive the marking sent by other terminals, determine the marking permission of the other terminals according to the marking area permission setting instruction, and then determine whether to issue the marking of the terminal.

[0202] 805: In response to the first terminal having marking permission, the server sends the marking to the second terminal; and the second terminal receives the marking.

[0203] 806: In response to the first terminal not having marking permission, the server discards the marking.

[0204] In the embodiments of the present disclosure, the terminal provides the function of marking and marking modification to the user, and allows any user to upload the marking to the server, and the server determines whether to issue the marking to other terminals according to the permission of each terminal. That is, the server manages the marking permission of each terminal.

[0205] In combination with the flowcharts of Figure 9 and Figure 12 , it can be known that after receiving the marking sent by the terminal A, the server can first determine whether the terminal A has marking permission, and only if the terminal A has marking permission, the marking of the terminal A is sent to other terminals. When the marking of the terminal A is sent to other terminals, it is necessary to determine which terminals have viewing permission, and after determining the terminals having viewing permission, the marking of the terminal A is sent to the terminals having viewing permission.

[0206] Figure 13 is a structural schematic diagram of a video conference system provided by the embodiments of the present disclosure. Referring to Figure 13 , the system includes a server S and a plurality of terminals. The server and the terminals are respectively used to execute the marking method of the video conference proposed in the foregoing.

[0207] For example, the plurality of terminals correspond to a plurality of participants A to D, and there is a conference initiator in the plurality of terminals, which is not limited by the present disclosure.

[0208] Hereinafter, taking participants A to C having viewing permission and D not having viewing permission, and A to B having marking and C to D not having marking as an example for description.

[0209] As shown in Figure 13As shown, participants A and B can both upload and receive tags, thus displaying the tag A entered by participant A and the tag B entered by participant B in the tag area. Participant C, although unable to create tags, has viewing permissions; therefore, the server sends the received tags A and B to participant C's terminal, causing participant C's terminal tag area to also display tags A and B. Participant D, lacking viewing permissions, has a blank tag area.

[0210] Figure 14 This is a block diagram of a terminal provided in an embodiment of this disclosure. For example... Figure 14 As shown, the terminal includes: a hardware layer 1401, a driver layer 1402, an operating system 1403, and a video conferencing application 1404. The video conferencing application 1404 includes standard modules for implementing video conferencing, such as a user interface (UI) module 1441, an audio / video encoding / decoding module 1442, a file / desktop sharing module 1443, a meeting management module 1444, a terminal peripheral scheduling module 1445, an audio / video acquisition / playback module 1446, and a communication protocol stack 1447. These modules are standard modules in a video conferencing application and will not be described in detail here.

[0211] To implement the tagging function proposed in this disclosure, the video conferencing application 1404 further includes: a tagging UI module 1448, a tagging permission management module 1449, a tagging area management module 1450, a tagging location acquisition module 1451, a tagging information overlay module 1452, a tagging information sending module 1453, and a tagging information receiving module 1454.

[0212] The marking UI module 1448 is configured to draw a graphical interface such as a marking area and a permission management menu on the interface of the video conference according to the requirement of a user. The marking permission management module 1449 is configured to determine the permission of each participant according to the setting of an administrator at the video conference initiating end, and transmit the permission to each participant terminal through the server. The participant terminal determines the marking permission of the participant according to the permission issued by the administrator, and limits the operation of the participant. The marking area management module 1450 is configured to control the marking UI module to draw a marking area according to the received marking area size and position information, and control the display or blanking of the marking area. The marking position acquisition module 1451 is configured to acquire the marking position information according to the marking operation. The pixel at the top left corner of the sharing area or the marking area is marked as (0, 0), and the pixel number is incremented from the right and downward from the (0, 0) point. When the marking or erasing operation is performed, the marking position acquisition module acquires the coordinates and the sequence of the selected pixels, that is, the coordinates and the sequence of each point on the marking line. The marking information sending module 1453 is configured to send the pixel coordinates and the sequence and other marking area information to the server according to the requirement of a communication protocol. The marking information receiving module 1454 is configured to receive the position and the sequence of the marked or erased pixels and the marking area information sent by the server according to the requirement of the communication protocol. The marking information superposition module 1452 is configured to synthesize the marking into the corresponding position in the video conference image according to the received position and sequence of the marked or erased pixels, or erase the marking at the corresponding position.

[0213] It should be noted that the marking information receiving module 1454 and the marking information superposition module 1452 in the terminal are optional modules. For example, when the marking and the video conference image are synthesized at the server, the marking information receiving module 1454 and the marking information superposition module 1452 can not be included in the terminal.

[0214] It should be noted that the terminal provided in the above embodiment is only used as an example for the division of the above functional modules. In actual applications, the above functions can be completed by different functional modules according to the requirement, that is, the internal structure of the device is divided into different functional modules to complete all or part of the above described functions. In addition, the terminal and the marking method for the video conference provided in the above embodiment belong to the same concept, and the implementation process is detailed in the method embodiment, which will not be described here.

[0215] Figure 15 A block diagram of a server provided in the embodiments of the present disclosure is shown in FIG. 14. As shown in FIG. 14, the server includes a marking information receiving module 1401, a marking information superposition module 1402, a marking information sending module 1403, a marking area management module 1404, a marking permission management module 1405, a marking UI module 1406, a marking position acquisition module 1407, a marking information receiving module 1408, a marking information superposition module 1409, a marking information sending module 1410, a marking area management module 1411, a marking permission management module 1412, a marking UI module 1413, and a marking position acquisition module 1414. Figure 15As shown, the server comprises: server hardware 1501 (single or multiple servers), an operating system 1502, a video conference system 1503. The video conference system 1503 comprises common modules for implementing video conferences, such as a conference management service module 1531, a streaming service module 1532, an audio / video codec service module 1533, a file storage service module 1534, a monitoring service module 1535, a statistical analysis service module 1536, a UI module 1537, and a communication protocol stack 1538, etc.

[0216] To implement the marking function proposed in the present disclosure, the video conference application 1503 further comprises: a permission management service module 1539, a region management service module 1540, a marking superimposition service module 1541, a marking information sending module 1542, and a marking information receiving module 1543.

[0217] The permission management service module 1539 is configured to obtain permission information of each participant, for managing the permissions of each participant terminal. The marking superimposition service module 1541 is configured to use different superimposition strategies for terminals with different permissions according to the permission information, such as participant A not having the permission to view, so that no marking is sent to participant A, and only the video conference image is forwarded to A; for example, participant B has the permission to mark, so that B's marking is synthesized onto the video conference image; for example, participant C has the permission to view but not the permission to mark, so that C's marking is not synthesized onto the video conference image, but the marking of other participants with the permission to mark is synthesized and sent to C, and if the synthesis process is completed at the terminal, the server only processes the marking or erasing information and directly forwards, and does not synthesize the marking and the video conference image. The region management service module 1540 is configured to record and update in real time the information such as the coordinates and size of the marking region, and forward to each participant, and the participant establishes the marking region on the terminal conference interface according to the information. The marking information sending module 1542 and the marking information receiving module 1543 are configured to transmit information such as the position and sequence of marking and erasing.

[0218] It should be noted that the marking superimposition service module 1541 in the server is an optional module, for example, when the marking and the video conference image are synthesized at the terminal, the marking superimposition service module 1541 can not be included in the server.

[0219] As shown in Figure 16 The computer device 1600 can be used to execute the marking method of the video conference provided in each of the above embodiments. Referring to Figure 16 The computer device 1600 comprises a memory 1601, a processor 1602, and a display component 1603, and those skilled in the art can understand that,Figure 16 The structure of the computer device 1600 shown in the figure does not constitute a limitation on the computer device 1600, and in actual applications, more or fewer components than those shown in the figure can be included, or certain components can be combined, or different component arrangements can be included. Among them:

[0220] The memory 1601 can be used to store computer programs and modules, and the memory 1601 can mainly include a program storage area and a data storage area, wherein the program storage area can store operating systems, application programs required by at least one function, and the like. The memory 1601 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state memory device. Accordingly, the memory 1601 can also include a memory controller to provide access for the processor 1602 to the memory 1601.

[0221] The processor 1602 executes various function applications and data processing by running software programs and modules stored in the memory 1601.

[0222] The display component 1603 is used to display images, and the display component 1603 can include a display panel, which can be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), and the like.

[0223] In an example embodiment, a computer readable storage medium is also provided, which is a non-volatile storage medium, and the computer program is stored in the computer readable storage medium, and when the computer program in the computer readable storage medium is executed by a processor, the video conference marking method provided in the embodiments of the present disclosure can be executed.

[0224] In an example embodiment, a computer program product is also provided, and the computer program product stores instructions, which, when executed on a computer, enable the computer to execute the video conference marking method provided in the embodiments of the present disclosure.

[0225] In an example embodiment, a chip is also provided, which includes a programmable logic circuit and / or program instructions, and when the chip is executed, the video conference marking method provided in the embodiments of the present disclosure can be executed.

[0226] Those of ordinary skill in the art can understand that all or part of the steps of the above-mentioned embodiments can be completed by hardware, or by program instructions instructing relevant hardware to complete, and the program can be stored in a computer readable storage medium. The storage medium mentioned above can be a read-only memory, a magnetic disk or an optical disk, etc.

[0227] The above merely provides the optional embodiments of the present disclosure, and does not represent the only ones of the present disclosure. Any modification, equivalent replacement, improvement, and the like made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A marking method for video conferencing, characterized in that, The method includes: The first terminal outputs a video conference image, which includes a marked area defined by a marker frame. The video conference image also includes a shared area, which is the region where the first terminal shares the screen provided by a first sharer. The marked area is located outside the shared area and has the function of sharing the screen provided by a second sharer. The number of marked areas is N, where N is a positive integer greater than 1, and the value of N is positively correlated with terminal performance and network speed. The screen provided by the second sharer is displayed within a fixed marked area. When the first terminal has marking permissions, it receives the markings input in the marking area; The first terminal sends the tag to the server, so that the server, in response to the first terminal having tagging permission and the second terminal being a terminal with tagging area viewing permission, sends the tag to the second terminal, so that the second terminal displays the video conference image with the tag. The first terminal is any terminal participating in the video conference, and the second terminal and the first terminal are different terminals. The tag and the conference video image of the shared area are sent separately.

2. The method according to claim 1, characterized in that, The first terminal outputs video conference images, including: Get the marking area settings information; The marker frame is drawn based on the marker area setting information to output the video conference image with the marker area.

3. The method according to claim 2, characterized in that, The marker area setting information includes at least one of the following parameters: The number of marker areas, the position of each marker area, the shape of each marker area, the size of each marker area, and the border properties of each marker area.

4. The method according to any one of claims 1 to 3, characterized in that, The first terminal is the initiator of the video conference, and the method further includes: Send a permission setting instruction for the marked area to the server so that the server can control the usage permissions of the marked area for each terminal participating in the meeting.

5. The method according to claim 4, characterized in that, The usage rights include at least one of the following: View permissions, mark permissions.

6. The method according to any one of claims 1 to 3, characterized in that, The first terminal sends the tag to the server, including: The markers are then incorporated into the video conference images; The video conference image with the aforementioned marker is sent to the server; or, The marker and its association with the image are sent to the server so that the server can composite the marker into the video conferencing image.

7. A marking method for video conferencing, characterized in that, The method includes: The server receives a tag sent by a first terminal. The tag is input from a tag area defined by a tag frame in the video conference image output by the first terminal. When the first terminal has tagging permissions, it receives the tag input in the tag area. The video conference image also includes a shared area, which is the area where the first terminal shares the screen provided by the first sharer. The tag area is located outside the shared area and has the function of sharing the screen provided by the second sharer. The number of tag areas is N, where N is a positive integer greater than 1, and the value of N is positively correlated with terminal performance and network speed. The screen provided by the second sharer is displayed within a fixed tag area. In response to the first terminal having marking permissions and the second terminal having marking area viewing permissions, the server sends the marking to the second terminal, causing the second terminal to display the video conference image with the marking. The first terminal is any terminal participating in the video conference, and the second terminal and the first terminal are different terminals. The marking and the conference video image of the shared area are sent separately.

8. The method according to claim 7, characterized in that, The server sends the tag to the second terminal, including: The marker and its association information with the image are sent to the second terminal so that the second terminal can composite the marker into the video conference image.

9. The method according to claim 7 or 8, characterized in that, Before the server sends the tag to the second terminal, the method further includes: Identify the terminals that have permission to view the marked area.

10. The method according to claim 9, characterized in that, Before determining the terminal with marked area viewing permissions, the method further includes: The system receives a marking area permission setting instruction sent by the initiator of the video conference. The marking area permission setting instruction is used to indicate the marking area usage permissions of each terminal participating in the conference, and the usage permissions include viewing permissions.

11. The method according to claim 10, characterized in that, The usage permissions also include marking permissions, and the method further includes: Generate a tag zone permission message according to the tag zone permission setting instruction; A tag area permission message is sent to the second terminal to indicate whether the second terminal has tagging permission.

12. The method according to claim 7 or 8, characterized in that, The method further includes: In response to the first terminal not having tagging permissions, the tag is discarded.

13. A terminal, characterized in that, The terminal includes a processor and a memory; The memory is used to store computer programs; The processor is configured to execute a computer program stored in the memory to implement the video conferencing marking method according to any one of claims 1 to 6.

14. A server, characterized in that, The server includes a processor and memory; The memory is used to store computer programs; The processor is configured to execute a computer program stored in the memory to implement the video conferencing marking method according to any one of claims 7 to 12.

15. A video conferencing system, characterized in that, The video conferencing system includes the terminal as described in claim 13 and the server as described in claim 14.

16. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that, when executed by a processor, enable the video conferencing marking method as described in any one of claims 1 to 6, or the video conferencing marking method as described in any one of claims 7 to 12.

Images