Method for processing visual communication mark layer

Abstract

The invention discloses a method for processing a visual communication marked layer, which comprises the following steps of: analyzing a received marked layer message in visual communication; the marked layer message at least comprises marked layer data and corresponding display parameters; displaying the marked layer data on more than two visual communication terminals according to the display parameters; the marked layer data at least comprises marked layer content and / or marked layer attributes; the display parameters at least comprise a display mode and / or a role switch. By utilizing the method provided by the invention, all the marked layers can be designed in advance, and display can be realized by sending and analyzing the message of the visible layer when the marked layers need to be displayed, so that the display of the marked layers can be orderly controlled. The role switch is used in the marked layer message, so that a control party for marked layer display can flexibly control some marked layers to only display or close specific communication participants (visual communication terminals) according to needs.

Description

Technical Field

[0001] The invention relates to a visual communication technology, in particular to a method for displaying auxiliary information on a visual communication screen, and belongs to communication and Internet media technology. Background Art

[0002] In some visual communication scenarios, the communicating parties often need to add some auxiliary information to the visual picture to enhance the effect of mutual communication and improve the efficiency of communication. However, almost all visual communication technologies seem to focus more on the quality of voice and picture, the synchronization between voice and picture, etc. Although these are also very meaningful, they are not helpful for achieving the above-mentioned goals.

[0003] The inventor filed an invention patent application with application number 201911235798.7 on December 5, 2019. The following technical contents are disclosed in the invention patent application:

[0004] "In the fourth specific implementation of the first category of the present invention, a method is provided for the parties to a call to interact with each other in addition to voice communication: interactive marking.

[0005] The so-called interactive marking means that any party participating in the call of the present invention can use its terminal to arbitrarily write, draw patterns or make marks on the terminal graphical interface, just like drawing patterns on the touch screen of a mobile phone, or using a handwriting tablet to input points, line trajectories, etc. on the display interface of a PC terminal; in order to achieve this purpose, in the first specific fourth implementation of the present invention, a corresponding marking information table and marking layer identifier are also established for each activated terminal; wherein, at least marking trajectory data, marking time parameters, and marking pen attribute information are stored in the marking information table. The marking trajectory data in the marking information table is mainly used to record the coordinates of the points and line trajectories input by the terminal user. These coordinates are transmitted to other activated terminals and displayed on other activated terminals on the one hand, and are also stored by the system on the other hand, so as to reproduce the interactive markings of the terminal user during the call in the future when needed. The marking time parameter is used to indicate the order in which the marking trajectory data appear, for example: this will enable all users participating in the call to accurately know the process of drawing a certain line segment; this is very meaningful during interactive communication. Even reproducing the call process afterwards is equally valuable. The marker pen attribute information is also used in conjunction with the marker trajectory data; usually, the marker pen attribute information includes at least the following parameters: pen thickness, ink color, pen weight, etc.; this information is mainly used to describe the marker trajectory data in a more detailed manner, so that the reproduced marker trajectory is vivid and realistic. In addition to the aforementioned parameters related to the marker trajectory data, the marker layer identifier is also a very important parameter or data. The marker layer identifier is mainly used to distinguish between many different marker information tables. On the one hand, it can facilitate the storage and management of each marker information table, and on the other hand, it can accurately reproduce the aforementioned marker trajectory data. "

[0006] The above technical solution solves some of the problems mentioned above to a certain extent, but it has certain limitations in some scenarios. Specifically, since visual communication is often used in multi-party call scenarios, such as meetings, online teaching, etc. In these scenarios, if the technical solution provided by the invention patent application No. 201911235798.7 is used, it often leads to two problems:

[0007] 1. All marker layers are generated and used instantly and cannot be designed in advance, which cannot meet some requirements for orderly control of marker layer display.

[0008] 2. In some scenarios, not all tags need to be displayed to all communication participants. For example, during online teaching, the teacher's lesson plan prompt information is usually not displayed to students, but the solution provided by the aforementioned invention obviously cannot support this requirement. Summary of the invention

[0009] The main purpose of the present invention is to provide a method for processing a visual communication mark layer, by means of which the mark layer can be controllably displayed in visual communication.

[0010] The above-mentioned purpose of the present invention is achieved through the following technical solutions:

[0011] A method for processing a marking layer in visual communication is provided, comprising: in visual communication, parsing a received marking layer message; the marking layer message at least comprises marking layer data and corresponding display parameters;

[0012] Displaying the marking layer data on two or more visual communication terminals according to the display parameters;

[0013] The marking layer data at least includes: marking layer content and / or marking layer attributes;

[0014] The display parameters at least include: a display mode and / or a role switch.

[0015] By using the method of the present invention, since the visual communication terminal can display after receiving and parsing the visual layer message, all the marking layers can be designed in advance, and when display is needed, the sending and parsing of the visual layer message is used to realize the display of the marking layers, so the marking layer display can be controlled in an orderly manner. On the other hand, the use of the role switch in the marking layer message allows the controller of the marking layer display to flexibly control certain marking layers to be displayed or closed only to specific communication participants (visual communication terminals) according to actual needs.

[0016] Hereinafter, various technical solutions of the present invention will be disclosed in more detail in combination with various specific implementation methods. DETAILED DESCRIPTION

[0017] All specific embodiments of the present invention are run in the following visual communication system environment:

[0018] The system comprises at least one system end and more than two visual communication terminals. The two or more visual terminals are respectively connected to the system end by means of a communication network; and the two or more visual terminals are connected to each other by means of the system end.

[0019] Based on the above-mentioned visual communication system, the first type of specific implementation of the present invention includes the following operations:

[0020] In visual communication, any visual communication terminal that is conducting visual communication parses the received marking layer message; the marking layer message includes at least marking layer data and corresponding display parameters. Among them, the marking layer data is composed of at least one or all of two types of information: one is the marking layer content, and the other is the marking layer attribute information. The marking layer content usually includes the information that can be displayed by the marking layer, such as: patterns, text, etc.; and the marking layer attribute information is used to distinguish different marking layers in a visual communication, and commonly includes: marking layer color, number and other information; in addition, it can also include such information: used to indicate which specific visual terminal a specific marking layer belongs to in the current video call.

[0021] The various information in the mark layer message is organized according to a certain information protocol to form a specific data format. Therefore, the receiving party can parse it based on this data format to obtain various information, such as mark layer content and mark layer attribute information.

[0022] After obtaining the marking layer data and display parameters, the marking layer data can be displayed on two or more visual communication terminals according to the display parameters. The display parameters generally include the following types: making the marking layer data appear on the display screen of the visual communication terminal according to a certain display mode, such as direct display, delayed display, continuous or flashing display, display in a fade-out or fade-in manner, etc. In addition, in some specific cases, the author of the marking layer hopes that some marking layer data will be displayed or not displayed only for a specific group (visual communication terminal); in this case, the display parameters can also include: a role switch, which can be used to turn on or off the display of the marking layer on the corresponding visual communication terminal.

[0023] By using the aforementioned first specific implementation method of the present invention, since the visual communication terminal can display after receiving and parsing the visual layer message, all the markup layers can be designed in advance, and when display is needed, the visible layer message is sent and parsed, so the display of the markup layers can be controlled in an orderly manner. On the other hand, the use of the role switch in the markup layer message allows the controller of the markup layer display to flexibly control certain markup layers to be displayed or closed only to specific communication participants (visual communication terminals) according to actual needs by using the role switch.

[0024] In some cases, for example, the parties involved in the communication will add some new mark data, such as patterns, text information, etc., to their mark layers in real time during some specific discussions. These mark data are called dynamic mark data. Therefore, in the second specific implementation of the present invention, based on the first specific implementation, the following are added: dynamic mark data based on these real-time inputs and display parameters corresponding to the dynamic mark data, and these dynamic mark data and corresponding display parameters are recorded in the mark layer message.

[0025] Therefore, the second specific implementation of the present invention also includes such a technical solution: when the dynamic mark data is received, the dynamic mark data is displayed on two or more visual communication terminals according to the display parameters corresponding to the dynamic mark data.

[0026] By utilizing the aforementioned second category of specific implementation methods of the present invention, the parties involved in the communication can instantly add new marking data for discussion on the existing marking layer at any time during some specific discussions. These new marking data can be instantly provided to the visual communication terminals of the parties involved in the communication through the updated marking layer messages through the second category of specific implementation methods of the present invention, so that they can be displayed together with the original marking layer.

[0027] As we all know, in the same visual communication, the rights of the parties involved in the visual communication are equal in some cases, and any party can speak freely or use the marked layer to express. However, in some other situations, such as video conferencing, online teaching, lectures, etc., the rights of the parties involved in the visual communication must be different; that is, the rights of the host, lecturer, speaker of the meeting are different from those of the general audience and students; the "rights" here generally refer to the control over the display and operation of the marked layer. For this reason, in the third category of specific implementation methods of the present invention, on the basis of the aforementioned first and second categories of specific implementation methods, the following technical contents are also provided:

[0028] The marking layer message also provides a marking layer control right parameter; during the visual communication process, when the parties involved in the visual communication (at least two parties) receive the marking layer control right parameter, they select the visual terminal indicated by the marking layer control right parameter among the visual communication terminals of the parties involved in the visual communication to control the display operation of the marking layer.

[0029] By utilizing the aforementioned third category of specific implementation methods of the present invention, when necessary, a party participating in visual communication can obtain control over the display and operation of the marking layer with the help of the marking layer control rights parameters, and the control over the display and operation of the marking layer can also be transferred from a party participating in visual communication to other parties with the help of the marking layer control rights parameters.

[0030] In the prior art, some visual communication processes can be recorded, but basically they are recorded in the form of video recordings of the screens of all participants in the entire visual communication. However, the layer information that can be used for display and interaction in the present invention cannot be recorded, so there is no question of reproduction. Since the layers of the present invention and the dynamic marks on the same layer and other information are pre-designed in the form of information data, and are transmitted and used in the form of data and messages, their transmission, display, and the addition and display of dynamic marks have an objective technical basis for being recorded in the process of visual communication. To this end, the present invention further provides a fourth category of specific implementation methods based on the aforementioned specific implementation methods and their combinations:

[0031] During the visual communication process, the operation of sending the marking layer message and / or the marking layer control right parameter is recorded.

[0032] With the fourth specific implementation of the present invention, since the operation of sending the marking layer message and / or marking layer control right parameter is recorded in the specific visual communication process, the specific time information of sending the marking layer message and / or marking layer control right parameter can be recorded. And this interrelated data can be used to reproduce the visual communication process when needed in the future. This feature is of great significance for the replay and reproduction of online teaching and lectures.

Claims

1. A method for processing a visual communication mark layer, comprising: In visual communication, the received marking layer message is parsed; The marking layer message at least includes marking layer data and corresponding display parameters; Displaying the marking layer data on two or more visual communication terminals according to the display parameters; The marking layer data at least includes: marking layer content and / or marking layer attributes; The display parameters at least include: a display mode and / or a role switch.

2. The method according to claim 1, characterized in that: Based on the dynamic mark data input in real time and the display parameters corresponding to the dynamic mark data, the dynamic mark data and the corresponding display parameters are recorded in the mark layer message; and / or, when the dynamic mark data is received, the dynamic mark data is displayed on more than two visual communication terminals according to the display parameters corresponding to the dynamic mark data.

3. The method according to claim 1 or 2, characterized in that: During the visual communication process, the sending of the mark layer message, the input of the dynamic mark and the operation of displaying the dynamic mark data are recorded.

4. The method according to claim 1 or 2, characterized in that: The marking layer message also includes a marking layer control right parameter; When the marking layer control right parameter is received, the visual terminal indicated by the marking layer control right parameter is selected from among the two or more visual communication terminals to control the display operation of the marking layer.

5. The method according to claim 1 or 2, characterized in that: During the visual communication process, the operation of sending the marking layer message is recorded.

6. The method according to claim 3, characterized in that: During the visual communication process, the operation of sending the marking layer message is recorded.

7. The method according to claim 4, characterized in that: During the visual communication process, the operation of sending the marking layer message and / or the marking layer control right parameter is recorded.