On-line conference communication architecture system and method based on screen projection

Abstract

The invention provides an online conference communication architecture system and method based on screen projection, and the system comprises an equipment docking module which is used for carrying out the docking of all authorization equipment with a conference master control terminal based on a conference creation result, and controlling a main screen in the authorization equipment to display the to-be-projected data based on a docking result; the screen projection module is used for coding the data to be subjected to screen projection into video streams in real time based on the display result, uploading the video streams to a video channel, and distributing video stream differences to the conference participating terminals in the authorization devices according to the screen projection requirements based on the uploading result; the display configuration module is used for performing equal-ratio content window conversion display on the video stream according to a coordinate conversion mechanism based on the distribution result, and receiving an operation instruction of the conference participating terminal in real time based on a conversion display result; and the response module is used for sending the operation instruction to each authorization device based on the signaling track channel, and synchronously updating the display content of each authorization device. And the accuracy, efficiency and effect of screen projection are improved.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a communication architecture system and method for an online conference based on screen projection. Background Art

[0002] In the daily work of enterprises, meetings are a common work scene, including corporate meetings and educational meetings. Currently, meetings are generally divided into two modes. One is an offline meeting, in which the speaker of the meeting usually opens the content to be displayed on a laptop or mobile phone, and displays it synchronously on the large screen of the TV in the conference room through HDMI or screen projection. The other is an online meeting, which is used for multiple people to hold online meetings in different locations, and screen projection is a necessary operation for the meeting.

[0003] However, during the current screen projection operation of a conference, only the data to be projected can be uniformly projected to all devices, and targeted screen projection operations cannot be performed according to the projection needs, resulting in a waste of resources. At the same time, the current screen projection operation can only be performed on devices within the same local area network. When there are branch venues, the screen projection operation cannot be performed. Moreover, during screen projection, only the speaker is allowed to write and draw on the control terminal, and the participants cannot operate on their respective terminals, which greatly reduces the screen projection effect.

[0004] Therefore, in order to overcome the above-mentioned defects, the present invention provides a communication architecture system and method for online conferences based on screen projection. Summary of the invention

[0005] The present invention provides a communication architecture system and method for online conferences based on screen projection, which are used to connect different authorized devices with the conference main control terminal to facilitate the screen projection of the same content on different devices, thereby realizing one-to-many fast screen projection. Secondly, the screen projection data is encoded in real time and distributed to each authorized device through video channels, thereby ensuring that the screen projection data can be effectively projected in different application scenarios and guaranteeing the screen projection efficiency. Finally, the operation instructions of different users on their respective terminals are monitored in real time, and the operation data of different users on their respective terminals are effectively and synchronously displayed on the terminals of other users through signaling track channels, thereby improving the accuracy and adaptability of screen projection and avoiding screen projection operations on unnecessary terminals, saving resources and improving the efficiency and effect of screen projection.

[0006] The present invention provides a communication architecture system for online conferences based on screen projection, comprising:

[0007] The device docking module is used to dock each authorized device with the conference main control terminal based on the conference creation result, and control the main screen in the authorized device to display the screen data to be projected based on the docking result;

[0008] The screen projection module is used to encode the screen projection data into a video stream in real time based on the display result and upload it to the video channel, and distribute the video stream difference to the participating terminals in each authorized device according to the screen projection requirements based on the uploaded result;

[0009] A display configuration module is used to convert and display the content window of the video stream in a proportional manner according to the coordinate conversion mechanism based on the distribution result, and receive operation instructions from the participating terminals in real time based on the conversion display result;

[0010] The response module is used to send the operation instruction to each authorized device based on the signaling track channel, and synchronously update the display content of each authorized device.

[0011] Preferably, in a communication architecture system for online conferences based on screen projection, the authorized devices include a main screen, split screens and a tablet.

[0012] Preferably, a communication architecture system for online conference based on screen projection, a device docking module, includes:

[0013] A conference creation unit, configured to receive a conference creation instruction based on a conference master control terminal, trigger a conference creation mechanism to create a conference based on a reception result, and allocate a docking interface to each authorized device at the conference master control terminal based on the creation result;

[0014] A device docking unit, used to extract the device number of each authorized device, and extract the communication address of each authorized device based on the device number, and dock each authorized device with the conference created in the conference main control terminal based on the communication address and the docking interface;

[0015] The status updating unit is used to start the TV main screen based on the docking result and load the conference program based on the startup result.

[0016] Preferably, a communication architecture system for online conferences based on screen projection, a conference creation unit, includes:

[0017] The data uploading subunit is used to start the preset document service based on the conference creation result, and receive the data information uploaded by the user based on the start result;

[0018] Format conversion unit, used for:

[0019] Extracting target component composition of the data information based on the received result, and splitting the data information into components based on the target component composition to obtain document content, video and audio in the data information;

[0020] Extract the document content from the data information, and convert the format of the document content based on the preset document service to obtain the target display page;

[0021] The target display page is associated with the video and audio based on the time series to complete the reception and preprocessing of the data to be projected.

[0022] Preferably, a communication architecture system for online conference based on screen projection, a device docking module, includes:

[0023] A result acquisition unit, used for acquiring the data to be projected, and loading the data to be projected based on the conference program;

[0024] Display unit for:

[0025] Extracting a list of contents to be displayed of the screen data to be projected based on the loading result, and determining to extract basic display attributes of each screen data to be projected based on the list of contents to be displayed;

[0026] The display order and expected display duration of the data to be projected are determined based on the basic display attributes, and the data to be projected are displayed in sequence according to the display order and expected display duration based on the conference program.

[0027] Preferably, a communication architecture system for online conference based on screen projection, a screen projection module, includes:

[0028] A monitoring unit, used to monitor the display results in real time, and obtain the playback timestamp of each screen projection data based on the real-time monitoring results;

[0029] Coding unit for:

[0030] Serialize the data to be projected based on the playback timestamp to obtain the projection screen corresponding to each playback timestamp, and determine the projection scene and basic projection parameters of the projection screen based on the projection requirements;

[0031] Preprocess the projection screen based on the basic projection parameters, and determine the video encoding format of the projection screen based on the preprocessing result according to the projection scene;

[0032] Determine the encoding parameters of the projection screen based on the projection requirements, and encapsulate the video encoding format and encoding parameters to obtain a video encoding mechanism;

[0033] Based on the video encoding mechanism, each projection screen is encoded in turn according to the playback timestamp, and the video stream data is time-stamped based on the playback timestamp to obtain the video stream data;

[0034] The data uploading unit is used to load the video stream data into the upload queue in the video channel, and upload the video stream data to the video channel after the loading is completed.

[0035] Preferably, a communication architecture system for online conference based on screen projection, a screen projection module, includes:

[0036] A demand parsing unit is used to obtain screen projection requirements based on the conference main control terminal, and parse the screen projection requirements to obtain the geographical location of each authorized device, and determine the network area distribution status of each authorized device based on the geographical location, wherein the network area distribution status includes the same local area network and cross-network;

[0037] Differential distribution unit for:

[0038] When all authorized devices are in the same LAN:

[0039] Obtain the communication address of each authorized device and construct a multicast address based on the communication address;

[0040] Encapsulate the video stream to obtain the data packet to be distributed, and distribute the data packet to be distributed to the participating terminals in each authorized device according to the multicast address based on the multicast network protocol;

[0041] When the authorized devices are across networks:

[0042] The video distribution server is configured with a path based on the communication address of each authorized device. At the same time, the real-time transfer byte volume of the video stream is determined based on the screen projection requirements, and the cache space of the video distribution server is configured based on the real-time transfer byte volume;

[0043] Obtain device attributes and network attributes of each authorized device, and determine the distribution priority for each authorized device based on the device attributes and network attributes;

[0044] Encapsulate the video stream to obtain a data packet to be distributed, and upload the data packet to be distributed to the video distribution server based on the cache space configuration result;

[0045] Based on the upload result, the video distribution server is controlled to distribute the data packets to be distributed to the participating terminals in each authorized device according to the path configuration result and the distribution priority of each authorized device.

[0046] Preferably, a communication architecture system for online conference based on screen projection, display configuration module, includes:

[0047] A content display unit, used to obtain the content window size of each participating terminal for video display, and scale the video stream in proportion based on the content window size and the coordinate conversion mechanism, and display the video stream based on the proportional scaling result;

[0048] Monitoring unit for:

[0049] Based on the displayed results, an active monitoring mechanism is started, and based on the start-up results, the operation data of each user on the participating terminal is monitored in real time, wherein the operation data includes text input data and trajectory input data;

[0050] Recognize the text input data and the trajectory input data based on the preset service mechanism, and obtain the path and position data of the text input data and the trajectory input data on each participating terminal based on the recognition result;

[0051] Based on the content window size control coordinate conversion mechanism of each participating terminal, the path and position data on each participating terminal are converted to obtain the operation instructions of each user on each participating terminal, wherein the operation instructions include text instructions and trajectory instructions.

[0052] Preferably, a communication architecture system for online conference based on screen projection, a response module, includes:

[0053] Instruction processing unit, used to:

[0054] Obtain the obtained operation instructions, and upload the operation instructions to the channel trajectory channel;

[0055] Sending the operation instruction to each authorized device based on the uploaded result, and responding to the text instruction in the operation instruction based on the main screen of the authorized device;

[0056] Based on the response result, the text instruction is converted into a standard execution event, and the standard execution event is executed. At the same time, the display content of each authorized device is synchronously updated based on the execution result;

[0057] At the same time, each authorized device receives the trajectory instruction in the operation instruction, and converts the format of the trajectory instruction based on the receiving result to obtain the operation trajectory;

[0058] The operation track is displayed on each authorized device.

[0059] The present invention provides a communication architecture method for an online conference based on screen projection, comprising:

[0060] Step 1: Based on the conference creation result, each authorized device is connected to the conference main control terminal, and based on the connection result, the main screen in the authorized device is controlled to display the screen data to be projected;

[0061] Step 2: Based on the display results, the screen data to be projected is encoded into a video stream in real time and uploaded to the video channel. Based on the uploaded results, the video stream differences are distributed to the participating terminals in each authorized device according to the projection requirements;

[0062] Step 3: Based on the distribution result, the video stream is converted and displayed in a proportional content window according to the coordinate conversion mechanism, and the operation instructions of the participating terminals are received in real time based on the conversion display result;

[0063] Step 4: Send the operation instruction to each authorized device based on the signaling track channel, and synchronously update the display content of each authorized device.

[0064] Compared with the prior art, the present invention has the following beneficial effects:

[0065] By connecting different authorized devices to the conference main control terminal, it is convenient to project the same content on different devices, realizing one-to-many fast screen projection. Secondly, the data to be projected is encoded in real time and distributed to each authorized device through the video channel difference, ensuring that the data to be projected can be effectively projected in different application scenarios, ensuring the efficiency of screen projection. Finally, the operation instructions of different users on their respective terminals are monitored in real time, and the operation data of different users on their respective terminals are effectively synchronized and displayed on the terminals of other users through the signaling track channel, which improves the accuracy and adaptability of screen projection, avoids screen projection operations on unnecessary terminals, saves resources, and at the same time improves the efficiency and effect of screen projection.

[0066] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures specifically pointed out in this application document.

[0067] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0068] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0069] Figure 1 This is a structural diagram of a communication architecture system for an online conference based on screen projection in an embodiment of the present invention;

[0070] Figure 2 It is a schematic diagram of the connection and working principle of the authorization device in a communication architecture system of an online conference based on screen projection in an embodiment of the present invention;

[0071] Figure 3 The present invention is a flowchart of a communication architecture method for an online conference based on screen projection in an embodiment of the present invention. DETAILED DESCRIPTION

[0072] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0073] Embodiment 1:

[0074] This embodiment provides a communication architecture system for online conferences based on screen projection, such as Figure 1 As shown, including:

[0075] The device docking module is used to dock each authorized device with the conference main control terminal based on the conference creation result, and control the main screen in the authorized device to display the screen data to be projected based on the docking result;

[0076] The screen projection module is used to encode the screen projection data into a video stream in real time based on the display result and upload it to the video channel, and distribute the video stream difference to the participating terminals in each authorized device according to the screen projection requirements based on the uploaded result;

[0077] A display configuration module is used to convert and display the content window of the video stream in a proportional manner according to the coordinate conversion mechanism based on the distribution result, and receive operation instructions from the participating terminals in real time based on the conversion display result;

[0078] The response module is used to send the operation instruction to each authorized device based on the signaling track channel, and synchronously update the display content of each authorized device.

[0079] In this embodiment, in addition to the video channel and the signaling track channel, there is another channel: the audio channel. The audio channel uses the telephone service (PBX service). The service is based on open source implementation. Each device only integrates the corresponding client, including: mobile phones, landlines, access to the conference through the telephone conference service, and listen to the conference. The schematic diagram of the authorized device connection and working principle is as follows Figure 2 shown.

[0080] In this embodiment, the conference creation result refers to monitoring the conference creation needs and creation status initiated by the user at the conference main control terminal, that is, after the conference is successfully created, the authorized device is bound to the conference main control terminal, where each authorized device includes the main screen, split screen, tablet, mobile phone, and landline phone, etc.

[0081] In this embodiment, the data to be projected refers to the information that needs to be projected and displayed, including files in formats such as docx, ppt, pdf, html, markdown, pictures, as well as videos, audios, etc.

[0082] In this embodiment, real-time encoding into a video stream refers to converting the format of the screen projection data into a coding form that can be easily transmitted in the video channel.

[0083] In this embodiment, the screen projection requirements are known in advance, including the network conditions of each authorized device.

[0084] In this embodiment, distributing the video stream differences to the participating terminals in each authorized device means distributing the video streams in different ways according to the situation of the network where each authorized device is located, including multicast distribution and cross-network distribution.

[0085] In this embodiment, the coordinate conversion mechanism is pre-configured and used to perform coordinate conversion on the display content and the user's operation data. Moreover, when performing the coordinate conversion, the conversion is performed relative to the size of the display content, in order to ensure that the user's operation data can be effectively displayed on different terminals.

[0086] In this embodiment, the operation instruction refers to the operation request of the user on the authorized device, including operation data such as text writing, clicking, sliding, and multi-touch.

[0087] In this embodiment, the signaling track channel is used to transmit operation instructions, that is, to transmit the operation instructions to each authorized device, and the video channel is used to transmit video data. The two work independently.

[0088] The working principle and beneficial effects of the above technical solution are: by connecting different authorized devices with the conference main control terminal, it is convenient to project the same content on different devices, realizing one-to-many fast screen projection; secondly, the data to be projected is encoded in real time and distributed to each authorized device through the video channel difference, ensuring that the data to be projected can be effectively projected in different application scenarios, thereby ensuring the efficiency of screen projection; finally, the operation instructions of different users on their respective terminals are monitored in real time, and the operation data of different users on their respective terminals are effectively synchronized and displayed on the terminals of other users through the signaling track channel, thereby improving the accuracy and adaptability of screen projection, avoiding screen projection operations on unnecessary terminals, saving resources, and at the same time, improving the efficiency and effect of screen projection.

[0089] Embodiment 2:

[0090] Based on Example 1, this embodiment provides a communication architecture system for online conferences based on screen projection, and the authorized devices include a main screen, split screens, and a tablet.

[0091] Embodiment 3:

[0092] Based on Example 1, this embodiment provides a communication architecture system for online conferences based on screen projection, and a device docking module, including:

[0093] A conference creation unit, configured to receive a conference creation instruction based on a conference master control terminal, trigger a conference creation mechanism to create a conference based on a reception result, and allocate a docking interface to each authorized device at the conference master control terminal based on the creation result;

[0094] A device docking unit, used to extract the device number of each authorized device, and extract the communication address of each authorized device based on the device number, and dock each authorized device with the conference created in the conference main control terminal based on the communication address and the docking interface;

[0095] The status updating unit is used to start the TV main screen based on the docking result and load the conference program based on the startup result.

[0096] In this embodiment, the conference creation mechanism is pre-set and is used to create a conference through a predetermined strategy or process after receiving a conference creation instruction.

[0097] In this embodiment, the docking interface refers to a communication interface allocated to different authorized devices at the conference main control terminal, so as to facilitate different authorized devices to participate in the conference.

[0098] In this embodiment, the device number is symbol information used to distinguish different authorized devices, for example, it can be an Arabic numeral number.

[0099] In this embodiment, the conference procedure is known in advance, that is, the process of starting the conference.

[0100] The working principle and beneficial effects of the above technical solution are: by creating a conference on the conference main control terminal and assigning a docking interface to the authorized device according to the creation result, it is convenient for different authorized devices to connect to the conference main control terminal. Secondly, the corresponding communication address is retrieved according to the device number of the authorized device, and finally the docking of the authorized device and the conference main control terminal is completed according to the communication address and the docking interface. Finally, after the docking is completed, the main screen of the TV is started, which facilitates subsequent screen projection operations.

[0101] Embodiment 4:

[0102] Based on Example 3, this embodiment provides a communication architecture system for online conferences based on screen projection, and a conference creation unit includes:

[0103] The data uploading subunit is used to start the preset document service based on the conference creation result, and receive the data information uploaded by the user based on the start result;

[0104] Format conversion unit, used for:

[0105] Extracting target component composition of the data information based on the received result, and splitting the data information into components based on the target component composition to obtain document content, video and audio in the data information;

[0106] Extract the document content from the data information, and convert the format of the document content based on the preset document service to obtain the target display page;

[0107] The target display page is associated with the video and audio based on the time series to complete the reception and preprocessing of the data to be projected.

[0108] In this embodiment, the data information uploaded by the user includes various types of files, such as docx, ppt, pdf, html, markdown, pictures and other formats, and may also be videos and audios.

[0109] In this embodiment, the preset document service is set in advance and is used to receive and pre-process the data that the user needs to project, thereby facilitating the corresponding projection operation.

[0110] In this embodiment, the target component composition refers to the composition of the data information, that is, all types of data included in the data information.

[0111] In this embodiment, the target display page refers to a screen that can be effectively displayed on the main screen after the format of the document content is converted by the preset document service.

[0112] In this embodiment, associating the target display page with the video and the audio based on the time sequence refers to determining the correspondence between the target display page and the video and the audio in the same time space according to the time sequence.

[0113] The working principle and beneficial effects of the above technical solution are: the data information uploaded by the received user is split into components through the preset document service, and the components obtained after the split are effectively processed to ensure that the final data information can be effectively displayed on each authorized device.

[0114] Embodiment 5:

[0115] Based on Example 1, this embodiment provides a communication architecture system for online conferences based on screen projection, and a device docking module, including:

[0116] A result acquisition unit, used for acquiring the data to be projected, and loading the data to be projected based on the conference program;

[0117] Display unit for:

[0118] Extracting a list of contents to be displayed of the screen data to be projected based on the loading result, and determining to extract basic display attributes of each screen data to be projected based on the list of contents to be displayed;

[0119] The display order and expected display duration of the data to be projected are determined based on the basic display attributes, and the data to be projected are displayed in sequence according to the display order and expected display duration based on the conference program.

[0120] In this embodiment, the conference program is set in advance and is used to process the data to be projected, in order to ensure that the data to be projected is displayed on the main screen and each participating terminal.

[0121] In this embodiment, the list of contents to be displayed refers to all the contents that need to be displayed in the determined screen projection data, and is a table for recording the contents that need to be displayed.

[0122] In this embodiment, the basic display attributes refer to the importance of each piece of data to be projected and the duration required for display.

[0123] In this embodiment, the expected display time refers to the length of time that the projected data needs to be displayed.

[0124] The working principle and beneficial effects of the above technical scheme are: loading the screen data to be projected through the conference program, and realizing accurate and effective determination of the list of contents to be displayed of the screen data to be projected according to the loading results, so as to facilitate orderly display of the screen data according to the list of contents to be displayed; secondly, parsing the basic display attributes of the screen data to be projected, and realizing accurate and effective determination of the display order and expected display time of the screen data to be projected; finally, displaying the screen data to be projected in sequence according to the determined display order and expected display time, providing reliable guarantee for the effective delivery of the screen data to be projected.

[0125] Embodiment 6:

[0126] Based on Example 1, this embodiment provides a communication architecture system for online conferences based on screen projection, and the screen projection module includes:

[0127] A monitoring unit, used to monitor the display results in real time, and obtain the playback timestamp of each screen projection data based on the real-time monitoring results;

[0128] Coding unit for:

[0129] Serialize the data to be projected based on the playback timestamp to obtain the projection screen corresponding to each playback timestamp, and determine the projection scene and basic projection parameters of the projection screen based on the projection requirements;

[0130] Preprocess the projection screen based on the basic projection parameters, and determine the video encoding format of the projection screen based on the preprocessing result according to the projection scene;

[0131] Determine the encoding parameters of the projection screen based on the projection requirements, and encapsulate the video encoding format and encoding parameters to obtain a video encoding mechanism;

[0132] Based on the video encoding mechanism, each projection screen is encoded in turn according to the playback timestamp, and the video stream data is time-stamped based on the playback timestamp to obtain the video stream data;

[0133] The data uploading unit is used to load the video stream data into the upload queue in the video channel, and upload the video stream data to the video channel after the loading is completed.

[0134] In this embodiment, the playback timestamp refers to the specific playback time information corresponding to each screen projection data.

[0135] In this embodiment, serialization processing refers to splitting each screen projection data into specific data corresponding to each unit time.

[0136] In this embodiment, the screen projection requirements are known in advance, and are used to characterize the object to which the screen projection image needs to be projected and the standards that need to be followed when projecting the screen.

[0137] In this embodiment, the screen projection scenario refers to the authorized device that needs to project the screen, including tablets, mobile phones, and split-screen TVs, etc. Different screen projection scenarios correspond to different basic screen projection parameters.

[0138] In this embodiment, the basic screen projection parameters refer to the standards that need to be followed when projecting the screen, including format requirements, etc.

[0139] In this embodiment, preprocessing refers to adjusting the format and image color of the projected image.

[0140] In this embodiment, the encoding parameter refers to the specific encoding data corresponding to converting the projection image into a video stream.

[0141] In this embodiment, the video encoding mechanism refers to a rule or strategy that is obtained by encapsulating the video encoding format and encoding parameters and can automatically encode the data to be projected.

[0142] In this embodiment, time marking refers to marking the video stream data with the corresponding playback time through the playback timestamp, so as to obtain the video stream data. The purpose is to perform corresponding orderly screen projection operations on the data to be projected on each authorized device according to the time marking result.

[0143] The working principle and beneficial effects of the above technical solution are: by performing real-time detection on the display results, the playback timestamp of each data to be projected can be accurately and effectively determined; secondly, each data to be projected is serialized according to the playback timestamp, so as to effectively determine the projection screen corresponding to each playback timestamp; at the same time, the projection scene and the corresponding basic projection parameters of each projection screen are determined according to the projection requirements, so as to effectively pre-process each projection screen according to the projection scene and the corresponding basic projection parameters, and effectively determine the video encoding mechanism; finally, each projection screen is encoded according to the obtained video encoding mechanism, so as to effectively obtain the video stream data, which greatly facilitates the projection operation; the obtained video stream data is loaded into the upload queue in the video channel, and finally the video stream data is effectively projected on each authorized device through the video channel, thereby ensuring the reliability and efficiency of the projection.

[0144] Embodiment 7:

[0145] Based on Example 1, this embodiment provides a communication architecture system for online conferences based on screen projection, and the screen projection module includes:

[0146] A demand parsing unit is used to obtain screen projection requirements based on the conference main control terminal, and parse the screen projection requirements to obtain the geographical location of each authorized device, and determine the network area distribution status of each authorized device based on the geographical location, wherein the network area distribution status includes the same local area network and cross-network;

[0147] Differential distribution unit for:

[0148] When all authorized devices are in the same LAN:

[0149] Obtain the communication address of each authorized device and construct a multicast address based on the communication address;

[0150] Encapsulate the video stream to obtain the data packet to be distributed, and distribute the data packet to be distributed to the participating terminals in each authorized device according to the multicast address based on the multicast network protocol;

[0151] When the authorized devices are across networks:

[0152] The video distribution server is configured with a path based on the communication address of each authorized device. At the same time, the real-time transfer byte volume of the video stream is determined based on the screen projection requirements, and the cache space of the video distribution server is configured based on the real-time transfer byte volume;

[0153] Obtain device attributes and network attributes of each authorized device, and determine the distribution priority for each authorized device based on the device attributes and network attributes;

[0154] Encapsulate the video stream to obtain a data packet to be distributed, and upload the data packet to be distributed to the video distribution server based on the cache space configuration result;

[0155] Based on the upload result, the video distribution server is controlled to distribute the data packets to be distributed to the participating terminals in each authorized device according to the path configuration result and the distribution priority of each authorized device.

[0156] In this embodiment, if there is a need for recording, a stream recording server is included, and the stream recording server is connected to the video distribution server to pull the video stream for recording from the video distribution server. The video distribution server can also directly act as a stream recording server for video recording.

[0157] In this embodiment, the network area distribution status refers to determining the network status of each authorized device through geographical location, in order to determine whether each authorized device is in the same network, so as to facilitate the screen projection operation using the corresponding screen projection method.

[0158] In this embodiment, the multicast address refers to a set of communication addresses of all devices obtained by summarizing the communication addresses of the authorized devices when the authorized devices are in the same local area network.

[0159] In this embodiment, the data packet to be distributed refers to the data packet that can be used for screen projection after encapsulating the video stream.

[0160] In this embodiment, the multicast network protocol refers to the data communication standards and rules that need to be followed when screen projection is performed using multicast.

[0161] In this embodiment, the video distribution server is set in advance and is used as a server to distribute the screen projection data when cross-network screen projection is adopted.

[0162] In this embodiment, path configuration refers to configuring the data channel to be distributed by the video distribution service according to the communication address of each authorized device, so as to ensure that the video distribution server effectively distributes the data to be projected to each authorized device.

[0163] In this embodiment, the real-time transfer byte amount of the video stream refers to the amount of data that needs to be buffered in the video distribution server during the screen projection process.

[0164] In this embodiment, cache space configuration refers to dividing storage space of corresponding size in the video distribution server according to the amount of real-time transfer bytes, which is used to cache the real-time transfer bytes when projecting the screen.

[0165] In this embodiment, the device attribute refers to the device type of each authorized device.

[0166] In this embodiment, the network attributes refer to the network type corresponding to each authorized device and the importance of its role in the meeting.

[0167] The working principle and beneficial effects of the above technical solution are: by analyzing the screen projection needs, the geographical location of each authorized device is determined, thereby realizing the determination of the network area distribution status of each authorized device according to the geographical location; secondly, the screen projection method for each authorized device is determined according to the network area distribution status, and the screen projection operation is limited to the same local area network and across networks respectively, thereby improving the reliability and efficiency of screen projection data in different situations, avoiding screen projection operations on unnecessary terminals, and saving resources.

[0168] Embodiment 8:

[0169] Based on Example 1, this embodiment provides a communication architecture system for online conferences based on screen projection, and a display configuration module, including:

[0170] A content display unit, used to obtain the content window size of each participating terminal for video display, and scale the video stream in proportion based on the content window size and the coordinate conversion mechanism, and display the video stream based on the proportional scaling result;

[0171] Monitoring unit for:

[0172] Based on the displayed results, an active monitoring mechanism is started, and based on the start-up results, the operation data of each user on the participating terminal is monitored in real time, wherein the operation data includes text input data and trajectory input data;

[0173] Recognize the text input data and the trajectory input data based on the preset service mechanism, and obtain the path and position data of the text input data and the trajectory input data on each participating terminal based on the recognition result;

[0174] Based on the content window size control coordinate conversion mechanism of each participating terminal, the path and position data on each participating terminal are converted to obtain the operation instructions of each user on each participating terminal, wherein the operation instructions include text instructions and trajectory instructions.

[0175] In this embodiment, virtual instructions can also be defined. For example, a plus button can be set in the operation menu area on the tablet (participating terminal). When the user clicks the button on the tablet, a [Zoom in] signal can be constructed. When the main screen receives the signal, the browser's zoom interface can be called.

[0176] In this embodiment, the trajectory input data includes click, slide, multi-touch, etc.

[0177] In this embodiment, the preset service mechanism includes a text recognition service and a geometry recognition service.

[0178] In this embodiment, the content window size refers to the window size used by each participating terminal for video display.

[0179] In this embodiment, the coordinate conversion mechanism is set in advance and is used to scale the screen ratio of the data to be projected according to the size of the content window.

[0180] In this embodiment, controlling the coordinate conversion mechanism based on the content window size of each participating terminal to perform coordinate conversion on the path and position data on each participating terminal means controlling the coordinate conversion mechanism to generate corresponding instructions based on the path and position data operated by the user on his own device, thereby facilitating the return of the instructions to the conference main control terminal through the instruction channel, thereby realizing the synchronous display of the user operation behavior on each authorized device.

[0181] The working principle and beneficial effects of the above technical solution are: by determining the content window size of each participating terminal used for video display, the coordinate conversion mechanism is controlled according to the size of the content window to proportionally scale the video stream, thereby facilitating the effective display of the video stream on each authorized device; secondly, after successful display, the operation data of each user on the participating terminal is monitored in real time, and the monitored operation data is analyzed to effectively determine the path and position data of the operation data; finally, the path and position data on each participating terminal are coordinate converted through the coordinate conversion mechanism to effectively determine the operation instructions of each user on each participating terminal, thereby facilitating the transmission of the operation instructions and achieving the effective display of the operations of different users on each authorized device.

[0182] Embodiment 9:

[0183] Based on Example 1, this embodiment provides a communication architecture system for online conferences based on screen projection, and a response module, including:

[0184] Instruction processing unit, used to:

[0185] Obtain the obtained operation instructions, and upload the operation instructions to the channel trajectory channel;

[0186] Sending the operation instruction to each authorized device based on the uploaded result, and responding to the text instruction in the operation instruction based on the main screen of the authorized device;

[0187] Based on the response result, the text instruction is converted into a standard execution event, and the standard execution event is executed. At the same time, the display content of each authorized device is synchronously updated based on the execution result;

[0188] At the same time, each authorized device receives the trajectory instruction in the operation instruction, and converts the format of the trajectory instruction based on the receiving result to obtain the operation trajectory;

[0189] The operation track is displayed on each authorized device.

[0190] In this embodiment, the trajectory is received by all participating terminals and displayed, and operation data, such as clicks, slides, etc., are received by all devices, but only the main screen actually responds.

[0191] In this embodiment, the signaling track channel is a channel dedicated to transmitting instructions.

[0192] In this embodiment, responding to text instructions in operation instructions based on the main screen in the authorized device means that only the main screen will respond to the text instructions, and after the response, the screens on other authorized devices will be synchronously updated, and each authorized device can directly receive and respond to the trajectory instructions.

[0193] In this embodiment, the text instruction refers to an instruction related to a text category in the operation instruction.

[0194] In this embodiment, the standard execution event refers to parsing the text instruction and converting the text instruction into a corresponding execution operation.

[0195] In this embodiment, format conversion of the trajectory instruction based on the reception result means that each authorized device can receive and respond to the trajectory instruction of other devices. The purpose of format conversion is to ensure that the trajectory operation on other devices can be effectively displayed on its own device.

[0196] The working principle and beneficial effects of the above technical solution are: by adopting the channel track channel to transmit the operation instructions to each authorized device, the display content on each authorized device is updated synchronously, ensuring the reliability, accuracy and adaptability of the screen projection, and improving the efficiency and effect of the screen projection.

[0197] Embodiment 10:

[0198] This embodiment provides a communication architecture method for an online conference based on screen projection, such as Figure 3 As shown, including:

[0199] Step 1: Based on the conference creation result, each authorized device is connected to the conference main control terminal, and based on the connection result, the main screen in the authorized device is controlled to display the screen data to be projected;

[0200] Step 2: Based on the display results, the screen data to be projected is encoded into a video stream in real time and uploaded to the video channel. Based on the uploaded results, the video stream differences are distributed to the participating terminals in each authorized device according to the projection requirements;

[0201] Step 3: Based on the distribution result, the video stream is converted and displayed in a proportional content window according to the coordinate conversion mechanism, and the operation instructions of the participating terminals are received in real time based on the conversion display result;

[0202] Step 4: Send the operation instruction to each authorized device based on the signaling track channel, and synchronously update the display content of each authorized device.

[0203] The working principle and beneficial effects of the above technical solution are: by connecting different authorized devices with the conference main control terminal, it is convenient to project the same content on different devices, realizing one-to-many fast screen projection; secondly, the data to be projected is encoded in real time and distributed to each authorized device through the video channel difference, ensuring that the data to be projected can be effectively projected in different application scenarios, thereby ensuring the efficiency of screen projection; finally, the operation instructions of different users on their respective terminals are monitored in real time, and the operation data of different users on their respective terminals are effectively synchronized and displayed on the terminals of other users through the signaling track channel, thereby improving the accuracy and adaptability of screen projection, avoiding screen projection operations on unnecessary terminals, saving resources, and at the same time, improving the efficiency and effect of screen projection.

[0204] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A communication architecture system for online conferences based on screen projection, characterized in that: include: The device docking module is used to dock each authorized device with the conference main control terminal based on the conference creation result, and control the main screen in the authorized device to display the screen data to be projected based on the docking result; The screen projection module is used to encode the screen projection data into a video stream in real time based on the display result and upload it to the video channel, and distribute the video stream difference to the participating terminals in each authorized device according to the screen projection requirements based on the uploaded result; A display configuration module is used to convert and display the content window of the video stream in a proportional manner according to the coordinate conversion mechanism based on the distribution result, and receive operation instructions from the participating terminals in real time based on the conversion display result; The response module is used to send the operation instruction to each authorized device based on the signaling track channel, and synchronously update the display content of each authorized device.

2. According to claim 1, a communication architecture system for online conferences based on screen projection is characterized in that: Authorized devices include main screen, split screen and tablet.

3. According to claim 1, a communication architecture system for online conferences based on screen projection is characterized in that: Device docking module, including: A conference creation unit, configured to receive a conference creation instruction based on a conference master control terminal, trigger a conference creation mechanism to create a conference based on a reception result, and allocate a docking interface to each authorized device at the conference master control terminal based on the creation result; A device docking unit, used to extract the device number of each authorized device, and extract the communication address of each authorized device based on the device number, and dock each authorized device with the conference created in the conference main control terminal based on the communication address and the docking interface; The status updating unit is used to start the TV main screen based on the docking result and load the conference program based on the startup result.

4. According to claim 3, a communication architecture system for online conferences based on screen projection is characterized in that: Conference creation unit, including: The data uploading subunit is used to start the preset document service based on the conference creation result, and receive the data information uploaded by the user based on the start result; Format conversion unit, used for: Extracting target component composition of the data information based on the received result, and splitting the data information into components based on the target component composition to obtain document content, video and audio in the data information; Extract the document content from the data information, and convert the format of the document content based on the preset document service to obtain the target display page; The target display page is associated with the video and audio based on the time series to complete the reception and preprocessing of the data to be projected.

5. According to claim 1, a communication architecture system for online conferences based on screen projection is characterized in that: Device docking module, including: A result acquisition unit, used for acquiring the data to be projected, and loading the data to be projected based on the conference program; Display unit for: Extracting a list of contents to be displayed of the screen data to be projected based on the loading result, and determining to extract basic display attributes of each screen data to be projected based on the list of contents to be displayed; The display order and expected display duration of the data to be projected are determined based on the basic display attributes, and the data to be projected are displayed in sequence according to the display order and expected display duration based on the conference program.

6. According to claim 1, a communication architecture system for online conference based on screen projection is characterized in that: Screen projection module, including: A monitoring unit, used to monitor the display results in real time, and obtain the playback timestamp of each screen projection data based on the real-time monitoring results; Coding unit for: Serialize the data to be projected based on the playback timestamp to obtain the projection screen corresponding to each playback timestamp, and determine the projection scene and basic projection parameters of the projection screen based on the projection requirements; Preprocess the projection screen based on the basic projection parameters, and determine the video encoding format of the projection screen based on the preprocessing result according to the projection scene; Determine the encoding parameters of the projection screen based on the projection requirements, and encapsulate the video encoding format and encoding parameters to obtain a video encoding mechanism; Based on the video encoding mechanism, each projection screen is encoded in turn according to the playback timestamp, and the video stream data is time-stamped based on the playback timestamp to obtain the video stream data; The data uploading unit is used to load the video stream data into the upload queue in the video channel, and upload the video stream data to the video channel after the loading is completed.

7. According to claim 1, a communication architecture system for online conferences based on screen projection is characterized in that: Screen projection module, including: A demand parsing unit is used to obtain screen projection requirements based on the conference main control terminal, and parse the screen projection requirements to obtain the geographical location of each authorized device, and determine the network area distribution status of each authorized device based on the geographical location, wherein the network area distribution status includes the same local area network and cross-network; Differential distribution unit for: When all authorized devices are in the same LAN: Obtain the communication address of each authorized device and construct a multicast address based on the communication address; Encapsulate the video stream to obtain the data packet to be distributed, and distribute the data packet to be distributed to the participating terminals in each authorized device according to the multicast address based on the multicast network protocol; When the authorized devices are across networks: The video distribution server is configured with a path based on the communication address of each authorized device. At the same time, the real-time transfer byte volume of the video stream is determined based on the screen projection requirements, and the cache space of the video distribution server is configured based on the real-time transfer byte volume; Obtain device attributes and network attributes of each authorized device, and determine the distribution priority for each authorized device based on the device attributes and network attributes; Encapsulate the video stream to obtain a data packet to be distributed, and upload the data packet to be distributed to the video distribution server based on the cache space configuration result; Based on the upload result, the video distribution server is controlled to distribute the data packets to be distributed to the participating terminals in each authorized device according to the path configuration result and the distribution priority of each authorized device.

8. The communication architecture system for online conference based on screen projection according to claim 1, characterized in that: Display configuration module, including: A content display unit, used to obtain the content window size of each participating terminal for video display, and scale the video stream in proportion based on the content window size and the coordinate conversion mechanism, and display the video stream based on the proportional scaling result; Monitoring unit for: Based on the displayed results, an active monitoring mechanism is started, and based on the start-up results, the operation data of each user on the participating terminal is monitored in real time, wherein the operation data includes text input data and trajectory input data; Recognize the text input data and the trajectory input data based on the preset service mechanism, and obtain the path and position data of the text input data and the trajectory input data on each participating terminal based on the recognition result; Based on the content window size control coordinate conversion mechanism of each participating terminal, the path and position data on each participating terminal are converted to obtain the operation instructions of each user on each participating terminal, wherein the operation instructions include text instructions and trajectory instructions.

9. The communication architecture system for online conference based on screen projection according to claim 1, characterized in that: Response modules, including: Instruction processing unit, used to: Obtain the obtained operation instructions, and upload the operation instructions to the channel trajectory channel; Sending the operation instruction to each authorized device based on the uploaded result, and responding to the text instruction in the operation instruction based on the main screen of the authorized device; Convert the text instruction into a standard execution event based on the response result, execute the standard execution event, and synchronously update the display content of each authorized device based on the execution result; At the same time, each authorized device receives the trajectory instruction in the operation instruction, and converts the format of the trajectory instruction based on the receiving result to obtain the operation trajectory; The operation track is displayed on each authorized device.

10. A communication architecture method for online conference based on screen projection, characterized in that: include: Step 1: Based on the conference creation result, each authorized device is connected to the conference main control terminal, and based on the connection result, the main screen in the authorized device is controlled to display the screen data to be projected; Step 2: Based on the display results, the screen data to be projected is encoded into a video stream in real time and uploaded to the video channel. Based on the uploaded results, the video stream differences are distributed to the participating terminals in each authorized device according to the projection requirements; Step 3: Based on the distribution result, the video stream is converted and displayed in a proportional content window according to the coordinate conversion mechanism, and the operation instructions of the participating terminals are received in real time based on the conversion display result; Step 4: Send the operation instruction to each authorized device based on the signaling track channel, and synchronously update the display content of each authorized device.

Images