Communication architecture system and method for online meetings based on screen mirroring

Abstract

The present invention provides a communication architecture system and method for an online meeting based on screen mirroring, including: a device docking module, configured to dock each authorized device with a meeting master control terminal based on the meeting creation result, and control the main screen in the authorized device to display the data to be screen-mirrored based on the docking result; a screen mirroring module, configured to encode the data to be screen-mirrored into a video stream in real time based on the display result and upload it to a video channel, and distribute the video stream difference to the participating terminals in each authorized device according to the screen mirroring requirement based on the upload result; a display configuration module, configured to perform a proportional content window conversion display on the video stream based on the coordinate conversion mechanism according to the distribution result, and receive the operation instructions of the participating terminals in real time based on the conversion display result; a response module, configured to send the operation instructions to each authorized device through a signaling trace channel, and synchronously update the display content of each authorized device. The accuracy, efficiency, and effect of screen mirroring are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and particularly to a communication architecture system and method for an online meeting based on screen mirroring. Background Art

[0002] In the daily work of enterprises, meetings are common work scenarios, including enterprise meetings and educational meetings. Currently, meetings generally fall into two modes. One is an offline meeting. Generally, the meeting host opens the content to be displayed on a laptop or mobile phone and synchronously displays it on the large TV screen in the meeting room through HDMI or screen mirroring. The other is an online meeting, which is used for multiple people to have an online meeting in different locations, and screen mirroring is a necessary operation for the meeting.

[0003] However, when performing screen mirroring operations for current meetings, only the data to be screen mirrored can be uniformly delivered to all devices, and targeted screen mirroring operations cannot be performed according to the screen mirroring requirements, resulting in a waste of resources. At the same time, the current screen mirroring operations can only be performed for device screen mirroring within the same local area network. When there are branch meeting rooms, screen mirroring operations cannot be performed. Moreover, when screen mirroring, only the host is allowed to perform writing and drawing operations on the control terminal, and the participants cannot perform operations on their respective terminals, thus greatly reducing the screen mirroring effect.

[0004] Therefore, in order to overcome the above defects, the present invention provides a communication architecture system and method for an online meeting based on screen mirroring. Summary of the Invention

[0005] The present invention provides a communication architecture system and method for an online meeting based on screen mirroring, which is used to dock different authorized devices with the meeting master control terminal, facilitating the screen mirroring and use of the same content on different devices to achieve one-to-many fast screen mirroring. Secondly, the data to be screen mirrored is encoded in real time and then distributed to each authorized device through video channel differences, ensuring that the data to be screen mirrored can be effectively screen mirrored in different application scenarios and guaranteeing the screen mirroring efficiency. Finally, the operation instructions of different users on their respective terminals are monitored in real time, and the operation data of different users on their respective terminals is effectively synchronously displayed on the terminals of other users through the signaling trace channel, improving the accuracy and adaptability of screen mirroring and avoiding screen mirroring operations on unnecessary terminals, saving resources, and at the same time, improving the efficiency and effect of screen mirroring.

[0006] The present invention provides a communication architecture system for an online meeting based on screen mirroring, including:

[0007] A device docking module, which is used to dock each authorized device with the meeting master control terminal based on the meeting creation result, and control the main screen in the authorized device to display the data to be screen mirrored based on the docking result;

[0008] The screen mirroring module is used to encode the data to be screen-mirrored into a video stream in real time based on the display result, and then upload it to the video channel. According to the upload result and the screen mirroring requirements, it differentially distributes the video stream to the participating terminals in each authorized device.

[0009] The display configuration module is used to perform an aspect ratio content window conversion display on the video stream based on the distribution result according to the coordinate conversion mechanism, and receive the operation instructions of the participating terminals in real time based on the conversion display result.

[0010] The response module is used to send the operation instructions to each authorized device through the signaling trace channel, and synchronously update the display content of each authorized device.

[0011] Preferably, in a communication architecture system for online meetings based on screen mirroring, the authorized devices include a main screen, a sub-screen, and a tablet.

[0012] Preferably, in a communication architecture system for online meetings based on screen mirroring, the device docking module includes:

[0013] The meeting creation unit is used to receive a meeting creation instruction based on the meeting master terminal, trigger a meeting creation mechanism to create a meeting based on the reception result, and allocate docking interfaces for each authorized device on the meeting master terminal based on the creation result.

[0014] The device docking unit is used to extract the device numbers of each authorized device, extract the communication addresses of each authorized device based on the device numbers, and dock each authorized device with the meeting created in the meeting master terminal based on the communication addresses and docking interfaces.

[0015] The status update unit is used to start the TV main screen based on the docking result, and load the meeting program based on the start result.

[0016] Preferably, in a communication architecture system for online meetings based on screen mirroring, the meeting creation unit includes:

[0017] The data upload sub-unit is used to start a preset document service based on the meeting creation result, and receive the data information uploaded by the user based on the start result.

[0018] The format conversion unit is used to:

[0019] Extract the target component composition of the data information based on the reception result, and perform component splitting on the data information based on the target component composition to obtain the document content, video, and audio in the data information.

[0020] Extract the document content in the data information, and perform format conversion on the document content based on the preset document service to obtain the target display page.

[0021] Associate the target display page with the video and audio based on the time series, and complete the reception and preprocessing of the data to be cast.

[0022] Preferably, a communication architecture system for an online meeting based on screen mirroring, the device docking module includes:

[0023] A result acquisition unit for acquiring the data to be cast and loading the data to be cast based on the meeting program;

[0024] A display unit for:

[0025] Extract the list of content to be displayed of the data to be cast based on the loading result, and determine the basic display attributes of each data to be cast based on the list of content to be displayed;

[0026] Determine the display order and expected display duration of the data to be cast based on the basic display attributes, and display the data to be cast sequentially according to the display order and expected display duration based on the meeting program.

[0027] Preferably, a communication architecture system for an online meeting based on screen mirroring, the screen mirroring module includes:

[0028] A monitoring unit for monitoring the display result in real time and obtaining the playback timestamps of each data to be cast based on the real-time monitoring result;

[0029] An encoding unit for:

[0030] Perform serialization processing on each data to be cast based on the playback timestamp to obtain a screen mirroring image corresponding to each playback timestamp, and determine the screen mirroring scenario and basic screen mirroring parameters of the screen mirroring image based on the screen mirroring requirements;

[0031] Preprocess the screen mirroring image based on the basic screen mirroring parameters, and determine the video encoding format of the screen mirroring image according to the screen mirroring scenario based on the preprocessing result;

[0032] Determine the encoding parameters for the screen mirroring image based on the screen mirroring requirements, and encapsulate the video encoding format and encoding parameters to obtain a video encoding mechanism;

[0033] Encode each screen mirroring image sequentially based on the video encoding mechanism according to the playback timestamp, and perform time marking on the video stream data based on the playback timestamp to obtain video stream data;

[0034] A data upload unit for loading the video stream data into the upload queue in the video channel and uploading the video stream data to the video channel after the loading is completed.

[0035] Preferably, a communication architecture system for an online meeting based on screen mirroring, the screen mirroring module includes:

[0036] A requirement analysis unit, which is used to obtain screen mirroring requirements based on a conference master terminal, analyze the screen mirroring requirements to obtain the geographical locations of authorized devices, and determine the network area distribution status of each authorized device based on the geographical locations, where the network area distribution status includes the same local area network and cross-network;

[0037] A differential distribution unit, which is used for:

[0038] When all authorized devices are within the same local area network:

[0039] Obtain the communication addresses of all authorized devices, and construct a multicast address based on the communication addresses;

[0040] Encapsulate the video stream to obtain packets to be distributed, and distribute the packets to be distributed to the participating terminals in each authorized device based on the multicast network protocol according to the multicast address;

[0041] When all authorized devices are cross-network:

[0042] Configure the path of the video distribution server based on the communication addresses of all authorized devices. At the same time, determine the real-time transit byte volume of the video stream based on the screen mirroring requirements, and configure the cache space of the video distribution server based on the real-time transit byte volume;

[0043] Obtain the device attributes and network attributes of all authorized devices, and determine the distribution priority for each authorized device based on the device attributes and network attributes;

[0044] Encapsulate the video stream to obtain packets to be distributed, and upload the packets to be distributed to the video distribution server based on the cache space configuration result;

[0045] Control the video distribution server based on the upload result to distribute the packets to be distributed to the participating terminals in each authorized device according to the path configuration result and the distribution priority of each authorized device.

[0046] Preferably, a communication architecture system for an online conference based on screen mirroring, a display configuration module, includes:

[0047] A content display unit, which is used to obtain the content window size for video display of each participating terminal, perform equal-proportion size scaling on the video stream based on the content window size and the coordinate conversion mechanism, and display the video stream based on the equal-proportion size scaling result;

[0048] A monitoring unit, which is used for:

[0049] Enable an active monitoring mechanism based on the display result, and monitor the operation data of each user on the participating terminal in real time based on the enabling result, where the operation data includes text input data and trajectory input data;

[0050] Identify the text input data and trajectory input data based on a preset service mechanism, and obtain the paths and location data of the text input data and trajectory input data on each participating terminal based on the recognition results;

[0051] Perform coordinate conversion on the paths and location data on each participating terminal based on the content window size control coordinate conversion mechanism of each participating terminal to obtain the operation instructions of each user on each participating terminal, where the operation instructions include text instructions and trajectory instructions.

[0052] Preferably, a communication architecture system for an online meeting based on screen mirroring, the response module includes:

[0053] An instruction processing unit for:

[0054] Obtain the obtained operation instructions and upload the operation instructions to the channel trajectory channel;

[0055] Send the operation instructions to each authorized device based on the upload result, and respond to the text instructions in the operation instructions based on the main screen in the authorized device;

[0056] Convert the text instructions into standard execution events based on the response result and execute the standard execution events. At the same time, synchronously update the display content of each authorized device based on the execution result;

[0057] At the same time, receive the trajectory instructions in the operation instructions based on each authorized device, and perform format conversion on the trajectory instructions based on the reception result to obtain an operation trajectory;

[0058] Display the operation trajectory on each authorized device.

[0059] The present invention provides a communication architecture method for an online meeting based on screen mirroring, including:

[0060] Step 1: Dock each authorized device with the conference master terminal based on the conference creation result, and control the main screen in the authorized device to display the data to be screen-mirrored based on the docking result;

[0061] Step 2: Real-time encode the data to be screen-mirrored into a video stream based on the display result and upload it to the video channel, and distribute the video stream differences to the participating terminals in each authorized device according to the screen-mirroring requirements based on the upload result;

[0062] Step 3: Perform a proportional content window conversion display on the video stream based on the distribution result according to the coordinate conversion mechanism, and receive the operation instructions of the participating terminal in real time based on the conversion display result;

[0063] Step 4: Send the operation instructions to each authorized device based on the signaling trajectory channel and synchronously update the display content of each authorized device.

[0064] Compared with the prior art, the beneficial effects of the present invention are as follows:

[0065] By docking different authorized devices with the conference master terminal, it is convenient to project the same content on different devices for use, realizing one-to-many fast screen projection. Secondly, the data to be projected is encoded in real time and then distributed to each authorized device through video channel differences, ensuring that the data to be projected can be effectively projected in different application scenarios, guaranteeing the screen projection efficiency. Finally, the operation instructions of different users on their respective terminals are monitored in real time, and the operation data of different users on their respective terminals are effectively synchronously displayed on the terminals of other users through the signaling trace channel, improving the accuracy and adaptability of screen projection and avoiding screen projection operations on unnecessary terminals, saving resources. At the same time, the efficiency and effect of screen projection are improved.

[0066] Other features and advantages of the present invention will be described in the following specification, and, in part, will be obvious from the specification, or will be understood by implementing the present invention. The objectives and other advantages of the present invention can be achieved and obtained through the structures specifically pointed out in this application document.

[0067] The technical solutions of the present invention will be further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0068] The accompanying drawings are used to provide a further understanding of the present invention, and constitute a part of the specification. They are used together with the embodiments of the present invention to explain the present invention, and do not constitute a limitation to the present invention. In the accompanying drawings:

[0069] Figure 1 is a structural diagram of a communication architecture system for an online conference based on screen projection in an embodiment of the present invention;

[0070] Figure 2 is a schematic diagram of the connection and working principle of authorized devices in a communication architecture system for an online conference based on screen projection in an embodiment of the present invention;

[0071] Figure 3 is a flowchart of a communication architecture method for an online conference based on screen projection in an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0072] The following describes the preferred embodiments of the present invention with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are only for the purpose of illustrating and explaining the present invention, and are not used to limit the present invention.

[0073] Embodiment 1:

[0074] This embodiment provides a communication architecture system for an online conference based on screen projection, as Figure 1 shown, including:

[0075] The device docking module is used to dock each authorized device with the conference master terminal based on the conference creation result, and control the main screen in the authorized device to display the data to be projected based on the docking result;

[0076] The screen projection module is used to encode the data to be projected into a video stream in real time based on the display result and upload it to the video channel, and distribute the video stream difference to the participating terminals in each authorized device according to the screen projection requirements based on the upload result;

[0077] The display configuration module is used to perform a proportional content window conversion display on the video stream based on the coordinate conversion mechanism according to the distribution result, and receive the operation instructions of the participating terminals in real time based on the conversion display result;

[0078] The response module is used to send the operation instructions to each authorized device based on the signaling trace channel and synchronously update the display content of each authorized device.

[0079] In this embodiment, in addition to the video channel and the signaling trace channel, there is another channel: the audio channel. The audio channel borrows the telephone service (PBX service), which is based on an open-source implementation. Each device only integrates the corresponding client, including mobile phones and landline phones, and accesses and listens to the conference through the telephone conference service. The schematic diagram of the connection and working principle of the authorized device is as Figure 2 shown.

[0080] In this embodiment, the conference creation result refers to monitoring the conference creation requirements and creation status initiated by the user on the conference master terminal, that is, binding the authorized device to the conference master terminal after the conference is successfully created. Among them, each authorized device includes a main screen, a sub-screen, a tablet, a mobile phone, and a landline phone, etc.

[0081] In this embodiment, the data to be projected refers to the information that needs to be projected and displayed, including format files such as docx, ppt, pdf, html, markdown, pictures, as well as videos, audios, etc.

[0082] In this embodiment, encoding into a video stream in real time means converting the format of the data to be projected into an encoding form that is convenient for transmission in the video channel.

[0083] In this embodiment, the screen projection requirements are known in advance, including the network conditions of each authorized device, etc.

[0084] In this embodiment, distributing the video stream difference to the participating terminals in each authorized device means distributing it in different ways according to the network conditions of each authorized device, including multicast distribution and cross-network distribution.

[0085] In this embodiment, the coordinate conversion mechanism is pre-configured to perform coordinate conversion on the display content and the user's operation data. Moreover, when performing coordinate conversion, it is converted relative to the size of the display content, aiming to ensure that the user's operation data can be effectively displayed on different terminals.

[0086] In this embodiment, the operation instruction refers to the operation request of the user on the authorized device, including operation data such as text writing, clicking, swiping, and multi-touch.

[0087] In this embodiment, the signaling trace channel is used to transmit operation instructions, that is, to transmit operation instructions to each authorized device, and the video channel is used to transmit video data, and the two work independently.

[0088] The working principle and beneficial effects of the above technical solution are as follows: By docking different authorized devices with the conference master terminal, it is convenient to project the same content on different devices for use, realizing fast one-to-many projection. Secondly, the data to be projected is encoded in real time and then distributed to each authorized device through the video channel difference, ensuring that the data to be projected can be effectively projected in different application scenarios, guaranteeing the projection efficiency. Finally, the operation instructions of different users on their respective terminals are monitored in real time, and the operation data of different users on their respective terminals are effectively synchronized and displayed on the terminals of other users through the signaling trace channel, improving the accuracy and adaptability of the projection and avoiding projection operations on unnecessary terminals, saving resources. At the same time, the efficiency and effect of the projection are improved.

[0089] Embodiment 2:

[0090] Based on Embodiment 1, this embodiment provides a communication architecture system for an online conference based on projection, and the authorized devices include a main screen, a sub-screen, and a tablet.

[0091] Embodiment 3:

[0092] Based on Embodiment 1, this embodiment provides a communication architecture system for an online conference based on projection, and the device docking module includes:

[0093] A conference creation unit, configured to receive a conference creation instruction based on the conference master terminal, trigger a conference creation mechanism to create a conference based on the reception result, and allocate docking interfaces for each authorized device on the conference master terminal based on the creation result;

[0094] A device docking unit, configured to extract the device numbers of each authorized device, extract the communication addresses of each authorized device based on the device numbers, and dock each authorized device with the conference created in the conference master terminal based on the communication addresses and the docking interfaces;

[0095] A status update unit, configured to start the TV main screen based on the docking result and load the meeting program based on the start result.

[0096] In this embodiment, the meeting creation mechanism is pre-set and is used to create a meeting by means of established strategies or processes after receiving a meeting creation instruction.

[0097] In this embodiment, the docking interface refers to the communication interface allocated by the meeting master terminal to different authorized devices, so as to facilitate the participation of different authorized devices in the meeting.

[0098] In this embodiment, the device number is symbolic information used to distinguish different authorized devices, such as Arabic numeral numbers.

[0099] In this embodiment, the meeting program is known in advance, that is, the process of starting the meeting.

[0100] The working principle and beneficial effects of the above technical solution are as follows: a meeting is created on the meeting master terminal, and docking interfaces are allocated to authorized devices according to the creation result, so as to facilitate the connection between different authorized devices and the meeting master terminal. Secondly, the corresponding communication address is retrieved according to the device number of the authorized device, and finally, the docking of the authorized device and the meeting master terminal is completed according to the communication address and the docking interface. Finally, after the docking is completed, the TV main screen is started, so as to facilitate subsequent screen mirroring operations.

[0101] Embodiment 4:

[0102] On the basis of Embodiment 3, this embodiment provides a communication architecture system for an online meeting based on screen mirroring. The meeting creation unit includes:

[0103] A data upload sub-unit, configured to start a preset document service based on the meeting creation result and receive the data information uploaded by the user based on the start result;

[0104] A format conversion unit, configured to:

[0105] Extract the target component composition of the data information based on the reception result, and split the data information into components based on the target component composition to obtain the document content, video and audio in the data information;

[0106] Extract the document content in the data information, and perform format conversion on the document content based on the preset document service to obtain a target display page;

[0107] Associate the target display page with the video and audio based on the time series to complete the reception and preprocessing of the data to be screen mirrored.

[0108] In this embodiment, the data information uploaded by the user includes various types of files, such as docx, ppt, pdf, html, markdown, pictures, etc., and may also be videos and audios.

[0109] In this embodiment, the preset document service is set in advance and is used to receive and preprocess the data that the user needs to cast, so as to facilitate the corresponding casting operation.

[0110] In this embodiment, the target component composition refers to the composition of the data information, that is, all types of data included in the data information.

[0111] In this embodiment, the target display page refers to the picture that can be effectively displayed on the main screen after the format of the document content is converted by the preset document service.

[0112] In this embodiment, associating the target display page with videos and audios based on the time series means determining the corresponding relationship between the target display page and videos and audios in the same time and space according to the time sequence.

[0113] The working principle and beneficial effects of the above technical solution are: through the preset document service, the data information uploaded by the user is split into components, and the components obtained after splitting are effectively processed to ensure that the finally obtained data information can be effectively displayed on each authorized device.

[0114] Embodiment 5:

[0115] Based on Embodiment 1, this embodiment provides a communication architecture system for an online meeting based on screen mirroring. The device docking module includes:

[0116] A result acquisition unit, which is used to acquire the data to be cast and load the data to be cast based on the meeting program;

[0117] A display unit, which is used for:

[0118] Extracting the list of content to be displayed of the data to be cast based on the loading result, and determining the basic display attributes of each data to be cast based on the list of content to be displayed;

[0119] Determining the display order and expected display duration of the data to be cast based on the basic display attributes, and sequentially displaying the data to be cast based on the display order and expected display duration according to the meeting program.

[0120] In this embodiment, the meeting program is set in advance and is used to process the data to be cast, aiming to ensure that the data to be cast is displayed on the main screen and each participating terminal.

[0121] In this embodiment, the list of content to be displayed refers to all the content that needs to be displayed in the determined data to be screen-cast, and is a table for recording the content to be displayed.

[0122] In this embodiment, the basic display attributes refer to the importance level corresponding to each data to be screen-cast and the display duration required.

[0123] In this embodiment, the expected display duration refers to the length of time for which the data to be screen-cast needs to be displayed.

[0124] The working principle and beneficial effects of the above technical solution are as follows: The meeting program is used to load the data to be screen-cast, so as to accurately and effectively determine the list of content to be displayed of the data to be screen-cast according to the loading result, thereby facilitating the orderly display of the data to be screen-cast according to the list of content to be displayed. Secondly, the basic display attributes of the data to be screen-cast are analyzed to accurately and effectively determine the display order and expected display duration of the data to be screen-cast. Finally, the data to be screen-cast is displayed in sequence according to the determined display order and expected display duration, providing a reliable guarantee for the effective projection of the data to be screen-cast.

[0125] Embodiment 6:

[0126] Based on Embodiment 1, this embodiment provides a communication architecture system for an online meeting based on screen-casting. The screen-casting module includes:

[0127] A monitoring unit, configured to monitor the display result in real time and obtain the playback timestamp of each data to be screen-cast based on the real-time monitoring result;

[0128] An encoding unit, configured to:

[0129] Perform serialization processing on each data to be screen-cast based on the playback timestamp to obtain a screen-casting image corresponding to each playback timestamp, and determine the screen-casting scenario and basic screen-casting parameters of the screen-casting image based on the screen-casting requirements;

[0130] Preprocess the screen-casting image based on the basic screen-casting parameters, and determine the video encoding format of the screen-casting image according to the screen-casting scenario based on the preprocessing result;

[0131] Determine the encoding parameters for the screen-casting image based on the screen-casting requirements, and encapsulate the video encoding format and encoding parameters to obtain a video encoding mechanism;

[0132] Encode each screen-casting image in sequence based on the video encoding mechanism according to the playback timestamp, and perform time marking on the video stream data based on the playback timestamp to obtain video stream data;

[0133] A data upload unit, configured to load the video stream data into the upload queue in the video channel and upload the video stream data to the video channel after the loading is completed.

[0134] In this embodiment, the playback timestamp refers to the specific playback time information corresponding to each piece of data to be screen-cast.

[0135] In this embodiment, the serialization process refers to splitting each piece of data to be screen-cast into specific data corresponding to each unit of time.

[0136] In this embodiment, the screen-casting requirements are known in advance and are used to characterize the objects that need to be screen-cast for the screen-cast image and the criteria to be followed during screen-casting.

[0137] In this embodiment, the screen-casting scenario refers to the authorized devices to which the screen-cast image needs to be projected, including tablets, mobile phones, and split-screen TVs, etc. Different screen-casting scenarios correspond to different basic screen-casting parameters.

[0138] In this embodiment, the basic screen-casting parameters refer to the criteria that need to be followed when projecting the screen-cast image, including format requirements, etc.

[0139] In this embodiment, the preprocessing refers to adjusting the format of the screen-cast image, the image color, etc.

[0140] In this embodiment, the encoding parameters refer to the specific encoding data corresponding to converting the screen-cast image into a video stream.

[0141] In this embodiment, the video encoding mechanism refers to the rules or strategies obtained by encapsulating the video encoding format and encoding parameters and capable of automatically encoding the data to be screen-cast.

[0142] In this embodiment, the time marking refers to performing corresponding playback time marking on the video stream data through the playback timestamp, so as to obtain the video stream data. The purpose is to perform corresponding ordered screen-casting operations on the data to be screen-cast on each authorized device according to the time marking result.

[0143] The working principle and beneficial effects of the above technical solution are as follows: By performing real-time detection on the display result, the playback timestamps of each data to be screen-cast are accurately and effectively determined. Secondly, serializing each data to be screen-cast according to the playback timestamps to effectively determine the screen-cast images corresponding to each playback timestamp. At the same time, determining the screen-cast scenarios and corresponding basic screen-cast parameters of each screen-cast image according to the screen-cast requirements, and preprocessing each screen-cast image effectively according to the screen-cast scenarios and corresponding basic screen-cast parameters, and effectively determining the video encoding mechanism. Finally, encoding each screen-cast image according to the obtained video encoding mechanism to effectively obtain the video stream data, which provides great convenience for the screen-cast operation. Loading the obtained video stream data into the upload queue in the video channel, and finally realizing the effective screen-casting of the video stream data on each authorized device through the video channel, ensuring the reliability and efficiency of the screen-casting.

[0144] Embodiment 7:

[0145] Based on Embodiment 1, this embodiment provides a communication architecture system for an online meeting based on screen-casting. The screen-casting module includes:

[0146] A requirement analysis unit, which is used to obtain the screen-casting requirements based on the meeting master control terminal, analyze the screen-casting requirements to obtain the geographical locations of each authorized device, and determine the network area distribution status of each authorized device based on the geographical locations, where the network area distribution status includes the same local area network and cross-network;

[0147] A difference distribution unit, which is used for:

[0148] When each authorized device is within the same local area network:

[0149] Obtaining the communication addresses of each authorized device and constructing a multicast address based on the communication addresses;

[0150] Encapsulating the video stream to obtain the data packets to be distributed, and distributing the data packets to be distributed to the participating terminals in each authorized device based on the multicast address according to the multicast network protocol;

[0151] When each authorized device is cross-network:

[0152] Configuring the path of the video distribution server based on the communication addresses of each authorized device. At the same time, determining the real-time transfer byte amount of the video stream based on the screen-casting requirements, and configuring the cache space of the video distribution server based on the real-time transfer byte amount;

[0153] Obtaining the device attributes and network attributes of each authorized device, and determining the distribution priority for each authorized device based on the device attributes and network attributes;

[0154] Encapsulate the video stream to obtain the data packets to be distributed, and upload the data packets to be distributed to the video distribution server based on the cache space configuration result;

[0155] Based on the upload result, control the video distribution server to distribute the data packets to be distributed to the participating terminals in each authorized device according to the path configuration result and the distribution priority of each authorized device.

[0156] In this embodiment, if there is a recording requirement, it includes a video recording server, and the video recording server is docked with the video distribution server to pull the video stream from the video distribution server for recording. It is also possible for the video distribution server to directly act as the video recording server for video recording.

[0157] In this embodiment, the network area distribution status refers to determining the network conditions of each authorized device through the geographical location, aiming to determine whether each authorized device is in the same network, so as to facilitate the use of corresponding screen mirroring methods for screen mirroring operations.

[0158] In this embodiment, the multicast address refers to the set of communication addresses of all devices obtained by summarizing the communication addresses of each authorized device when each authorized device is in the same local area network.

[0159] In this embodiment, the data packets to be distributed refer to the data packets that can be screen mirrored after encapsulating the video stream.

[0160] In this embodiment, the multicast network protocol refers to the data communication standards and rules that need to be followed when using the multicast method for screen mirroring.

[0161] In this embodiment, the video distribution server is pre-set and is used to distribute the data to be screen mirrored when using cross-network screen mirroring.

[0162] In this embodiment, path configuration refers to configuring the data channels to be distributed by the video distribution service according to the communication addresses of each authorized device, so as to ensure that the video distribution server effectively distributes the data to be screen mirrored to each authorized device.

[0163] In this embodiment, the real-time transfer byte volume of the video stream refers to the amount of data that needs to be buffered in the video distribution server during the screen mirroring process.

[0164] In this embodiment, cache space configuration refers to dividing a corresponding storage space of a certain size in the video distribution server according to the real-time transfer byte volume for caching the real-time transfer bytes during screen mirroring.

[0165] In this embodiment, the device attribute refers to the device type of each authorized device.

[0166] In this embodiment, the network attributes refer to the network types corresponding to each authorized device and the importance of the role in the meeting, etc.

[0167] The working principle and beneficial effects of the above technical solution are as follows: By analyzing the screen mirroring requirements, the geographical locations of each authorized device are determined, so as to determine the network area distribution status of each authorized device according to the geographical location. Secondly, according to the network area distribution status, the screen mirroring methods for each authorized device are determined, and the screen mirroring operations are limited for the two cases of the same local area network and cross-network respectively, which improves the reliability and efficiency of screen mirroring the data to be screen-mirrored in different situations, avoids screen mirroring operations on unnecessary terminals, and saves resources.

[0168] Embodiment 8:

[0169] Based on Embodiment 1, this embodiment provides a communication architecture system for an online meeting based on screen mirroring, and a display configuration module, including:

[0170] A content display unit for obtaining the content window size for video display of each participating terminal, scaling the video stream proportionally based on the content window size and the coordinate conversion mechanism, and displaying the video stream based on the proportional scaling result;

[0171] A monitoring unit for:

[0172] Enabling an active monitoring mechanism based on the display result, and real-time monitoring the operation data of each user on the participating terminal based on the enabling result, where the operation data includes text input data and trajectory input data;

[0173] Identifying the text input data and the trajectory input data based on a preset service mechanism, and obtaining the path and position data of the text input data and the trajectory input data on each participating terminal based on the identification result;

[0174] Controlling the coordinate conversion mechanism based on the content window size of each participating terminal to perform coordinate conversion on the path and position data on each participating terminal, and obtaining the operation instructions of each user on each participating terminal, where the operation instructions include text instructions and trajectory instructions.

[0175] In this embodiment, virtual instructions can also be defined. For example, in the operation menu area of a tablet (participating terminal), a plus button can be set. When the user clicks this button on the tablet, a [Zoom In] signal can be constructed. When the main screen receives this signal, the zoom interface of the browser can be called.

[0176] In this embodiment, the trajectory input data includes clicks, swipes, multi-touch, etc.

[0177] In this embodiment, the preset service mechanism includes a text recognition service and a geometric recognition service.

[0178] In this embodiment, the content window size refers to the window size of each participating terminal for video display.

[0179] In this embodiment, the coordinate conversion mechanism is set in advance and is used to scale the screen ratio of the data to be cast according to the content window size.

[0180] In this embodiment, controlling the coordinate conversion mechanism to perform coordinate conversion on the path and position data on each participating terminal based on the content window size of each participating terminal means controlling the coordinate conversion mechanism to generate corresponding instructions according to the path and position data of the user's operation on their own device, so as to facilitate returning the instructions to the conference master terminal through the instruction channel, thereby realizing the synchronous display of the user's operation behavior on each authorized device.

[0181] The working principle and beneficial effects of the above technical solution are as follows: By determining the content window size of each participating terminal for video display, it is possible to control the coordinate conversion mechanism to perform equal-proportion scaling on the video stream according to the size of the content window, so as to facilitate the effective display of the video stream on each authorized device. Secondly, after successful display, the operation data of each user on the participating terminal is monitored in real time, and the monitored operation data is analyzed to effectively determine the path and position data of the operation data. Finally, the coordinate conversion mechanism is used to perform coordinate conversion on the path and position data on each participating terminal, so as to effectively determine the operation instructions of each user on each participating terminal, thereby facilitating the transmission of the operation instructions and realizing the effective display of the operations of different users on each authorized device.

[0182] Embodiment 9:

[0183] Based on Embodiment 1, this embodiment provides a communication architecture system for an online conference based on screen mirroring, and the response module includes:

[0184] An instruction processing unit, which is used for:

[0185] Obtaining the obtained operation instructions and uploading the operation instructions to the channel trajectory channel;

[0186] Sending the operation instructions to each authorized device based on the upload result, and responding to the text instructions in the operation instructions based on the main screen in the authorized device;

[0187] Converting the text instructions into standard execution events based on the response result, and executing the standard execution events. At the same time, synchronously updating the display content of each authorized device based on the execution result;

[0188] Meanwhile, each authorized device receives the trajectory instruction in the operation instruction, and based on the reception result, formats the trajectory instruction to obtain an operation trajectory;

[0189] The operation trajectory is displayed on each authorized device.

[0190] In this embodiment, the trajectory is received by all participating terminals and the trajectory is displayed. Operation data, such as click and slide operations, are received by all devices, but only the main screen actually responds.

[0191] In this embodiment, the signaling trajectory channel is a dedicated channel for transmitting instructions.

[0192] In this embodiment, the main screen in the authorized device responding to the text instruction in the operation instruction means that only the main screen responds to the text instruction, and after the response, the screens on other authorized devices are synchronously updated. Each authorized device can directly receive and respond to the trajectory instruction.

[0193] In this embodiment, the text instruction refers to the instruction of the text category in the operation instruction.

[0194] In this embodiment, the standard execution event refers to parsing the text instruction and converting the text instruction into a corresponding execution operation.

[0195] In this embodiment, formatting the trajectory instruction based on the reception result means that each authorized device can receive and respond to the trajectory instructions of other devices. The purpose of formatting conversion is to ensure that the trajectory operations on other devices can be effectively displayed on its own device.

[0196] The working principle and beneficial effects of the above technical solution are: by using the channel trajectory channel to transmit the operation instruction to each authorized device, the display content on each authorized device is synchronously updated, ensuring the reliability, accuracy, and adaptability of screen mirroring, and improving the efficiency and effect of screen mirroring.

[0197] Embodiment 10:

[0198] This embodiment provides a communication architecture method for an online meeting based on screen mirroring, as Figure 3 shown, including:

[0199] Step 1: Based on the meeting creation result, dock each authorized device with the meeting master terminal, and based on the docking result, control the main screen in the authorized device to display the data to be screen-mirrored;

[0200] Step 2: Based on the display result, encode the data to be screen-mirrored into a video stream in real time and upload it to the video channel, and based on the upload result, distribute the video stream difference to the participating terminals in each authorized device according to the screen mirroring requirements;

[0201] Step 3: Based on the distribution result, perform an equal-ratio content window conversion display on the video stream according to the coordinate conversion mechanism, and receive the operation instructions of the participating terminals in real time based on the conversion display result;

[0202] Step 4: Send the operation instructions to each authorized device based on the signaling trace channel, and synchronously update the display content of each authorized device.

[0203] The working principle and beneficial effects of the above technical solution are as follows: By docking different authorized devices with the conference master terminal, it is convenient to project the same content on different devices for use, realizing one-to-many fast projection. Secondly, the data to be projected is encoded in real time and then distributed to each authorized device through the video channel difference, ensuring that the data to be projected can be effectively projected in different application scenarios, guaranteeing the projection efficiency. Finally, the operation instructions of different users on their respective terminals are monitored in real time, and the operation data of different users on their respective terminals are effectively synchronously displayed on the terminals of other users through the signaling trace channel, improving the accuracy and adaptability of the projection and avoiding the projection operation on unnecessary terminals, saving resources. At the same time, the efficiency and effect of the projection are improved.

[0204] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention is also intended to include these changes and modifications.

Claims

1. A communication architecture system for an online meeting based on screen mirroring, characterized in that, Including: The device docking module is used to dock each authorized device with the conference master terminal based on the conference creation result, and control the main screen in the authorized device to display the data to be cast based on the docking result; The screen mirroring module is used to encode the data to be cast into a video stream in real time based on the display result and upload it to the video channel, and distribute the video stream difference to the participating terminals in each authorized device according to the screen mirroring requirement based on the upload result; The display configuration module is used to perform a proportional content window conversion display on the video stream based on the distribution result according to the coordinate conversion mechanism, and receive the operation instructions of the participating terminals in real time based on the conversion display result; The response module is used to send the operation instructions to each authorized device based on the signaling trace channel and synchronously update the display content of each authorized device; Among them, the screen mirroring module includes: The requirement analysis unit is used to obtain the screen mirroring requirement based on the conference master terminal, analyze the screen mirroring requirement to obtain the geographical locations of each authorized device, and determine the network area distribution status of each authorized device based on the geographical location, where the network area distribution status includes the same local area network and cross-network; The difference distribution unit is used for: When each authorized device is within the same local area network: Obtain the communication addresses of each authorized device and construct a multicast address based on the communication addresses; Encapsulate the video stream to obtain the data packet to be distributed, and distribute the data packet to be distributed to the participating terminals in each authorized device based on the multicast network protocol according to the multicast address; When each authorized device is cross-network: Configure the path of the video distribution server based on the communication addresses of each authorized device. At the same time, determine the real-time transfer byte amount of the video stream based on the screen mirroring requirement, and configure the cache space of the video distribution server based on the real-time transfer byte amount; Obtain the device attributes and network attributes of each authorized device, and determine the distribution priority for each authorized device based on the device attributes and network attributes; Encapsulate the video stream to obtain the data packet to be distributed, and upload the data packet to be distributed to the video distribution server based on the cache space configuration result; Control the video distribution server to distribute the data packet to be distributed to the participating terminals in each authorized device based on the upload result according to the path configuration result and the distribution priority of each authorized device.

2. The communication architecture system of an online meeting based on screen mirroring according to claim 1, characterized in that, The authorized devices include a main screen, a sub-screen, and a tablet.

3. The communication architecture system of an online meeting based on screen mirroring according to claim 1, characterized in that, The device docking module includes: The conference creation unit is used to receive a conference creation instruction based on the conference master terminal, trigger a conference creation mechanism to create a conference based on the reception result, and allocate docking interfaces for each authorized device on the conference master terminal based on the creation result; The device docking unit is used to extract the device numbers of each authorized device, extract the communication addresses of each authorized device based on the device numbers, and dock each authorized device with the conference created in the conference master terminal based on the communication addresses and docking interfaces; The status update unit is used to start the TV main screen based on the docking result and load the conference program based on the start result.

4. A communication architecture system for an online meeting based on screen mirroring according to claim 3, characterized in that, The conference creation unit includes: The data upload sub-unit is used to start a preset document service based on the conference creation result and receive the data information uploaded by the user based on the start result; The format conversion unit is used for: The target component composition for extracting data information based on the reception result, and based on the target component composition, the data information is component-split to obtain the document content, video, and audio in the data information; Extract the document content in the data information, and based on a preset document service, perform format conversion on the document content to obtain a target display page; Associate the target display page with the video and audio based on the time series to complete the reception and preprocessing of the data to be cast on the screen.

5. A communication architecture system for an online meeting based on screen mirroring, as claimed in claim 1, wherein Device docking module, including: Result acquisition unit, used to acquire the data to be cast on the screen and load the data to be cast on the screen based on the conference program; Display unit, used for: Extract the list of content to be displayed of the data to be cast on the screen based on the loading result, and determine the basic display attributes for extracting each data to be cast on the screen based on the list of content to be displayed; Determine the display order and expected display duration of the data to be cast on the screen based on the basic display attributes, and display the data to be cast on the screen sequentially based on the display order and expected display duration according to the conference program.

6. The communication architecture system of an online meeting based on screen mirroring according to claim 1, characterized in that, Screen mirroring module, including: Monitoring unit, used to monitor the display result in real time and obtain the playback timestamps of each data to be cast on the screen based on the real-time monitoring result; Encoding unit, used for: Perform serialization processing on each data to be cast on the screen based on the playback timestamp to obtain a screen mirroring image corresponding to each playback timestamp, and determine the screen mirroring scenario and basic screen mirroring parameters of the screen mirroring image based on the screen mirroring requirements; Preprocess the screen mirroring image based on the basic screen mirroring parameters, and determine the video encoding format of the screen mirroring image according to the screen mirroring scenario based on the preprocessing result; Determine the encoding parameters for the screen mirroring image based on the screen mirroring requirements, and encapsulate the video encoding format and encoding parameters to obtain a video encoding mechanism; Perform encoding processing on each screen mirroring image sequentially based on the video encoding mechanism according to the playback timestamp, and perform time marking on the video stream data based on the playback timestamp to obtain video stream data; Data upload unit, used to load the video stream data into the upload queue in the video channel and upload the video stream data to the video channel after the loading is completed.

7. A communication architecture system for an online meeting based on screen mirroring according to claim 1, characterized in that, Display configuration module, including: Content display unit, used to obtain the content window size for video display of each participating terminal, perform equal-proportion size scaling on the video stream based on the content window size and the coordinate conversion mechanism, and display the video stream based on the equal-proportion size scaling result; Monitoring unit, used for: Enable the active monitoring mechanism based on the display result, and monitor the operation data of each user on the participating terminal in real time based on the enabling result, where the operation data includes text input data and trajectory input data; Identify the text input data and trajectory input data based on a preset service mechanism, and obtain the path and position data of the text input data and trajectory input data on each participating terminal based on the identification result; Perform coordinate conversion on the path and position data on each participating terminal based on the content window size of each participating terminal to control the coordinate conversion mechanism to obtain the operation instructions of each user on each participating terminal, where the operation instructions include text instructions and trajectory instructions.

8. A communication architecture system for an online meeting based on screen mirroring according to claim 1, characterized in that, Response module, including: Instruction processing unit, used for: Obtain the obtained operation instructions and upload the operation instructions to the channel trajectory channel; Send operation instructions to each authorized device based on the upload result, and respond to the text instructions in the operation instructions based on the main screen in the authorized device; Convert the text instructions into standard execution events based on the response result, and execute the standard execution events. At the same time, synchronously update the display content of each authorized device based on the execution result; At the same time, receive the trajectory instructions in the operation instructions based on each authorized device, and convert the format of the trajectory instructions based on the reception result to obtain the operation trajectory; Display the operation trajectory on each authorized device.

9. A communication architecture method for an online meeting based on screen mirroring, characterized in that, Include: Step 1: Docking each authorized device with the conference master control terminal based on the conference creation result, and controlling the main screen in the authorized device to display the data to be cast based on the docking result; Step 2: Real-time encode the data to be cast into a video stream based on the display result and upload it to the video channel, and based on the upload result, differentially distribute the video stream to the participating terminals in each authorized device according to the screen projection requirements; Step 3: Perform a ratio-preserving content window conversion display on the video stream based on the distribution result according to the coordinate conversion mechanism, and receive the operation instructions of the participating terminals in real time based on the conversion display result; Step 4: Send the operation instructions to each authorized device based on the signaling trajectory channel, and synchronously update the display content of each authorized device; Among them, Step 2 includes: A requirement analysis unit for obtaining the screen projection requirements based on the conference master control terminal, analyzing the screen projection requirements to obtain the geographical locations of each authorized device, and determining the network area distribution status of each authorized device based on the geographical locations, where the network area distribution status includes the same local area network and cross-network; When each authorized device is within the same local area network: Obtain the communication addresses of each authorized device, and construct a multicast address based on the communication addresses; Encapsulate the video stream to obtain the data packet to be distributed, and distribute the data packet to be distributed to the participating terminals in each authorized device based on the multicast network protocol according to the multicast address; When each authorized device is cross-network: Configure the path of the video distribution server based on the communication addresses of each authorized device. At the same time, determine the real-time transfer byte amount of the video stream based on the screen projection requirements, and configure the cache space of the video distribution server based on the real-time transfer byte amount; Obtain the device attributes and network attributes of each authorized device, and determine the distribution priority for each authorized device based on the device attributes and network attributes; Encapsulate the video stream to obtain the data packet to be distributed, and upload the data packet to be distributed to the video distribution server based on the cache space configuration result; Control the video distribution server based on the upload result to distribute the data packet to be distributed to the participating terminals in each authorized device according to the path configuration result and the distribution priority of each authorized device.

Images