A method and system for processing information based on multi-point video conferencing

Abstract

This invention provides an information processing method and system based on multi-terminal video conferencing. Based on a video conferencing initiation request received by the service platform, a video conferencing thread is started. Based on the running status of the video conferencing thread, video conferencing invitations are sent to different user terminals, thereby connecting the corresponding user terminals to the video conferencing thread. The system monitors and determines whether a user terminal is online in the video conferencing, adds messages uploaded by the corresponding user terminal to the data stream link, and adjusts the transmission status of all messages under the data stream link in the video conferencing thread, distinguishing and uploading messages of corresponding types from multiple user terminals. Furthermore, it determines whether a user terminal has experienced a video conferencing offline event, intercepts messages in the data stream link for user terminals that have experienced offline events, and resends the messages when the user terminal reconnects, avoiding information loss during the video conferencing process and providing stable and reliable video conferencing services for multiple user terminals.

Description

Technical Field

[0001] This invention relates to the field of multimedia information processing, and more particularly to an information processing method and system based on multi-terminal video conferencing. Background Technology

[0002] With the increasing popularity of online work, video conferencing has become a primary means of online communication. Users can participate in online video conferences and send and receive messages by connecting to the corresponding online video conferencing port using smartphones or laptops. To ensure the stability and security of video conferences, users typically need a password to gain access. Existing video conferencing systems operate on a real-time information processing basis, meaning that information from different user terminals is uploaded and displayed in real time. This method effectively reduces information processing latency. However, when a user goes offline during a video conference, the information sent by that user cannot be uploaded to the video conference, resulting in information loss during the conference and reducing the integrity of the information. This prevents the system from providing a stable and reliable video conferencing service for all user terminals. Summary of the Invention

[0003] The purpose of this invention is to provide an information processing method and system based on multi-terminal video conferencing. Based on a video conferencing initiation request received by the service platform, it starts a video conferencing thread and, based on the running status of the video conferencing thread, sends video conferencing invitations to different user terminals, thereby connecting the corresponding user terminals to the video conferencing thread and enabling multiple user terminals to correctly access the corresponding video conference. It monitors and determines whether a user terminal is online in the video conference, adds the messages uploaded by the corresponding user terminal to the data stream link, and adjusts the transmission status of all messages under the data stream link in the video conferencing thread, distinguishing and uploading corresponding types of messages from multiple user terminals to improve the information processing efficiency of the video conference. It also determines whether a user terminal has experienced a video conference offline event, intercepts the messages in the data stream link of the user terminal that has experienced an offline event, and resends the messages when the user terminal reconnects, avoiding information loss during the video conference and providing a stable and reliable video conferencing service for multiple user terminals.

[0004] This invention is achieved through the following technical solution:

[0005] An information processing method based on multi-terminal video conferencing includes:

[0006] Based on the video conference initiation request received by the service platform, the corresponding video conference thread of the service platform is started; based on the running status information of the video conference thread, video conference invitations are sent to different user terminals, thereby connecting the corresponding user terminals to the video conference thread;

[0007] All user terminals connected to the video conferencing thread are monitored to determine whether the user terminal is currently in the online video conferencing state; based on the messages uploaded by each user terminal in the online video conferencing state, the messages are added to the corresponding data stream links, and the transmission status of all messages under the data stream links in the video conferencing thread is adjusted;

[0008] Based on the real-time working status of the user terminal connected to the video conferencing thread, it is determined whether a video conferencing offline event has occurred at the user terminal; if a video conferencing offline event occurs, the corresponding messages in the data stream link are intercepted so that the messages can be resent after the user terminal comes back online.

[0009] Optionally, based on the video conference initiation request received by the service platform, the corresponding video conference thread of the service platform is started; based on the running status information of the video conference thread, video conference invitations are sent to different user terminals, thereby connecting the corresponding user terminals to the video conference thread, including:

[0010] The service platform parses and processes the video conference initiation request received to obtain the status information of the participating user terminals in the video conference to be initiated. The status information of the participating user terminals includes the number of participating user terminals and the network location of the user terminals. Based on the status information of the participating user terminals, the service platform predicts the running resources required to execute the corresponding video conference and starts the corresponding video conference thread.

[0011] The operation log of the video conferencing thread is analyzed to obtain the network area connection progress information of the video conferencing thread, and a video conferencing invitation is sent to the user terminal under the corresponding network area; the invitation response from the user terminal is identified to determine whether the user terminal has video conferencing participation permission, and then the user terminal with video conferencing participation permission is connected to the video conferencing thread.

[0012] Optionally, all user terminals connected to the video conferencing thread are monitored to determine whether they are currently online in the video conferencing session. Based on the messages uploaded by each user terminal that is online in the video conferencing session, the messages are added to the corresponding data stream links, and the transmission status of all messages under the data stream links in the video conferencing thread is adjusted, including:

[0013] For each user terminal connected to the video conferencing thread, the video conferencing window status is identified to determine whether the user terminal's video conferencing window meets the preset interface display conditions; if yes, the user terminal is currently in the video conferencing online state; if no, the user terminal is currently not in the video conferencing online state.

[0014] The system identifies the messages uploaded by all users in the online video conferencing state to obtain the data content type attribute corresponding to each message; based on the data content type attribute, the message is added to the corresponding data stream link; the system identifies the amount of added message data in the data stream link to determine whether the data stream link is in a data saturation state; when the data stream link is in a data saturation state, the system adjusts the time axis of all messages transmitted to the video conferencing thread based on the generation time of all messages under the data stream link.

[0015] Optionally, based on the real-time working status of the user terminal accessing the video conferencing thread, it is determined whether a video conferencing offline event has occurred at the user terminal; if a video conferencing offline event occurs, the corresponding messages in the data stream link are intercepted so that the messages can be resent after the user terminal reconnects, including:

[0016] Real-time network bandwidth usage is identified for user terminals connected to the video conferencing thread to determine the available connection bandwidth between the user terminal and the video conferencing thread; if the available connection bandwidth is less than a preset bandwidth threshold, it is determined that a video conferencing offline event has occurred on the user terminal; otherwise, it is determined that no video conferencing offline event has occurred on the user terminal.

[0017] When a video conference goes offline, all messages uploaded and added to the data stream link by the user terminal that went offline are marked and intercepted based on the duration of the offline event; and when the user terminal that went offline comes back online, the marked and intercepted messages are resent.

[0018] Optionally, when a user client that experienced a video conference offline event comes back online, the message intercepted by the identifier is retransmitted, including:

[0019] Step S1: Let t be the difference between the time of generation and the current time of a message that needs to be resent, in milliseconds; let H be the importance of the message; and let S be the number of historical interactions between the user sending the message and the user receiving the message. Then, the importance score of the message that needs to be resent is:

[0020]

[0021] In the above formula (1), I is the importance score of the message that needs to be resent, α, β, γ and δ are all correlation coefficients, and e is the natural constant;

[0022] Step S2: Let the available bandwidth of the user terminal sending this message be w, the theoretical maximum bandwidth of the user terminal be W, its current network latency be Y, and its current packet loss rate be p. Then the network condition score of the current user terminal is:

[0023]

[0024] In the above formula (2), F is the network status score of the current user terminal, P is the historical maximum packet loss rate of the user terminal, and a, b, and c are the bandwidth impact coefficient, network latency impact coefficient, and packet loss rate impact coefficient, respectively.

[0025] Step S2: Based on the calculation results of steps S1 and S2 above, determine the retransmission priority score of the messages that need to be retransmitted.

[0026]

[0027] In the above formula (3), K is the retransmission priority score of the message that needs to be retransmitted, and C is the number of times it has failed to be sent in history. All messages that need to be retransmitted are arranged in reverse order of retransmission priority score. The higher the priority score, the higher the priority is sent. When the value of K is less than 0.5, the message will no longer be retransmitted. m and n are the message importance adjustment coefficient and the network condition adjustment coefficient, respectively.

[0028] An information processing system based on multi-terminal video conferencing, comprising:

[0029] The video conferencing thread startup module is used to start the corresponding video conferencing thread of the service platform based on the video conferencing initiation request received by the service platform.

[0030] The user terminal access control module is used to initiate video conference invitations to different user terminals based on the running status information of the video conference thread, thereby connecting the corresponding user terminals to the video conference thread.

[0031] The user-end monitoring module is used to monitor all user ends connected to the video conferencing thread and determine whether the user end is currently online in the video conferencing.

[0032] The message addition and transmission control module is used to add messages to the corresponding data stream links based on the messages uploaded by all user terminals that are online in the video conference, and to adjust the transmission status of all messages under the data stream links in the video conference thread.

[0033] The video conference offline event determination module is used to determine whether a video conference offline event has occurred on the user terminal based on the real-time working status of the user terminal connected to the video conference thread.

[0034] The message interception and retransmission control module is used to intercept the corresponding messages in the data stream when a video conference goes offline, so as to retransmit the messages after the user comes back online.

[0035] Optionally, the video conferencing thread startup module is used to start the corresponding video conferencing thread of the service platform based on the video conferencing initiation request received by the service platform, including:

[0036] The service platform parses and processes the video conference initiation request received to obtain the status information of the participating user terminals in the video conference to be initiated. The status information of the participating user terminals includes the number of participating user terminals and the network location of the user terminals. Based on the status information of the participating user terminals, the service platform predicts the running resources required to execute the corresponding video conference and starts the corresponding video conference thread.

[0037] The user terminal access control module is used to initiate video conference invitations to different user terminals based on the running status information of the video conferencing thread, thereby connecting the corresponding user terminals to the video conferencing thread, including:

[0038] The operation log of the video conferencing thread is analyzed to obtain the network area connection progress information of the video conferencing thread, and a video conferencing invitation is sent to the user terminal under the corresponding network area; the invitation response from the user terminal is identified to determine whether the user terminal has video conferencing participation permission, and then the user terminal with video conferencing participation permission is connected to the video conferencing thread.

[0039] Optionally, the user-end monitoring module is used to monitor all user ends connected to the video conferencing thread and determine whether the user end is currently online in the video conferencing, including:

[0040] For each user terminal connected to the video conferencing thread, the video conferencing window status is identified to determine whether the user terminal's video conferencing window meets the preset interface display conditions; if yes, the user terminal is currently in the video conferencing online state; if no, the user terminal is currently not in the video conferencing online state.

[0041] The message addition and transmission control module is used to add messages to the corresponding data stream links based on the messages uploaded by all user terminals that are online in the video conference, and to adjust the transmission status of all messages under the data stream links in the video conference thread, including:

[0042] The system identifies the messages uploaded by all users in the online video conferencing state to obtain the data content type attribute corresponding to each message; based on the data content type attribute, the message is added to the corresponding data stream link; the system identifies the amount of added message data in the data stream link to determine whether the data stream link is in a data saturation state; when the data stream link is in a data saturation state, the system adjusts the time axis of all messages transmitted to the video conferencing thread based on the generation time of all messages under the data stream link.

[0043] Optionally, the conference offline event determination module is used to determine whether a video conference offline event has occurred on the user terminal based on the real-time working status of the user terminal connected to the video conference thread, including:

[0044] Real-time network bandwidth usage is identified for user terminals connected to the video conferencing thread to determine the available connection bandwidth between the user terminal and the video conferencing thread; if the available connection bandwidth is less than a preset bandwidth threshold, it is determined that a video conferencing offline event has occurred on the user terminal; otherwise, it is determined that no video conferencing offline event has occurred on the user terminal.

[0045] The message interception and retransmission control module is used to intercept corresponding messages in the data stream when a video conference goes offline, so as to retransmit the messages after the user comes back online, including:

[0046] When a video conference goes offline, all messages uploaded and added to the data stream link by the user terminal that went offline are marked and intercepted based on the duration of the offline event; and when the user terminal that went offline comes back online, the marked and intercepted messages are resent.

[0047] Optionally, when a user client that experienced a video conference offline event comes back online, the message intercepted by the identifier is retransmitted, including:

[0048] Step S1: Let t be the difference between the time of generation and the current time of a message that needs to be resent, in milliseconds; let H be the importance of the message; and let S be the number of historical interactions between the user sending the message and the user receiving the message. Then, the importance score of the message that needs to be resent is:

[0049]

[0050] In the above formula (1), I is the importance score of the message that needs to be resent, α, β, γ and δ are all correlation coefficients, and e is the natural constant;

[0051] Step S2: Let the available bandwidth of the user terminal sending this message be w, the theoretical maximum bandwidth of the user terminal be W, its current network latency be Y, and its current packet loss rate be p. Then the network condition score of the current user terminal is:

[0052]

[0053] In the above formula (2), F is the network status score of the current user terminal, P is the historical maximum packet loss rate of the user terminal, and a, b, and c are the bandwidth impact coefficient, network latency impact coefficient, and packet loss rate impact coefficient, respectively.

[0054] Step S2: Based on the calculation results of steps S1 and S2 above, determine the retransmission priority score of the messages that need to be retransmitted.

[0055]

[0056] In the above formula (3), K is the retransmission priority score of the message that needs to be retransmitted, and C is the number of times it has failed to be sent in history. All messages that need to be retransmitted are arranged in reverse order of retransmission priority score. The higher the priority score, the higher the priority is sent. When the value of K is less than 0.5, the message will no longer be retransmitted. m and n are the message importance adjustment coefficient and the network condition adjustment coefficient, respectively.

[0057] Compared with the prior art, the present invention has the following beneficial effects:

[0058] This application provides an information processing method and system based on multi-terminal video conferencing. Based on a video conferencing initiation request received from a service platform, a video conferencing thread is started. Based on the running status of the video conferencing thread, video conferencing invitations are sent to different user terminals, thereby connecting the corresponding user terminals to the video conferencing thread and enabling multiple user terminals to correctly join the corresponding video conference. The system monitors and determines whether a user terminal is online in the video conference, adds the messages uploaded by the corresponding user terminal to the data stream link, and adjusts the transmission status of all messages under the data stream link in the video conferencing thread. It also distinguishes and uploads messages of corresponding types from multiple user terminals to improve the information processing efficiency of the video conference. Furthermore, it determines whether a user terminal has experienced a video conference offline event, intercepts the messages in the data stream link of the user terminal that has experienced an offline event, and resends the messages when the user terminal reconnects, avoiding information loss during the video conference and providing a stable and reliable video conferencing service for multiple user terminals. Attached Figure Description

[0059] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort. Wherein:

[0060] Figure 1 This is a flowchart illustrating an information processing method based on multi-terminal video conferencing provided by the present invention.

[0061] Figure 2 This is a schematic diagram of the structure of an information processing system based on multi-terminal video conferencing provided by the present invention. Detailed Implementation

[0062] To make the above-mentioned objectives, features, and advantages of this application more apparent and understandable, the specific embodiments of this application will be described in detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are for illustrative purposes only and are not intended to limit the scope of this application. Furthermore, it should be noted that, for ease of description, only the parts relevant to this application are shown in the accompanying drawings, not the entire structure. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without inventive effort are within the scope of protection of this application.

[0063] The terms “comprising” and “having”, and any variations thereof, used in this application are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the steps or units listed, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to such process, method, product, or apparatus.

[0064] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0065] Please see Figure 1 As shown, an embodiment of this application provides an information processing method based on multi-terminal video conferencing. This information processing method based on multi-terminal video conferencing includes:

[0066] Based on the video conference initiation request received by the service platform, the corresponding video conference thread of the service platform is started; based on the running status information of the video conference thread, video conference invitations are sent to different user terminals, thereby connecting the corresponding user terminals to the video conference thread;

[0067] Monitor all user terminals connected to the video conferencing thread to determine whether the user terminal is currently online in the video conferencing; based on the messages uploaded by each user terminal that is online in the video conferencing, add the message to the corresponding data stream link, and adjust the transmission status of all messages under the data stream link in the video conferencing thread;

[0068] Based on the real-time working status of the user terminal connected to the video conferencing thread, it is determined whether the user terminal has experienced a video conferencing offline event; if a video conferencing offline event occurs, the corresponding messages in the data stream are intercepted so that the messages can be resent after the user terminal comes back online.

[0069] The beneficial effects of the above embodiments are as follows: This information processing method based on multi-terminal video conferencing starts a video conferencing thread based on the video conferencing initiation request received by the service platform, and sends video conferencing invitations to different user terminals based on the running status of the video conferencing thread, thereby connecting the corresponding user terminals to the video conferencing thread, enabling multiple user terminals to correctly access the corresponding video conferencing; it monitors and determines whether the user terminal is in the online state of the video conferencing, adds the messages uploaded by the corresponding user terminal to the data stream link, and adjusts the transmission status of all messages under the data stream link in the video conferencing thread, distinguishing and uploading the corresponding types of messages uploaded by multiple user terminals, thereby improving the information processing efficiency of the video conferencing; it also determines whether a user terminal has experienced a video conferencing offline event, intercepts the messages in the data stream link of the user terminal that experienced the video conferencing offline event, and resends the messages when the user terminal reconnects, avoiding information loss during the video conferencing process and providing a stable and reliable video conferencing service for multiple user terminals.

[0070] In another embodiment, based on a video conference initiation request received by the service platform, a corresponding video conference thread of the service platform is started; based on the running status information of the video conference thread, video conference invitations are sent to different user terminals, thereby connecting the corresponding user terminals to the video conference thread, including:

[0071] The service platform parses and processes the video conference initiation request received to obtain the status information of the participating user terminals in the video conference to be initiated. This status information includes the number of participating user terminals and their network locations. Based on this status information, the service platform predicts the runtime resources required to execute the corresponding video conference and starts the corresponding video conference thread accordingly.

[0072] The operation log of the video conferencing thread is analyzed to obtain the network area connection progress information of the video conferencing thread, and video conferencing invitations are sent to user terminals under the corresponding network area; the invitation responses from user terminals are identified to determine whether the user terminal has video conferencing participation permissions, and user terminals with video conferencing participation permissions are connected to the video conferencing thread.

[0073] The beneficial effects of the above embodiments are that, in actual video conferencing, the service platform, as the control platform for all user terminals participating in the video conference, can process messages occurring on different user terminals during the video conference, realize information interaction between different user terminals, and each user terminal has the authority to initiate video conference invitations through the service platform. To ensure that the corresponding user terminals can participate in the video conference in a timely manner, the service platform parses and processes the video conference requests received to obtain the status information of the user terminals participating in the video conference to be initiated, that is, to determine the status information of all user terminals expected to participate in the currently initiated video conference. This status information includes the number of user terminals participating in the video conference and the network location of the user terminals, thus enabling accurate prediction of the memory and network resources required for subsequent video conference operations. Based on this user terminal status information, the service platform predicts the memory and network resources required to execute the corresponding video conference, thereby calling the corresponding memory and network resources within the service platform to start the corresponding video conference thread, ensuring that the service platform can guarantee the stable and continuous operation of the video conference. Furthermore, the operation logs of the video conferencing thread are analyzed to obtain network segment connection progress information (i.e., the connection speed of the video conferencing thread with different network segments during operation). Based on this, video conferencing invitations are sequentially sent to user terminals under the corresponding network segments. The invitation responses from user terminals are identified to obtain the user terminal's identity information. This identity information is compared with a preset identity information whitelist. If the identity information exists in the preset identity information whitelist, it is determined that the user terminal has video conferencing participation permissions; otherwise, it is determined that the user terminal does not have video conferencing participation permissions. Therefore, user terminals with video conferencing participation permissions are connected to the video conferencing thread to ensure that the corresponding user terminals can join the video conference in a timely manner.

[0074] In another embodiment, all user terminals accessing the video conferencing thread are monitored to determine whether the user terminal is currently online in the video conferencing; based on the messages uploaded by each user terminal that is online in the video conferencing, the message is added to the corresponding data stream link, and the transmission status of all messages under the data stream link in the video conferencing thread is adjusted, including:

[0075] For each user terminal connected to the video conferencing thread, the video conferencing window status is identified to determine whether the user terminal's video conferencing window meets the preset interface display conditions; if yes, the user terminal is currently in the video conferencing online state; if no, the user terminal is currently not in the video conferencing online state.

[0076] The system identifies the messages uploaded by all users in the online video conferencing state and obtains the data content type attribute corresponding to each message. Based on the data content type attribute, the message is added to the corresponding data stream link. The system identifies the amount of added message data in the data stream link and determines whether the data stream link is in a data saturation state. If the data stream link is in a data saturation state, the system adjusts the time axis of all messages transmitted to the video conferencing thread based on the generation time of all messages under the data stream link.

[0077] The beneficial effects of the above embodiments are that the user terminal can be, but is not limited to, a smartphone or laptop held by the user terminal. While participating in the video conference, the user terminal may also launch other software, ensuring that the user terminal does not keep the window of the software corresponding to the video conference open throughout the entire video conference. To ensure that video conference information is transmitted only when the user terminal keeps the window of the software corresponding to the video conference open in the foreground, the video conference window status of each user terminal connected to the video conference thread is identified. It is determined whether the user terminal's video conference window meets the preset interface display conditions (the preset interface display conditions refer to the video conference window being in the foreground state on the user terminal's display interface). This accurately determines whether the user terminal is currently online in the video conference, ensuring effective differentiation and uploading of messages from all user terminals that are online in the video conference. The messages uploaded by each user terminal that is online in the video conference are identified, and the data content type attribute corresponding to each message is obtained. The messages are then added to the corresponding data stream links, achieving classified uploading of messages with different content. Furthermore, the system identifies the amount of message data added to the data stream link and determines whether the data stream link is in a data saturation state (i.e., whether the amount of data on the data stream link exceeds a preset data amount threshold). When the data stream link is in a data saturation state, it indicates that the data stream link cannot continue to receive new messages, otherwise message overflow and loss will occur. At this time, based on the generation time of all messages under the data stream link, the timeline of all messages transmitted to the video conferencing thread is adjusted, and all messages under the data stream link are transmitted to the video conferencing thread in sequence according to the timeline, ensuring that the video conferencing thread can display the corresponding messages in an orderly manner.

[0078] In another embodiment, based on the real-time working status of the user terminal accessing the video conferencing thread, it is determined whether a video conferencing offline event has occurred at the user terminal; if a video conferencing offline event occurs, the corresponding messages in the data stream are intercepted so that the messages can be resent after the user terminal comes back online, including:

[0079] Real-time network bandwidth usage is identified for user terminals connected to the video conferencing thread to determine the available connection bandwidth between the user terminal and the video conferencing thread; if the available connection bandwidth is less than a preset bandwidth threshold, it is determined that the user terminal has experienced a video conferencing offline event; otherwise, it is determined that the user terminal has not experienced a video conferencing offline event.

[0080] When a video conference goes offline, all messages uploaded and added to the data stream by the user client that went offline are marked and intercepted based on the duration of the offline event. When the user client that went offline comes back online, the marked and intercepted messages are resent.

[0081] The beneficial effects of the above embodiments are that a sufficiently large connection bandwidth exists between the user terminal and the video conferencing thread to ensure effective and stable information interaction between them. If the connection bandwidth between the user terminal and the video conferencing thread is insufficient, continuous real-time information interaction cannot be guaranteed, resulting in a de facto offline connection. By identifying the real-time network bandwidth usage of the user terminal accessing the video conferencing thread, the available connection bandwidth between the user terminal and the video conferencing thread is determined, and a threshold comparison is performed on this available connection bandwidth to determine whether a video conferencing offline event has occurred. This facilitates the subsequent interception of messages that the corresponding user terminal needs to upload during the offline period. Furthermore, when a video conferencing offline event occurs, all messages uploaded and added to the data stream link by the user terminal that experienced the offline event are marked and intercepted based on the duration of the offline event. When the user terminal that experienced the offline event reconnects, the marked and intercepted messages are retransmitted to avoid information loss during the video conference and to provide stable and reliable video conferencing services for multiple user terminals.

[0082] In another embodiment, when a user client that experienced a video conference offline event reconnects, the message intercepted by the identifier is retransmitted, including:

[0083] Step S1: Let t be the difference between the time of generation and the current time of a message that needs to be resent, in milliseconds; let H be the importance of the message; and let S be the number of historical interactions between the user sending the message and the user receiving the message. Then, the importance score of the message that needs to be resent is:

[0084]

[0085] In the above formula (1), I is the importance score of the message that needs to be resent, α, β, γ and δ are all correlation coefficients, whose values ​​can be adjusted according to the actual situation, and e is the natural constant. The importance of the message is comprehensively scored from factors such as the timeliness of the message that needs to be resent and the relationship between the sender and the receiver. This can more accurately assess the importance of the message and provide a data basis for the priority of subsequent resent messages.

[0086] Step S2: Let the available bandwidth of the user terminal sending this message be w, the theoretical maximum bandwidth of the user terminal be W, its current network latency be Y, and its current packet loss rate be p. Then the network condition score of the current user terminal is:

[0087]

[0088] In the above formula (2), F is the network status score of the current user terminal, P is the historical maximum packet loss rate of the user terminal, and a, b, and c are the bandwidth impact coefficient, network latency impact coefficient, and packet loss rate impact coefficient, respectively. The network status of the user is comprehensively evaluated based on the user's bandwidth, network latency, and packet loss rate, which provides data support for the efficient use of network resources and avoidance of resource waste in the future.

[0089] Step S2: Based on the calculation results of steps S1 and S2 above, determine the retransmission priority score of the messages that need to be retransmitted.

[0090]

[0091] In the above formula (3), K is the retransmission priority score of the message that needs to be retransmitted, and C is the number of times it has failed to be sent in history. All messages that need to be retransmitted are arranged in reverse order of retransmission priority score. The higher the priority score, the higher the priority of sending. When the value of K is less than 0.5, the message will no longer be retransmitted. m and n are the message importance adjustment coefficient and the network condition adjustment coefficient, respectively. Their values ​​can be adjusted according to the actual situation. The retransmission priority of the message is scientifically scored according to the current network condition, the importance of the message and the historical sending failure situation, which ensures that important messages are retransmitted first, improves the efficiency of system resource utilization, and avoids resource waste and network congestion.

[0092] The beneficial effects of the above embodiments are as follows: Frequent retransmissions can lead to a sharp increase in network traffic, especially when a large number of users are online simultaneously, potentially causing network congestion. Simultaneously, the server needs to handle a large number of retransmission requests, which may result in excessive consumption of server resources (such as CPU, memory, and bandwidth), affecting server stability and response speed. This, in turn, can lead to user frustration due to message delays and communication instability, reducing their overall service satisfaction and causing significant losses. To avoid the above situation, when a user client that experienced a video conference offline event reconnects, the intercepted messages are retransmitted. The retransmission priority and whether to retransmit messages are scientifically evaluated based on the current network conditions, the importance of the message, and historical transmission failures. This avoids the sharp increase in network traffic and network congestion caused by frequent retransmissions, while improving server stability and response speed, preventing user frustration due to message delays and communication instability, and avoiding reduced overall satisfaction.

[0093] Please see Figure 2 As shown, an embodiment of this application provides an information processing system based on multi-terminal video conferencing. This information processing system based on multi-terminal video conferencing includes:

[0094] The video conferencing thread startup module is used to start the corresponding video conferencing thread of the service platform based on the video conferencing initiation request received by the service platform.

[0095] The user terminal access control module is used to send video conference invitations to different user terminals based on the running status information of the video conference thread, thereby connecting the corresponding user terminals to the video conference thread.

[0096] The client-side monitoring module is used to monitor all client terminals connected to the video conferencing thread and determine whether the client terminal is currently online in the video conferencing.

[0097] The message addition and transmission control module is used to add messages to the corresponding data stream links based on the messages uploaded by all users who are online in the video conference, and to adjust the transmission status of all messages under the data stream link in the video conference thread.

[0098] The video conference offline event detection module is used to determine whether a video conference offline event has occurred on a user terminal based on the real-time working status of the user terminal connected to the video conference thread.

[0099] The message interception and retransmission control module is used to intercept the corresponding messages in the data stream when a video conference goes offline, so that the messages can be retransmitted after the user comes back online.

[0100] The beneficial effects of the above embodiments are as follows: This multi-terminal video conferencing-based information processing system starts a video conferencing thread based on the video conferencing initiation request received by the service platform, and sends video conferencing invitations to different user terminals based on the running status of the video conferencing thread, thereby connecting the corresponding user terminals to the video conferencing thread, enabling multiple user terminals to correctly access the corresponding video conference; it monitors and determines whether the user terminal is in the online state of the video conference, adds the messages uploaded by the corresponding user terminal to the data stream link, and adjusts the transmission status of all messages under the data stream link in the video conferencing thread, distinguishing and uploading the corresponding types of messages uploaded by multiple user terminals, thereby improving the information processing efficiency of the video conference; it also determines whether a user terminal has experienced a video conference offline event, intercepts the messages in the data stream link of the user terminal that experienced the video conference offline event, and resends the messages when the user terminal reconnects, avoiding information loss during the video conference and providing a stable and reliable video conferencing service for multiple user terminals.

[0101] In another embodiment, the video conferencing thread initiation module is used to initiate a corresponding video conferencing thread on the service platform based on a video conferencing initiation request received by the service platform, including:

[0102] The service platform parses and processes the video conference initiation request received to obtain the status information of the participating user terminals in the video conference to be initiated. This status information includes the number of participating user terminals and their network locations. Based on this status information, the service platform predicts the runtime resources required to execute the corresponding video conference and starts the corresponding video conference thread accordingly.

[0103] The user terminal access control module is used to initiate video conference invitations to different user terminals based on the running status information of the video conference thread, thereby connecting the corresponding user terminals to the video conference thread, including:

[0104] The operation log of the video conferencing thread is analyzed to obtain the network area connection progress information of the video conferencing thread, and video conferencing invitations are sent to user terminals under the corresponding network area; the invitation responses from user terminals are identified to determine whether the user terminal has video conferencing participation permissions, and user terminals with video conferencing participation permissions are connected to the video conferencing thread.

[0105] The beneficial effects of the above embodiments are that, in actual video conferencing, the service platform, as the control platform for all user terminals participating in the video conference, can process messages occurring on different user terminals during the video conference, realize information interaction between different user terminals, and each user terminal has the authority to initiate video conference invitations through the service platform. To ensure that the corresponding user terminals can participate in the video conference in a timely manner, the service platform parses and processes the video conference requests received to obtain the status information of the user terminals participating in the video conference to be initiated, that is, to determine the status information of all user terminals expected to participate in the currently initiated video conference. This status information includes the number of user terminals participating in the video conference and the network location of the user terminals, thus enabling accurate prediction of the memory and network resources required for subsequent video conference operations. Based on this user terminal status information, the service platform predicts the memory and network resources required to execute the corresponding video conference, thereby calling the corresponding memory and network resources within the service platform to start the corresponding video conference thread, ensuring that the service platform can guarantee the stable and continuous operation of the video conference. Furthermore, the operation logs of the video conferencing thread are analyzed to obtain network segment connection progress information (i.e., the connection speed of the video conferencing thread with different network segments during operation). Based on this, video conferencing invitations are sequentially sent to user terminals under the corresponding network segments. The invitation responses from user terminals are identified to obtain the user terminal's identity information. This identity information is compared with a preset identity information whitelist. If the identity information exists in the preset identity information whitelist, it is determined that the user terminal has video conferencing participation permissions; otherwise, it is determined that the user terminal does not have video conferencing participation permissions. Therefore, user terminals with video conferencing participation permissions are connected to the video conferencing thread to ensure that the corresponding user terminals can join the video conference in a timely manner.

[0106] In another embodiment, the user-end monitoring module is used to monitor all user ends connected to the video conferencing thread and determine whether the user end is currently online in the video conferencing, including:

[0107] For each user terminal connected to the video conferencing thread, the video conferencing window status is identified to determine whether the user terminal's video conferencing window meets the preset interface display conditions; if yes, the user terminal is currently in the video conferencing online state; if no, the user terminal is currently not in the video conferencing online state.

[0108] The message addition and transmission control module is used to add messages to the corresponding data stream links based on the messages uploaded by all users who are online in the video conference, and to adjust the transmission status of all messages under that data stream link in the video conference thread, including:

[0109] The system identifies the messages uploaded by all users in the online video conferencing state and obtains the data content type attribute corresponding to each message. Based on the data content type attribute, the message is added to the corresponding data stream link. The system identifies the amount of added message data in the data stream link and determines whether the data stream link is in a data saturation state. If the data stream link is in a data saturation state, the system adjusts the time axis of all messages transmitted to the video conferencing thread based on the generation time of all messages under the data stream link.

[0110] The beneficial effects of the above embodiments are that the user terminal can be, but is not limited to, a smartphone or laptop held by the user terminal. While participating in the video conference, the user terminal may also launch other software, ensuring that the user terminal does not keep the window of the software corresponding to the video conference open throughout the entire video conference. To ensure that video conference information is transmitted only when the user terminal keeps the window of the software corresponding to the video conference open in the foreground, the video conference window status of each user terminal connected to the video conference thread is identified. It is determined whether the user terminal's video conference window meets the preset interface display conditions (the preset interface display conditions refer to the video conference window being in the foreground state on the user terminal's display interface). This accurately determines whether the user terminal is currently online in the video conference, ensuring effective differentiation and uploading of messages from all user terminals that are online in the video conference. The messages uploaded by each user terminal that is online in the video conference are identified, and the data content type attribute corresponding to each message is obtained. The messages are then added to the corresponding data stream links, achieving classified uploading of messages with different content. Furthermore, the system identifies the amount of message data added to the data stream link and determines whether the data stream link is in a data saturation state (i.e., whether the amount of data on the data stream link exceeds a preset data amount threshold). When the data stream link is in a data saturation state, it indicates that the data stream link cannot continue to receive new messages, otherwise message overflow and loss will occur. At this time, based on the generation time of all messages under the data stream link, the timeline of all messages transmitted to the video conferencing thread is adjusted, and all messages under the data stream link are transmitted to the video conferencing thread in sequence according to the timeline, ensuring that the video conferencing thread can display the corresponding messages in an orderly manner.

[0111] In another embodiment, the video conference offline event determination module is used to determine whether a video conference offline event has occurred on a user terminal based on the real-time working status of the user terminal accessing the video conference thread, including:

[0112] Real-time network bandwidth usage is identified for user terminals connected to the video conferencing thread to determine the available connection bandwidth between the user terminal and the video conferencing thread; if the available connection bandwidth is less than a preset bandwidth threshold, it is determined that the user terminal has experienced a video conferencing offline event; otherwise, it is determined that the user terminal has not experienced a video conferencing offline event.

[0113] The message interception and retransmission control module is used to intercept corresponding messages in the data stream when a video conference goes offline, so that the messages can be retransmitted after the user comes back online. This includes:

[0114] When a video conference goes offline, all messages uploaded and added to the data stream by the user client that went offline are marked and intercepted based on the duration of the offline event. When the user client that went offline comes back online, the marked and intercepted messages are resent.

[0115] The beneficial effects of the above embodiments are that a sufficiently large connection bandwidth exists between the user terminal and the video conferencing thread to ensure effective and stable information interaction between them. If the connection bandwidth between the user terminal and the video conferencing thread is insufficient, continuous real-time information interaction cannot be guaranteed, resulting in a de facto offline connection. By identifying the real-time network bandwidth usage of the user terminal accessing the video conferencing thread, the available connection bandwidth between the user terminal and the video conferencing thread is determined, and a threshold comparison is performed on this available connection bandwidth to determine whether a video conferencing offline event has occurred. This facilitates the subsequent interception of messages that the corresponding user terminal needs to upload during the offline period. Furthermore, when a video conferencing offline event occurs, all messages uploaded and added to the data stream link by the user terminal that experienced the offline event are marked and intercepted based on the duration of the offline event. When the user terminal that experienced the offline event reconnects, the marked and intercepted messages are retransmitted to avoid information loss during the video conference and to provide stable and reliable video conferencing services for multiple user terminals.

[0116] In another embodiment, when a user client that experienced a video conference offline event reconnects, the message intercepted by the identifier is retransmitted, including:

[0117] Step S1: Let t be the difference between the time of generation and the current time of a message that needs to be resent, in milliseconds; let H be the importance of the message; and let S be the number of historical interactions between the user sending the message and the user receiving the message. Then, the importance score of the message that needs to be resent is:

[0118]

[0119] In the above formula (1), I is the importance score of the message that needs to be resent, α, β, γ and δ are all correlation coefficients, whose values ​​can be adjusted according to the actual situation, and e is the natural constant. The importance of the message is comprehensively scored from factors such as the timeliness of the message that needs to be resent and the relationship between the sender and the receiver. This can more accurately assess the importance of the message and provide a data basis for the priority of subsequent resent messages.

[0120] Step S2: Let the available bandwidth of the user terminal sending this message be w, the theoretical maximum bandwidth of the user terminal be W, its current network latency be Y, and its current packet loss rate be p. Then the network condition score of the current user terminal is:

[0121]

[0122] In the above formula (2), F is the network status score of the current user terminal, P is the historical maximum packet loss rate of the user terminal, and a, b, and c are the bandwidth impact coefficient, network latency impact coefficient, and packet loss rate impact coefficient, respectively. The network status of the user is comprehensively evaluated based on the user's bandwidth, network latency, and packet loss rate, which provides data support for the efficient use of network resources and avoidance of resource waste in the future.

[0123] Step S2: Based on the calculation results of steps S1 and S2 above, determine the retransmission priority score of the messages that need to be retransmitted.

[0124]

[0125] In the above formula (3), K is the retransmission priority score of the message that needs to be retransmitted, and C is the number of times it has failed to be sent in history. All messages that need to be retransmitted are arranged in reverse order of retransmission priority score. The higher the priority score, the higher the priority of sending. When the value of K is less than 0.5, the message will no longer be retransmitted. m and n are the message importance adjustment coefficient and the network condition adjustment coefficient, respectively. Their values ​​can be adjusted according to the actual situation. The retransmission priority of the message is scientifically scored according to the current network condition, the importance of the message and the historical sending failure situation, which ensures that important messages are retransmitted first, improves the efficiency of system resource utilization, and avoids resource waste and network congestion.

[0126] The beneficial effects of the above embodiments are as follows: Frequent retransmissions can lead to a sharp increase in network traffic, especially when a large number of users are online simultaneously, potentially causing network congestion. Simultaneously, the server needs to handle a large number of retransmission requests, which may result in excessive consumption of server resources (such as CPU, memory, and bandwidth), affecting server stability and response speed. This, in turn, can lead to user frustration due to message delays and communication instability, reducing their overall service satisfaction and causing significant losses. To avoid the above situation, when a user client that experienced a video conference offline event reconnects, the intercepted messages are retransmitted. The retransmission priority and whether to retransmit messages are scientifically evaluated based on the current network conditions, the importance of the message, and historical transmission failures. This avoids the sharp increase in network traffic and network congestion caused by frequent retransmissions, while improving server stability and response speed, preventing user frustration due to message delays and communication instability, and avoiding reduced overall satisfaction.

[0127] In summary, this information processing method and system based on multi-terminal video conferencing starts a video conferencing thread based on the video conferencing request received from the service platform. Based on the running status of the video conferencing thread, it sends video conferencing invitations to different user terminals, thereby connecting the corresponding user terminals to the video conferencing thread and enabling multiple user terminals to correctly join the corresponding video conference. It monitors and determines whether a user terminal is online in the video conference, adds the messages uploaded by the corresponding user terminal to the data stream link, and adjusts the transmission status of all messages under the data stream link in the video conferencing thread. It also distinguishes and uploads messages of corresponding types from multiple user terminals to improve the information processing efficiency of the video conference. Furthermore, it determines whether a user terminal has experienced a video conference offline event, intercepts messages in the data stream link for users with offline events, and resends the messages when the user terminal reconnects, avoiding information loss during the video conference and providing a stable and reliable video conferencing service for multiple user terminals.

[0128] The above is only one specific embodiment of the present invention, and any improvements made based on the concept of the present invention shall be considered within the scope of protection of the present invention.

Claims

1. An information processing method based on multi-terminal video conferencing, characterized in that, include: Based on the video conference initiation request received by the service platform, the corresponding video conference thread of the service platform is started; based on the running status information of the video conference thread, video conference invitations are sent to different user terminals, thereby connecting the corresponding user terminals to the video conference thread; All user terminals connected to the video conferencing thread are monitored to determine whether the user terminal is currently in the online video conferencing state; based on the messages uploaded by each user terminal in the online video conferencing state, the messages are added to the corresponding data stream links, and the transmission status of all messages under the data stream links in the video conferencing thread is adjusted; Based on the real-time working status of the user terminal connected to the video conferencing thread, determine whether the user terminal has experienced a video conferencing offline event; When a video conference goes offline, the corresponding messages in the data stream are intercepted so that they can be resent after the user comes back online. Based on the messages uploaded by all user terminals that are online in the video conference, the messages are added to the corresponding data stream links, and the transmission status of all messages under the data stream links in the video conference thread is adjusted, including: identifying the messages uploaded by all user terminals that are online in the video conference and obtaining the data content type attribute corresponding to each message; Based on the data content type attribute, the message is added to the corresponding data stream link; the amount of added message data is identified in the data stream link to determine whether the data stream link is in a data saturation state; when the data stream link is in a data saturation state, the time axis of all messages transmitted to the video conferencing thread is adjusted based on the generation time of all messages under the data stream link.

2. The information processing method based on multi-terminal video conferencing as described in claim 1, characterized in that: Based on the video conference initiation request received by the service platform, the corresponding video conference thread of the service platform is started; based on the running status information of the video conference thread, video conference invitations are sent to different user terminals, thereby connecting the corresponding user terminals to the video conference thread, including: The service platform parses and processes the video conference initiation request received to obtain the status information of the participating user terminals in the video conference to be initiated. The status information of the participating user terminals includes the number of participating user terminals and the network location of the user terminals. Based on the status information of the participating user terminals, the service platform predicts the running resources required to execute the corresponding video conference and starts the corresponding video conference thread. The operation log of the video conferencing thread is analyzed to obtain the network area connection progress information of the video conferencing thread, and a video conferencing invitation is sent to the user terminal under the corresponding network area; the invitation response from the user terminal is identified to determine whether the user terminal has video conferencing participation permission, and then the user terminal with video conferencing participation permission is connected to the video conferencing thread.

3. The information processing method based on multi-terminal video conferencing as described in claim 1, characterized in that: Monitor all user terminals connected to the video conferencing thread to determine whether each user terminal is currently online in the video conferencing, including: For all user terminals connected to the video conferencing thread, the video conferencing window status is identified to determine whether the user terminal's video conferencing window meets the preset interface display conditions, which means that the video conferencing window is in the foreground open state on the user terminal's display interface; if yes, it is determined that the user terminal is currently in the video conferencing online state; if no, it is determined that the user terminal is currently not in the video conferencing online state.

4. The information processing method based on multi-terminal video conferencing as described in claim 1, characterized in that: Based on the real-time working status of the user terminal connected to the video conferencing thread, determine whether the user terminal has experienced a video conferencing offline event; When a video conference goes offline, the corresponding messages in the data stream are intercepted so that they can be resent after the user reconnects, including: Real-time network bandwidth usage is identified for user terminals connected to the video conferencing thread to determine the available connection bandwidth between the user terminal and the video conferencing thread; if the available connection bandwidth is less than a preset bandwidth threshold, it is determined that a video conferencing offline event has occurred on the user terminal; otherwise, it is determined that no video conferencing offline event has occurred on the user terminal. When a video conference goes offline, all messages uploaded and added to the data stream link by the user terminal that went offline are marked and intercepted based on the duration of the offline event; and when the user terminal that went offline comes back online, the marked and intercepted messages are resent.

5. The information processing method based on multi-terminal video conferencing as described in claim 4, characterized in that: When a user client that experienced a video conference offline event comes back online, the message intercepted by the identifier is retransmitted, including: Step S1: Let t be the difference between the time of generation and the current time of a message that needs to be resent, in milliseconds; let H be the importance of the message; and let S be the number of historical interactions between the user sending the message and the user receiving the message. Then, the importance score of the message that needs to be resent is: （1） In the above formula (1), Assess the importance of the message that needs to be resent. , , , All are correlation coefficients, and e is the natural constant; Step S2: Let the available bandwidth of the user terminal sending this message be w, the theoretical maximum bandwidth of the user terminal be W, its current network latency be Y, and its current packet loss rate be p. Then the network condition score of the current user terminal is: （2） In the above formula (2), The network condition of the current user terminal is scored, where P is the maximum historical packet loss rate of that user terminal. These are the bandwidth impact coefficient, network latency impact coefficient, and packet loss rate impact coefficient, respectively. Step S3: Based on the calculation results of steps S1 and S2 above, determine the retransmission priority score of the messages that need to be retransmitted. （3） In the above formula (3), The retransmission priority score is assigned to messages that require retransmission, and C is the number of times the message has failed to be sent in the past. All messages that require retransmission are sorted in descending order of their retransmission priority scores. The higher the priority score, the earlier the message is sent. When the K value is less than 0.5, the message will no longer be retransmitted. m and n are the message importance adjustment coefficient and the network condition adjustment coefficient, respectively.

6. An information processing system based on multi-terminal video conferencing, characterized in that, include: The video conferencing thread startup module is used to start the corresponding video conferencing thread of the service platform based on the video conferencing initiation request received by the service platform. The user terminal access control module is used to initiate video conference invitations to different user terminals based on the running status information of the video conference thread, thereby connecting the corresponding user terminals to the video conference thread. The user-end monitoring module is used to monitor all user ends connected to the video conferencing thread and determine whether the user end is currently online in the video conferencing. The message addition and transmission control module is used to add messages to the corresponding data stream links based on the messages uploaded by all user terminals that are online in the video conference, and to adjust the transmission status of all messages under the data stream links in the video conference thread. The video conference offline event determination module is used to determine whether a video conference offline event has occurred on the user terminal based on the real-time working status of the user terminal connected to the video conference thread. The message interception and retransmission control module is used to intercept the corresponding messages in the data stream link when a video conference offline event occurs, so as to retransmit the messages after the user comes back online. The message addition and transmission control module is used to add messages to the corresponding data stream links based on the messages uploaded by all user terminals that are online in the video conference, and to adjust the transmission status of all messages under the data stream links in the video conference thread, including: Identify the messages uploaded by all users who are online in the video conference and obtain the data content type attribute corresponding to each message; Based on the data content type attribute, the message is added to the corresponding data stream link; the amount of added message data is identified in the data stream link to determine whether the data stream link is in a data saturation state; when the data stream link is in a data saturation state, the time axis of all messages transmitted to the video conferencing thread is adjusted based on the generation time of all messages under the data stream link.

7. The information processing system based on multi-terminal video conferencing as described in claim 6, characterized in that: The video conferencing thread startup module is used to start the corresponding video conferencing thread of the service platform based on the video conferencing initiation request received by the service platform, including: The service platform parses and processes the video conference initiation request received to obtain the status information of the participating user terminals in the video conference to be initiated. The status information of the participating user terminals includes the number of participating user terminals and the network location of the user terminals. Based on the status information of the participating user terminals, the service platform predicts the running resources required to execute the corresponding video conference and starts the corresponding video conference thread. The user terminal access control module is used to initiate video conference invitations to different user terminals based on the running status information of the video conferencing thread, thereby connecting the corresponding user terminals to the video conferencing thread, including: The operation log of the video conferencing thread is analyzed to obtain the network area connection progress information of the video conferencing thread, and a video conferencing invitation is sent to the user terminal under the corresponding network area; the invitation response from the user terminal is identified to determine whether the user terminal has video conferencing participation permission, and then the user terminal with video conferencing participation permission is connected to the video conferencing thread.

8. The information processing system based on multi-terminal video conferencing as described in claim 6, characterized in that: The user-end monitoring module is used to monitor all user ends connected to the video conferencing thread and determine whether the user end is currently online in the video conferencing, including: For each user terminal connected to the video conferencing thread, the video conferencing window status is identified to determine whether the user terminal's video conferencing window meets the preset interface display conditions. These preset interface display conditions refer to the video conferencing window being in the foreground on the user terminal's display interface. state If yes, then the user terminal is determined to be currently online in the video conference; if no, then the user terminal is determined to be currently not online in the video conference.

9. The information processing system based on multi-terminal video conferencing as described in claim 6, characterized in that: The video conference offline event determination module is used to determine whether a video conference offline event has occurred on the user terminal based on the real-time working status of the user terminal connected to the video conference thread, including: Real-time network bandwidth usage is identified for user terminals connected to the video conferencing thread to determine the available connection bandwidth between the user terminal and the video conferencing thread; if the available connection bandwidth is less than a preset bandwidth threshold, it is determined that a video conferencing offline event has occurred on the user terminal; otherwise, it is determined that no video conferencing offline event has occurred on the user terminal. The message interception and retransmission control module is used to intercept corresponding messages in the data stream when a video conference goes offline, so as to retransmit the messages after the user comes back online, including: When a video conference goes offline, all messages uploaded and added to the data stream link by the user terminal that went offline are marked and intercepted based on the duration of the offline event; and when the user terminal that went offline comes back online, the marked and intercepted messages are resent.

10. The information processing system based on multi-terminal video conferencing as described in claim 9, characterized in that: When a user client that experienced a video conference offline event comes back online, the message intercepted by the flag will be resent, including: Step S1: Let t be the difference between the time of generation and the current time of a message that needs to be resent, in milliseconds; let H be the importance of the message; and let S be the number of historical interactions between the user sending the message and the user receiving the message. Then, the importance score of the message that needs to be resent is: （1） In the above formula (1), Assess the importance of the message that needs to be resent. , , , All are correlation coefficients, and e is the natural constant; Step S2: Let the available bandwidth of the user terminal sending this message be w, the theoretical maximum bandwidth of the user terminal be W, its current network latency be Y, and its current packet loss rate be p. Then the network condition score of the current user terminal is: （2） In the above formula (2), The network condition of the current user terminal is scored, where P is the maximum historical packet loss rate of that user terminal. These are the bandwidth impact coefficient, network latency impact coefficient, and packet loss rate impact coefficient, respectively. Step S3: Based on the calculation results of steps S1 and S2 above, determine the retransmission priority score of the messages that need to be retransmitted. （3） In the above formula (3), The retransmission priority score is assigned to messages that require retransmission, and C is the number of times the message has failed to be sent in the past. All messages that require retransmission are sorted in descending order of their retransmission priority scores. The higher the priority score, the earlier the message is sent. When the K value is less than 0.5, the message will no longer be retransmitted. m and n are the message importance adjustment coefficient and the network condition adjustment coefficient, respectively.

Images