Information processing method and system based on multi-terminal video conference

By starting the video conference thread in the video conferencing system, monitoring the online status of the user side and processing offline message resend, the information loss problem caused by the user side is solved, and the stability and information integrity of the video conference are achieved.

CN119071422AActive Publication Date: 2024-12-03GUANGZHOU SHIYU COMPUTER TECH CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202411090429.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-09
Publication Date
2024-12-03
Estimated Expiration
2044-08-09

AI Technical Summary

Technical Problem

The existing video conferencing system cannot upload information when the user is offline, resulting in missing information and reducing the information integrity and stability of video conferencing.

Method used

After receiving the video conference initiation request from the service platform, initiate an invitation to the user, monitor the online status of the user, upload messages to the data stream link, adjust the transmission status, and promptly intercept the offline user's messages and inject them. Resend when re-on.

Benefits of technology

Ensure the integrity and stability of information in video conferencing, avoid information loss, and provide stable and reliable video conferencing services for multiple users.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119071422A_ABST
    Figure CN119071422A_ABST
Patent Text Reader

Abstract

The invention provides an information processing method and system based on a multi-terminal video conference, and the method comprises the steps: starting a video conference thread based on a video conference initiation request received by a service platform, and initiating a video conference invitation to different user terminals based on the operation state of the video conference thread, thereby enabling the corresponding user terminals to access the video conference thread; monitoring and judging whether the user sides are in a video conference online state or not, adding messages uploaded by the corresponding user sides to the data stream links, adjusting transmission states of all messages subordinate to the data stream links in a video conference thread, and carrying out distinguished uploading on the corresponding types of messages uploaded by the plurality of user sides; in addition, whether a video conference off-line event happens to the user side or not is judged, the message of the user side where the video conference off-line event happens in the data flow link is intercepted, when the user side is online again, message retransmission is carried out, information missing in the video conference process is avoided, and stable and reliable video conference service is provided for multiple user sides.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of multimedia information processing, and in particular to an information processing method and system based on multi-terminal video conferencing. Background Art

[0002] With the increasing popularity of online office, video conferencing has become the main means of online office. Users can participate in online video conferences and send and receive corresponding messages by connecting to the corresponding online video conferencing port using terminals such as smartphones or laptops. In order to ensure the stability and security of video conferencing, users usually need to use corresponding passwords to obtain access to video conferences. Existing video conferences are all based on real-time processing of information, that is, real-time uploading and displaying of information from different user terminals. This method can effectively reduce the information processing delay of video conferences. However, when the user terminal goes offline during the video conference, the information sent by the user terminal will not be uploaded to the video conference, resulting in information loss during the video conference, reducing the information integrity of the video conference, and failing to provide stable and reliable video conferencing scene services for all user terminals. Summary of the invention

[0003] The purpose of the present invention is to provide an information processing method and system based on multi-terminal video conferencing, which starts a video conferencing thread based on a video conferencing initiation request received by a service platform, and initiates video conferencing invitations to different user terminals based on the running status of the video conferencing thread, so as to connect the corresponding user terminal to the video conferencing thread, so that multiple user terminals can correctly access the corresponding video conference; monitor and determine whether the user terminal is in an online state of the video conference, add the message uploaded by the corresponding user terminal to the data flow link, and adjust the transmission status of all messages under the data flow link in the video conferencing thread, distinguish and upload the corresponding types of messages uploaded by multiple user terminals, and improve the information processing efficiency of the video conference; it also determines whether a video conference offline event occurs on the user terminal, intercepts the message of the user terminal that has a video conference offline event in the data flow link, and resends the message when the user terminal is back online, so as to avoid information loss during the video conference and provide stable and reliable video conferencing services for multiple user terminals.

[0004] The present invention is achieved through the following technical solutions:

[0005] An information processing method based on multi-terminal video conferencing, comprising:

[0006] Based on the video conference initiation request received by the service platform, start the corresponding video conference thread of the service platform; based on the running status information of the video conference thread, initiate video conference invitations to different user terminals, so as to connect the corresponding user terminals to the video conference thread;

[0007] All user terminals connected to the video conference thread are monitored respectively to determine whether the user terminals are currently in an online video conference state; based on messages uploaded by all user terminals in an online video conference state, the messages are added to corresponding data flow links, and the transmission states of all messages under the data flow links in the video conference thread are adjusted;

[0008] Based on the real-time working status of the user terminal connected to the video conference thread, it is determined whether a video conference offline event occurs on the user terminal; when a video conference offline event occurs, the corresponding message in the data stream link is intercepted, so as to resend the message after the user terminal comes back online.

[0009] Optionally, based on the video conference initiation request received by the service platform, starting a corresponding video conference thread of the service platform; based on the running status information of the video conference thread, initiating video conference invitations to different user terminals, thereby connecting the corresponding user terminals to the video conference thread, including:

[0010] Parsing and processing the video conference initiation request received by the service platform to obtain the status information of the user terminals participating in the video conference to be initiated; wherein the status information of the user terminals participating in the video conference includes the number of user terminals participating in the video conference and the network location of the user terminals; based on the status information of the user terminals participating in the video conference, predicting the operating resources required to execute the corresponding video conference, thereby starting the corresponding video conference thread of the service platform;

[0011] The operation log of the video conference thread is analyzed to obtain the network area connection progress information of the video conference thread, and a video conference invitation is initiated to the user terminal under the corresponding network area; the invitation response from the user terminal is identified to determine whether the user terminal has the right to participate in the video conference, so as to connect the user terminal with the right to participate in the video conference to the video conference thread.

[0012] Optionally, all user terminals accessing the video conference thread are monitored respectively to determine whether the user terminals are currently in an online state of the video conference; based on messages uploaded by all user terminals in an online state of the video conference, the messages are added to corresponding data flow links, and the transmission states of all messages under the data flow links in the video conference thread are adjusted, including:

[0013] Performing video conference window status identification on all user terminals connected to the video conference thread respectively, and determining whether the video conference window of the user terminal meets the preset interface display condition; if so, determining that the user terminal is currently in the video conference online state; if not, determining that the user terminal is currently not in the video conference online state;

[0014] Messages uploaded by all users online in a video conference are identified to obtain data content type attributes corresponding to each message; based on the data content type attributes, the messages are added to the corresponding data flow link; the amount of added message data is identified for the data flow link to determine whether the data flow link is in a data saturation state; when the data flow link is in a data saturation state, the timeline for transmitting all messages to the video conference thread is adjusted based on the generation time of all messages under the data flow link.

[0015] Optionally, based on the real-time working status of the user terminal accessing the video conference thread, determining whether a video conference offline event occurs on the user terminal; when a video conference offline event occurs, intercepting a corresponding message in the data stream link, so as to perform a message resending operation after the user terminal comes back online, including:

[0016] Performing real-time network bandwidth usage identification on the user terminal accessing the video conference thread to determine the available connection bandwidth between the user terminal and the video conference thread; if the available connection bandwidth is less than a preset bandwidth threshold, determining that a video conference offline event has occurred on the user terminal; otherwise, determining that no video conference offline event has occurred on the user terminal;

[0017] When a video conference offline event occurs, all messages uploaded and added to the data flow link by the user end where the video conference offline event occurs are marked and intercepted based on the duration of the video conference offline event; and when the user end where the video conference offline event occurs comes back online, the marked and intercepted messages are resent.

[0018] Optionally, when the user terminal where the video conference offline event occurs comes back online, the message marked as intercepted is resent, including:

[0019] Step S1, assuming that the difference between the time when a message that needs to be resent is generated and the current time is t, in milliseconds, the importance of the message is H, and the number of historical interactions between the user who sent the message and the user who received the message is S, then the importance score of the message that needs to be resent is:

[0020]

[0021] In the above formula (1), I is the importance score of the message that needs to be resent, α, β, γ, δ are all correlation coefficients, and e is a natural constant;

[0022] Step S2: Assume that the current available bandwidth of the user end sending this message is w, the theoretical maximum bandwidth of the user end is W, the current network delay is Y, and the current packet loss rate is p. Then the network status score of the current user end is:

[0023]

[0024] In the above formula (2), F is the network status score of the current user end, P is the historical maximum packet loss rate of the user end, a, b, and c are the bandwidth impact coefficient, network delay impact coefficient, and packet loss rate impact coefficient, respectively;

[0025] Step S2, based on the calculation results of the above steps S1 and S2, determine the retransmission priority score of the message that needs to be retransmitted.

[0026]

[0027] In the above formula (3), K is the retransmission priority score of the message that needs to be retransmitted, and C is the number of historical transmission failures. All messages that need to be retransmitted are sorted in reverse order according to the retransmission priority score. The higher the priority score, the higher the priority of transmission. When the K value is less than 0.5, the message will no longer be retransmitted. m and n are the message importance adjustment coefficient and the network status adjustment coefficient, respectively.

[0028] An information processing system based on multi-terminal video conferencing, comprising:

[0029] A video conference thread starting module, used to start the corresponding video conference thread of the service platform based on the video conference initiation request received by the service platform;

[0030] A user terminal access control module, used to initiate video conference invitations to different user terminals based on the running status information of the video conference thread, so as to connect the corresponding user terminals to the video conference thread;

[0031] A user terminal monitoring module is used to monitor all user terminals connected to the video conference thread respectively to determine whether the user terminal is currently in an online state of the video conference;

[0032] A message adding and transmission control module, used to add the messages uploaded by all the users in the online video conference to the corresponding data flow link, and adjust the transmission status of all the messages under the data flow link in the video conference thread;

[0033] A conference offline event judgment module, used to judge whether a video conference offline event occurs on the user end based on the real-time working status of the user end accessing the video conference thread;

[0034] The message interception and retransmission control module is used to intercept the corresponding message in the data stream link when a video conference offline event occurs, so as to perform a message retransmission operation after the user terminal comes back online.

[0035] Optionally, the video conference thread starting module is used to start the corresponding video conference thread of the service platform based on the video conference initiation request received by the service platform, including:

[0036] Parsing and processing the video conference initiation request received by the service platform to obtain the status information of the user terminals participating in the video conference to be initiated; wherein the status information of the user terminals participating in the video conference includes the number of user terminals participating in the video conference and the network location of the user terminals; based on the status information of the user terminals participating in the video conference, predicting the operating resources required to execute the corresponding video conference, thereby starting the corresponding video conference thread of the service platform;

[0037] The user terminal access control module is used to initiate video conference invitations to different user terminals based on the running status information of the video conference thread, so as to connect the corresponding user terminals to the video conference thread, including:

[0038] The operation log of the video conference thread is analyzed to obtain the network area connection progress information of the video conference thread, and a video conference invitation is initiated to the user terminal under the corresponding network area; the invitation response from the user terminal is identified to determine whether the user terminal has the right to participate in the video conference, so as to connect the user terminal with the right to participate in the video conference to the video conference thread.

[0039] Optionally, the user terminal monitoring module is used to monitor all user terminals connected to the video conference thread respectively to determine whether the user terminal is currently in an online state of the video conference, including:

[0040] Performing video conference window status identification on all user terminals connected to the video conference thread respectively, and determining whether the video conference window of the user terminal meets the preset interface display condition; if so, determining that the user terminal is currently in the video conference online state; if not, determining that the user terminal is currently not in the video conference online state;

[0041] The message adding and transmission control module is used to add the message to the corresponding data flow link based on the messages uploaded by all the user terminals in the online state of the video conference, and adjust the transmission status of all the messages under the data flow link in the video conference thread, including:

[0042] Messages uploaded by all users online in a video conference are identified to obtain data content type attributes corresponding to each message; based on the data content type attributes, the messages are added to the corresponding data flow link; the amount of added message data is identified for the data flow link to determine whether the data flow link is in a data saturation state; when the data flow link is in a data saturation state, the timeline for transmitting all messages to the video conference thread is adjusted based on the generation time of all messages under the data flow link.

[0043] Optionally, the conference offline event judgment module is used to judge whether a video conference offline event occurs at the user terminal based on the real-time working status of the user terminal accessing the video conference thread, including:

[0044] Performing real-time network bandwidth usage identification on the user terminal accessing the video conference thread to determine the available connection bandwidth between the user terminal and the video conference thread; if the available connection bandwidth is less than a preset bandwidth threshold, determining that a video conference offline event has occurred on the user terminal; otherwise, determining that no video conference offline event has occurred on the user terminal;

[0045] The message interception and retransmission control module is used to intercept the corresponding message in the data stream link when a video conference offline event occurs, so as to perform a message retransmission operation after the user terminal comes back online, including:

[0046] When a video conference offline event occurs, all messages uploaded and added to the data flow link by the user end where the video conference offline event occurs are marked and intercepted based on the duration of the video conference offline event; and when the user end where the video conference offline event occurs comes back online, the marked and intercepted messages are resent.

[0047] Optionally, when the user terminal where the video conference offline event occurs comes back online, the message marked as intercepted is resent, including:

[0048] Step S1, assuming that the difference between the time when a message that needs to be resent is generated and the current time is t, in milliseconds, the importance of the message is H, and the number of historical interactions between the user who sent the message and the user who received the message is S, then the importance score of the message that needs to be resent is:

[0049]

[0050] In the above formula (1), I is the importance score of the message that needs to be resent, α, β, γ, δ are all correlation coefficients, and e is a natural constant;

[0051] Step S2: Assume that the current available bandwidth of the user end sending this message is w, the theoretical maximum bandwidth of the user end is W, the current network delay is Y, and the current packet loss rate is p. Then the network status score of the current user end is:

[0052]

[0053] In the above formula (2), F is the network status score of the current user end, P is the historical maximum packet loss rate of the user end, a, b, and c are the bandwidth impact coefficient, network delay impact coefficient, and packet loss rate impact coefficient, respectively;

[0054] Step S2, based on the calculation results of the above steps S1 and S2, determine the retransmission priority score of the message that needs to be retransmitted.

[0055]

[0056] In the above formula (3), K is the retransmission priority score of the message that needs to be retransmitted, and C is the number of historical transmission failures. All messages that need to be retransmitted are sorted in reverse order according to the retransmission priority score. The higher the priority score, the higher the priority of transmission. When the K value is less than 0.5, the message will no longer be retransmitted. m and n are the message importance adjustment coefficient and the network status adjustment coefficient, respectively.

[0057] Compared with the prior art, the present invention has the following beneficial effects:

[0058] The present application provides an information processing method and system based on multi-terminal video conferencing. Based on a video conference initiation request received by a service platform, the method and system start a video conference thread, and based on the running status of the video conference thread, initiate video conference invitations to different user terminals, thereby connecting the corresponding user terminal to the video conference thread, so that multiple user terminals can correctly access the corresponding video conference; monitor and determine whether the user terminal is in an online state of the video conference, add the message uploaded by the corresponding user terminal to the data flow link, and adjust the transmission status of all messages under the data flow link in the video conference thread, distinguish and upload the corresponding types of messages uploaded by multiple user terminals, and improve the information processing efficiency of the video conference; also determine whether a video conference offline event occurs on the user terminal, intercept the message of the user terminal that has the video conference offline event in the data flow link, and resend the message when the user terminal is back online, so as to avoid information loss during the video conference and provide stable and reliable video conferencing services for multiple user terminals. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the prior art descriptions. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. Among them:

[0060] Figure 1 A flowchart of an information processing method based on multi-terminal video conferencing provided by the present invention.

[0061] Figure 2 A structural schematic diagram of an information processing system based on multi-terminal video conferencing provided by the present invention. DETAILED DESCRIPTION

[0062] In order to make the above-mentioned purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are described in detail below in conjunction with the accompanying drawings. It is to be understood that the specific embodiments described herein are only used to explain the present application, rather than to limit the present application. It should also be noted that, for ease of description, only some structures related to the present application are shown in the accompanying drawings, rather than all structures. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0063] The terms "including" and "having" and any variations thereof in this application are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices.

[0064] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0065] See also Figure 1 As shown, an information processing method based on multi-terminal video conferencing is provided in one embodiment of the present application. The information processing method based on multi-terminal video conferencing includes:

[0066] Based on the video conference initiation request received by the service platform, the corresponding video conference thread of the service platform is started; based on the running status information of the video conference thread, video conference invitations are initiated to different user terminals, so as to connect the corresponding user terminals to the video conference thread;

[0067] Monitor all user terminals connected to the video conference thread respectively to determine whether the user terminal is currently in the online state of the video conference; based on the messages uploaded by all user terminals in the online state of the video conference, add the messages to the corresponding data flow link, and adjust the transmission status of all messages under the data flow link in the video conference thread;

[0068] Based on the real-time working status of the user terminal connected to the video conference thread, it is determined whether a video conference offline event occurs at the user terminal; when a video conference offline event occurs, the corresponding message in the data stream link is intercepted, so as to resend the message after the user terminal comes back online.

[0069] The beneficial effects of the above embodiments are as follows: the information processing method based on multi-terminal video conferencing starts a video conferencing thread based on a video conferencing initiation request received by a service platform, and initiates video conferencing invitations to different user terminals based on the running status of the video conferencing thread, thereby connecting the corresponding user terminal to the video conferencing thread, so that multiple user terminals can correctly access the corresponding video conference; monitors and determines whether the user terminal is in an online state of the video conference, adds the message uploaded by the corresponding user terminal to the data flow link, and adjusts the transmission status of all messages under the data flow link in the video conferencing thread, distinguishes and uploads the corresponding types of messages uploaded by multiple user terminals, and improves the information processing efficiency of the video conference; it also determines whether a video conference offline event occurs on the user terminal, intercepts the message in the data flow link of the user terminal where the video conference offline event occurs, and resends the message when the user terminal is back online, so as to avoid information loss during the video conference and provide stable and reliable video conferencing services for multiple user terminals.

[0070] In another embodiment, based on the video conference initiation request received by the service platform, starting the corresponding video conference thread of the service platform; based on the running status information of the video conference thread, initiating video conference invitations to different user terminals, thereby connecting the corresponding user terminals to the video conference thread, including:

[0071] Parsing and processing the video conference initiation request received by the service platform to obtain the status information of the user terminals participating in the video conference to be initiated; wherein the status information of the user terminals participating in the video conference includes the number of user terminals participating in the video conference and the network location of the user terminals; based on the status information of the user terminals participating in the video conference, predicting the operating resources required to execute the corresponding video conference, thereby starting the corresponding video conference thread of the service platform;

[0072] The operation log of the video conference thread is analyzed to obtain the network area connection progress information of the video conference thread, and a video conference invitation is initiated to the user terminal under the corresponding network area; the invitation response from the user terminal is identified to determine whether the user terminal has the right to participate in the video conference, so as to connect the user terminal with the right to participate in the video conference to the video conference thread.

[0073] The beneficial effect of the above embodiment is that during the actual video conference, the service platform acts as a control platform for all user terminals participating in the video conference. It can process messages generated by different user terminals during the video conference, realize information interaction between different user terminals, and each user terminal has the authority to initiate a video conference invitation through the service platform. In order to ensure that the corresponding user terminal can participate in the video conference in a timely manner, the video conference request received by the service platform is parsed and processed to obtain the status information of the user terminals participating in the video conference to be initiated, that is, the status information of all user terminals expected to participate in the currently initiated video conference is determined, wherein the status information of the user terminals participating in the video conference includes the number of user terminals participating in the video conference and the network location of the user terminals, so that the memory resources and network resources required for the subsequent operation of the video conference can be accurately predicted. Then, based on the status information of the user terminals participating in the video conference, the memory resources and network resources required to execute the corresponding video conference are predicted, so that the corresponding memory resources and network resources are called within the service platform to start the corresponding video conference thread, so as to ensure that the service platform can ensure the stable and continuous operation of the video conference. The operation log of the video conference thread is also analyzed to obtain the network area connection progress information of the video conference thread (that is, the connection speed information of the video conference thread with different network areas during operation), so as to initiate video conference invitations to the user terminals under the corresponding network areas in turn; and the invitation response from the user terminal is identified to obtain the identity information of the user terminal, and the identity information is compared with the preset identity information whitelist. If the identity information exists in the preset identity information whitelist, it is determined that the user terminal has the right to participate in the video conference; otherwise, it is determined that the user terminal does not have the right to participate in the video conference, so that the user terminal with the right to participate in the video conference is connected to the video conference thread, so as to ensure that the corresponding user terminal can go online to the video conference in time.

[0074] In another embodiment, all user terminals accessing the video conference thread are monitored respectively to determine whether the user terminal is currently in an online state of the video conference; based on messages uploaded by all user terminals in the online state of the video conference, the messages are added to the corresponding data flow link, and the transmission status of all messages under the data flow link in the video conference thread is adjusted, including:

[0075] Perform video conference window status identification on all user terminals connected to the video conference thread to determine whether the video conference window of the user terminal meets the preset interface display conditions; if so, determine that the user terminal is currently in the video conference online state; if not, determine that the user terminal is currently not in the video conference online state;

[0076] Messages uploaded by all users online in a video conference are identified to obtain data content type attributes corresponding to each message; based on the data content type attributes, the message is added to the corresponding data flow link; the amount of added message data is identified for the data flow link to determine whether the data flow link is in a data saturation state; when the data flow link is in a data saturation state, the timeline of all message transmissions to the video conference thread is adjusted based on the generation time of all messages under the data flow link.

[0077] The beneficial effect of the above embodiment is that the user terminal can be but not limited to a smart phone or a laptop held by the user terminal. The user terminal will also start other software while participating in the video conference, so that the user terminal will not always maintain the window of the software corresponding to the video conference in the front open state during the entire video conference. In order to ensure that the video conference information is transmitted only when the user terminal puts the window of the software corresponding to the video conference in the front open state, the video conference window state is identified for all user terminals connected to the video conference thread, and it is determined whether the video conference window of the user terminal meets the preset interface display condition (the preset interface display condition refers to the video conference window in the display interface of the user terminal is in the front open state), so as to accurately determine whether the user terminal is currently in the video conference online state, and ensure that the messages uploaded by all user terminals in the video conference online state are effectively distinguished and uploaded. The messages uploaded by all user terminals in the video conference online state are identified, and the data content type attribute corresponding to each message is obtained, so that the message is added to the corresponding data flow link, and the classified upload of messages with different contents is realized. In addition, the amount of added message data is identified for the data flow link to determine whether the data flow link is in a data saturation state (i.e., whether the amount of data on the data flow link exceeds a preset data volume threshold). When the data flow link is in a data saturation state, it indicates that the data flow link cannot currently continue to receive new messages, otherwise message overflow and loss will occur. At this time, based on the generation time of all messages under the data flow link, the timeline for transmitting all messages to the video conference thread is adjusted, and all messages under the data flow link are transmitted to the video conference thread in sequence according to the timeline, to ensure that the video conference thread can display the corresponding messages in an orderly manner.

[0078] In another embodiment, based on the real-time working status of the user terminal accessing the video conference thread, it is determined whether the user terminal has a video conference offline event; when the video conference offline event occurs, the corresponding message in the data stream link is intercepted, so as to perform a message resending operation after the user terminal comes back online, including:

[0079] Performing real-time network bandwidth usage identification on the user terminal accessing the video conference thread to determine the available connection bandwidth between the user terminal and the video conference thread; if the available connection bandwidth is less than a preset bandwidth threshold, determining that a video conference offline event has occurred on the user terminal; otherwise, determining that no video conference offline event has occurred on the user terminal;

[0080] When a video conference offline event occurs, all messages uploaded and added to the data flow link by the user end where the video conference offline event occurred are marked and intercepted based on the duration of the video conference offline event; and when the user end where the video conference offline event occurred comes back online, the messages marked and intercepted are resent.

[0081] The beneficial effect of the above embodiment is that the user terminal needs to have a sufficiently large connection bandwidth with the video conference thread to ensure effective and stable information interaction between the user terminal and the video conference thread. If the connection bandwidth between the user terminal and the video conference thread is small, the continuous real-time information interaction between the user terminal and the video conference thread cannot be guaranteed, resulting in the substantial offline between the user terminal and the video conference thread. By identifying the real-time network bandwidth usage of the user terminal connected to the video conference thread, determining the available connection bandwidth between the user terminal and the video conference thread, and comparing the threshold of the available connection bandwidth, it is judged whether the user terminal has a video conference offline event, so as to facilitate the subsequent interception of messages that need to be uploaded by the corresponding user terminal during the offline period. In addition, when a video conference offline event occurs, based on the duration of the video conference offline event, all messages uploaded and added to the data flow link by the user terminal where the video conference offline event occurs are marked and intercepted, and when the user terminal where the video conference offline event occurs is back online, the message marked and intercepted is resent to avoid information loss during the video conference, and provide stable and reliable video conferencing services for multiple user terminals.

[0082] In another embodiment, when the user terminal where the video conference is offline comes back online, the message intercepted by the identifier is resent, including:

[0083] Step S1, assuming that the difference between the time when a message that needs to be resent is generated and the current time is t, in milliseconds, the importance of the message is H, and the number of historical interactions between the user who sent the message and the user who received the message is S, then the importance score of the message that needs to be resent is:

[0084]

[0085] In the above formula (1), I is the importance score of the message that needs to be resent, α, β, γ, and δ are all correlation coefficients, and their values ​​can be adjusted according to actual conditions. e is a natural constant. The importance of the message that needs to be resent is comprehensively scored based on factors such as the timeliness of the message that needs to be resent, the relationship between the sender and the receiver, etc., which can more accurately evaluate the importance of the message and provide a data basis for the priority of the subsequent resent messages.

[0086] Step S2: Assume that the current available bandwidth of the user end sending this message is w, the theoretical maximum bandwidth of the user end is W, the current network delay is Y, and the current packet loss rate is p. Then the network status score of the current user end is:

[0087]

[0088] In the above formula (2), F is the network status score of the current user end, P is the historical maximum packet loss rate of the user end, a, b, and c are the bandwidth impact coefficient, network delay impact coefficient, and packet loss rate impact coefficient respectively; based on the user's bandwidth, network delay, packet loss rate and other information, a comprehensive assessment of its network status is conducted, providing data support for the subsequent efficient use of network resources to avoid resource waste;

[0089] Step S2, based on the calculation results of the above steps S1 and S2, determine the retransmission priority score of the message that needs to be retransmitted.

[0090]

[0091] In the above formula (3), K is the retransmission priority score of the message that needs to be retransmitted, and C is the number of historical sending failures. All messages that need to be retransmitted are arranged in reverse order according to the retransmission priority score. The higher the priority score, the higher the priority of sending. When the K value is less than 0.5, the message will no longer be retransmitted. m and n are the message importance adjustment coefficient and the network status adjustment coefficient, respectively, and their values ​​can be adjusted according to actual conditions. The message retransmission priority is scientifically scored according to the current network status, the importance of the message and the historical sending failure, ensuring that important messages are retransmitted first, improving the efficiency of system resource utilization, and avoiding resource waste and network congestion.

[0092] The beneficial effects of the above embodiments are that frequent retransmissions may cause a sharp increase in network traffic, especially when a large number of users are online at the same time, which may cause network congestion. At the same time, the server needs to process a large number of retransmission requests, which may lead to excessive consumption of server resources (such as CPU, memory and bandwidth), affecting the stability and response speed of the server, and then causing users to feel frustrated due to message delays and unstable communications, reducing their overall satisfaction with the service, and thus causing huge losses. In order to avoid the above situation, when the user end of the video conference offline event comes back online, the message that is marked as intercepted is retransmitted; the message retransmission priority and whether to retransmit are scientifically evaluated based on the current network status, the importance of the message and the historical sending failure, avoiding the sharp increase in network traffic and network congestion caused by frequent retransmissions, while improving the stability and response speed of the server, avoiding users from feeling frustrated due to message delays and unstable communications, and reducing overall satisfaction.

[0093] See also Figure 2 As shown, an information processing system based on multi-terminal video conferencing is provided in one embodiment of the present application. The information processing system based on multi-terminal video conferencing includes:

[0094] A video conference thread starting module, used to start the corresponding video conference thread of the service platform based on the video conference initiation request received by the service platform;

[0095] A user terminal access control module is used to initiate video conference invitations to different user terminals based on the running status information of the video conference thread, thereby connecting the corresponding user terminals to the video conference thread;

[0096] The user end monitoring module is used to monitor all the user ends connected to the video conference thread respectively to determine whether the user end is currently in the video conference online state;

[0097] A message adding and transmission control module, which is used to add messages uploaded by all users in the online video conference to the corresponding data flow link, and adjust the transmission status of all messages under the data flow link in the video conference thread;

[0098] A conference offline event judgment module, used to judge whether a video conference offline event occurs at the user end based on the real-time working status of the user end accessing the video conference thread;

[0099] The message interception and retransmission control module is used to intercept the corresponding message in the data stream link when a video conference offline event occurs, so as to retransmit the message after the user terminal comes back online.

[0100] The beneficial effects of the above embodiments are as follows: the information processing system based on multi-terminal video conferencing starts a video conferencing thread based on a video conferencing initiation request received by a service platform, and initiates video conferencing invitations to different user terminals based on the running status of the video conferencing thread, thereby connecting the corresponding user terminal to the video conferencing thread, so that multiple user terminals can correctly access the corresponding video conference; monitors and determines whether the user terminal is in an online state of the video conference, adds the message uploaded by the corresponding user terminal to the data flow link, and adjusts the transmission status of all messages under the data flow link in the video conferencing thread, distinguishes and uploads the corresponding types of messages uploaded by multiple user terminals, and improves the information processing efficiency of the video conference; it also determines whether a video conference offline event occurs on the user terminal, intercepts the message in the data flow link of the user terminal where the video conference offline event occurs, and resends the message when the user terminal is back online, thereby avoiding information loss during the video conference and providing stable and reliable video conferencing services for multiple user terminals.

[0101] In another embodiment, the video conference thread starting module is used to start the corresponding video conference thread of the service platform based on the video conference initiation request received by the service platform, including:

[0102] Parsing and processing the video conference initiation request received by the service platform to obtain the status information of the user terminals participating in the video conference to be initiated; wherein the status information of the user terminals participating in the video conference includes the number of user terminals participating in the video conference and the network location of the user terminals; based on the status information of the user terminals participating in the video conference, predicting the operating resources required to execute the corresponding video conference, thereby starting the corresponding video conference thread of the service platform;

[0103] The user terminal access control module is used to initiate video conference invitations to different user terminals based on the running status information of the video conference thread, so as to connect the corresponding user terminals to the video conference thread, including:

[0104] The operation log of the video conference thread is analyzed to obtain the network area connection progress information of the video conference thread, and a video conference invitation is initiated to the user terminal under the corresponding network area; the invitation response from the user terminal is identified to determine whether the user terminal has the right to participate in the video conference, so as to connect the user terminal with the right to participate in the video conference to the video conference thread.

[0105] The beneficial effect of the above embodiment is that during the actual video conference, the service platform acts as a control platform for all user terminals participating in the video conference. It can process messages generated by different user terminals during the video conference, realize information interaction between different user terminals, and each user terminal has the authority to initiate a video conference invitation through the service platform. In order to ensure that the corresponding user terminal can participate in the video conference in a timely manner, the video conference request received by the service platform is parsed and processed to obtain the status information of the user terminals participating in the video conference to be initiated, that is, the status information of all user terminals expected to participate in the currently initiated video conference is determined, wherein the status information of the user terminals participating in the video conference includes the number of user terminals participating in the video conference and the network location of the user terminals, so that the memory resources and network resources required for the subsequent operation of the video conference can be accurately predicted. Then, based on the status information of the user terminals participating in the video conference, the memory resources and network resources required to execute the corresponding video conference are predicted, so that the corresponding memory resources and network resources are called within the service platform to start the corresponding video conference thread, so as to ensure that the service platform can ensure the stable and continuous operation of the video conference. The operation log of the video conference thread is also analyzed to obtain the network area connection progress information of the video conference thread (that is, the connection speed information of the video conference thread with different network areas during operation), so as to initiate video conference invitations to the user terminals under the corresponding network areas in turn; and the invitation response from the user terminal is identified to obtain the identity information of the user terminal, and the identity information is compared with the preset identity information whitelist. If the identity information exists in the preset identity information whitelist, it is determined that the user terminal has the right to participate in the video conference; otherwise, it is determined that the user terminal does not have the right to participate in the video conference, so that the user terminal with the right to participate in the video conference is connected to the video conference thread, so as to ensure that the corresponding user terminal can go online to the video conference in time.

[0106] In another embodiment, the user terminal monitoring module is used to monitor all user terminals connected to the video conference thread respectively to determine whether the user terminal is currently in the video conference online state, including:

[0107] Perform video conference window status identification on all user terminals connected to the video conference thread to determine whether the video conference window of the user terminal meets the preset interface display conditions; if so, determine that the user terminal is currently in the video conference online state; if not, determine that the user terminal is currently not in the video conference online state;

[0108] The message adding and transmission control module is used to add the message to the corresponding data flow link based on the message uploaded by all the user terminals in the online state of the video conference, and adjust the transmission status of all the messages under the data flow link in the video conference thread, including:

[0109] Messages uploaded by all users online in a video conference are identified to obtain data content type attributes corresponding to each message; based on the data content type attributes, the message is added to the corresponding data flow link; the amount of added message data is identified for the data flow link to determine whether the data flow link is in a data saturation state; when the data flow link is in a data saturation state, the timeline of all message transmissions to the video conference thread is adjusted based on the generation time of all messages under the data flow link.

[0110] The beneficial effect of the above embodiment is that the user terminal can be but not limited to a smart phone or a laptop held by the user terminal. The user terminal will also start other software while participating in the video conference, so that the user terminal will not always maintain the window of the software corresponding to the video conference in the front open state during the entire video conference. In order to ensure that the video conference information is transmitted only when the user terminal puts the window of the software corresponding to the video conference in the front open state, the video conference window state is identified for all user terminals connected to the video conference thread, and it is determined whether the video conference window of the user terminal meets the preset interface display condition (the preset interface display condition refers to the video conference window in the display interface of the user terminal is in the front open state), so as to accurately determine whether the user terminal is currently in the video conference online state, and ensure that the messages uploaded by all user terminals in the video conference online state are effectively distinguished and uploaded. The messages uploaded by all user terminals in the video conference online state are identified, and the data content type attribute corresponding to each message is obtained, so that the message is added to the corresponding data flow link, and the classified upload of messages with different contents is realized. In addition, the amount of added message data is identified for the data flow link to determine whether the data flow link is in a data saturation state (i.e., whether the amount of data on the data flow link exceeds a preset data volume threshold). When the data flow link is in a data saturation state, it indicates that the data flow link cannot currently continue to receive new messages, otherwise message overflow and loss will occur. At this time, based on the generation time of all messages under the data flow link, the timeline for transmitting all messages to the video conference thread is adjusted, and all messages under the data flow link are transmitted to the video conference thread in sequence according to the timeline, to ensure that the video conference thread can display the corresponding messages in an orderly manner.

[0111] In another embodiment, the conference offline event determination module is used to determine whether a video conference offline event occurs at the user terminal based on the real-time working status of the user terminal accessing the video conference thread, including:

[0112] Performing real-time network bandwidth usage identification on the user terminal accessing the video conference thread to determine the available connection bandwidth between the user terminal and the video conference thread; if the available connection bandwidth is less than a preset bandwidth threshold, determining that a video conference offline event has occurred on the user terminal; otherwise, determining that no video conference offline event has occurred on the user terminal;

[0113] The message interception and retransmission control module is used to intercept the corresponding message in the data stream link when a video conference offline event occurs, so as to perform a message retransmission operation after the user terminal comes back online, including:

[0114] When a video conference offline event occurs, all messages uploaded and added to the data flow link by the user end where the video conference offline event occurred are marked and intercepted based on the duration of the video conference offline event; and when the user end where the video conference offline event occurred comes back online, the messages marked and intercepted are resent.

[0115] The beneficial effect of the above embodiment is that the user terminal needs to have a sufficiently large connection bandwidth with the video conference thread to ensure effective and stable information interaction between the user terminal and the video conference thread. If the connection bandwidth between the user terminal and the video conference thread is small, the continuous real-time information interaction between the user terminal and the video conference thread cannot be guaranteed, resulting in the substantial offline between the user terminal and the video conference thread. By identifying the real-time network bandwidth usage of the user terminal connected to the video conference thread, determining the available connection bandwidth between the user terminal and the video conference thread, and comparing the threshold of the available connection bandwidth, it is judged whether the user terminal has a video conference offline event, so as to facilitate the subsequent interception of messages that need to be uploaded by the corresponding user terminal during the offline period. In addition, when a video conference offline event occurs, based on the duration of the video conference offline event, all messages uploaded and added to the data flow link by the user terminal where the video conference offline event occurs are marked and intercepted, and when the user terminal where the video conference offline event occurs is back online, the message marked and intercepted is resent to avoid information loss during the video conference, and provide stable and reliable video conferencing services for multiple user terminals.

[0116] In another embodiment, when the user terminal where the video conference is offline comes back online, the message intercepted by the identifier is resent, including:

[0117] Step S1, assuming that the difference between the time when a message that needs to be resent is generated and the current time is t, in milliseconds, the importance of the message is H, and the number of historical interactions between the user who sent the message and the user who received the message is S, then the importance score of the message that needs to be resent is:

[0118]

[0119] In the above formula (1), I is the importance score of the message that needs to be resent, α, β, γ, and δ are all correlation coefficients, and their values ​​can be adjusted according to actual conditions. e is a natural constant. The importance of the message that needs to be resent is comprehensively scored based on factors such as the timeliness of the message that needs to be resent, the relationship between the sender and the receiver, etc., which can more accurately evaluate the importance of the message and provide a data basis for the priority of the subsequent resent messages.

[0120] Step S2: Assume that the current available bandwidth of the user end sending this message is w, the theoretical maximum bandwidth of the user end is W, the current network delay is Y, and the current packet loss rate is p. Then the network status score of the current user end is:

[0121]

[0122] In the above formula (2), F is the network status score of the current user end, P is the historical maximum packet loss rate of the user end, a, b, and c are the bandwidth impact coefficient, network delay impact coefficient, and packet loss rate impact coefficient respectively; based on the user's bandwidth, network delay, packet loss rate and other information, a comprehensive assessment of its network status is conducted, providing data support for the subsequent efficient use of network resources to avoid resource waste;

[0123] Step S2, based on the calculation results of the above steps S1 and S2, determine the retransmission priority score of the message that needs to be retransmitted.

[0124]

[0125] In the above formula (3), K is the retransmission priority score of the message that needs to be retransmitted, and C is the number of historical sending failures. All messages that need to be retransmitted are arranged in reverse order according to the retransmission priority score. The higher the priority score, the higher the priority of sending. When the K value is less than 0.5, the message will no longer be retransmitted. m and n are the message importance adjustment coefficient and the network status adjustment coefficient, respectively, and their values ​​can be adjusted according to actual conditions. The message retransmission priority is scientifically scored according to the current network status, the importance of the message and the historical sending failure, ensuring that important messages are retransmitted first, improving the efficiency of system resource utilization, and avoiding resource waste and network congestion.

[0126] The beneficial effects of the above embodiments are that frequent retransmissions may cause a sharp increase in network traffic, especially when a large number of users are online at the same time, which may cause network congestion. At the same time, the server needs to process a large number of retransmission requests, which may lead to excessive consumption of server resources (such as CPU, memory and bandwidth), affecting the stability and response speed of the server, and then causing users to feel frustrated due to message delays and unstable communications, reducing their overall satisfaction with the service, and thus causing huge losses. In order to avoid the above situation, when the user end of the video conference offline event comes back online, the message that is marked as intercepted is retransmitted; the message retransmission priority and whether to retransmit are scientifically evaluated based on the current network status, the importance of the message and the historical sending failure, avoiding the sharp increase in network traffic and network congestion caused by frequent retransmissions, while improving the stability and response speed of the server, avoiding users from feeling frustrated due to message delays and unstable communications, and reducing overall satisfaction.

[0127] In general, the information processing method and system based on multi-terminal video conferencing starts a video conferencing thread based on a video conferencing initiation request received by a service platform, and initiates video conferencing invitations to different user terminals based on the running status of the video conferencing thread, thereby connecting the corresponding user terminal to the video conferencing thread, so that multiple user terminals can correctly access the corresponding video conference; monitors and determines whether the user terminal is in an online state of the video conference, adds the message uploaded by the corresponding user terminal to the data flow link, and adjusts the transmission status of all messages under the data flow link in the video conferencing thread, distinguishes and uploads the corresponding types of messages uploaded by multiple user terminals, and improves the information processing efficiency of the video conference; it also determines whether a video conference offline event occurs on the user terminal, intercepts the message of the user terminal that has a video conference offline event in the data flow link, and resends the message when the user terminal is back online, so as to avoid information loss during the video conference and provide stable and reliable video conferencing services for multiple user terminals.

[0128] The above is only a specific implementation of the present invention, and any other improvements made based on the concept of the present invention are considered to be within the protection scope of the present invention.

Claims

1. An information processing method based on multi-terminal video conferencing, characterized in that: include: Based on the video conference initiation request received by the service platform, start the corresponding video conference thread of the service platform; based on the running status information of the video conference thread, initiate video conference invitations to different user terminals, so as to connect the corresponding user terminals to the video conference thread; All user terminals connected to the video conference thread are monitored respectively to determine whether the user terminals are currently in an online video conference state; based on messages uploaded by all user terminals in an online video conference state, the messages are added to corresponding data flow links, and the transmission states of all messages under the data flow links in the video conference thread are adjusted; Based on the real-time working status of the user terminal accessing the video conference thread, determining whether a video conference offline event occurs on the user terminal; When a video conference offline event occurs, the corresponding message in the data stream link is intercepted, so as to perform a message resending operation after the user terminal comes back online.

2. The information processing method based on multi-terminal video conferencing according to claim 1, characterized in that: Based on the video conference initiation request received by the service platform, the corresponding video conference thread of the service platform is started; based on the running status information of the video conference thread, video conference invitations are initiated to different user terminals, so as to connect the corresponding user terminals to the video conference thread, including: Parsing and processing the video conference initiation request received by the service platform to obtain the status information of the user terminals participating in the video conference to be initiated; wherein the status information of the user terminals participating in the video conference includes the number of user terminals participating in the video conference and the network location of the user terminals; based on the status information of the user terminals participating in the video conference, predicting the operating resources required to execute the corresponding video conference, thereby starting the corresponding video conference thread of the service platform; The operation log of the video conference thread is analyzed to obtain the network area connection progress information of the video conference thread, and a video conference invitation is initiated to the user terminal under the corresponding network area; the invitation response from the user terminal is identified to determine whether the user terminal has the right to participate in the video conference, so as to connect the user terminal with the right to participate in the video conference to the video conference thread.

3. The information processing method based on multi-terminal video conferencing according to claim 1, characterized in that: All user terminals accessing the video conference thread are monitored respectively to determine whether the user terminals are currently in an online state of the video conference; based on messages uploaded by all user terminals in an online state of the video conference, the messages are added to corresponding data flow links, and the transmission states of all messages under the data flow links in the video conference thread are adjusted, including: Performing video conference window status identification on all user terminals connected to the video conference thread respectively, and determining whether the video conference window of the user terminal meets the preset interface display condition; if so, determining that the user terminal is currently in the video conference online state; if not, determining that the user terminal is currently not in the video conference online state; Messages uploaded by all users online in a video conference are identified to obtain data content type attributes corresponding to each message; based on the data content type attributes, the messages are added to the corresponding data flow link; the amount of added message data is identified for the data flow link to determine whether the data flow link is in a data saturation state; when the data flow link is in a data saturation state, the timeline for transmitting all messages to the video conference thread is adjusted based on the generation time of all messages under the data flow link.

4. The information processing method based on multi-terminal video conferencing according to claim 1, characterized in that: Based on the real-time working status of the user terminal accessing the video conference thread, determining whether a video conference offline event occurs on the user terminal; When a video conference offline event occurs, the corresponding message in the data stream link is intercepted, so as to perform a message resending operation after the user terminal comes back online, including: Performing real-time network bandwidth usage identification on the user terminal accessing the video conference thread to determine the available connection bandwidth between the user terminal and the video conference thread; if the available connection bandwidth is less than a preset bandwidth threshold, determining that a video conference offline event has occurred on the user terminal; otherwise, determining that no video conference offline event has occurred on the user terminal; When a video conference offline event occurs, all messages uploaded and added to the data flow link by the user end where the video conference offline event occurs are marked and intercepted based on the duration of the video conference offline event; and when the user end where the video conference offline event occurs comes back online, the marked and intercepted messages are resent.

5. The information processing method based on multi-terminal video conferencing according to claim 4, characterized in that: When the user terminal where the video conference offline event occurred comes back online, the message intercepted by the identifier is resent, including: Step S1, assuming that the difference between the time when a message that needs to be resent is generated and the current time is t, in milliseconds, the importance of the message is H, and the number of historical interactions between the user who sent the message and the user who received the message is S, then the importance score of the message that needs to be resent is: In the above formula (1), I is the importance score of the message that needs to be resent, α, β, γ, δ are all correlation coefficients, and e is a natural constant; Step S2: Assume that the current available bandwidth of the user end sending this message is w, the theoretical maximum bandwidth of the user end is W, the current network delay is Y, and the current packet loss rate is p. Then the network status score of the current user end is: In the above formula (2), f is the network status score of the current user end, P is the historical maximum packet loss rate of the user end, a, b, and c are the bandwidth impact coefficient, network delay impact coefficient, and packet loss rate impact coefficient, respectively; Step S2, based on the calculation results of the above steps S1 and S2, determine the retransmission priority score of the message that needs to be retransmitted. In the above formula (3), K is the retransmission priority score of the message that needs to be retransmitted, and C is the number of historical transmission failures. All messages that need to be retransmitted are sorted in reverse order according to the retransmission priority score. The higher the priority score, the higher the priority of transmission. When the K value is less than 0.5, the message will no longer be retransmitted. m and n are the message importance adjustment coefficient and the network status adjustment coefficient, respectively.

6. An information processing system based on multi-terminal video conferencing, characterized in that: include: A video conference thread starting module, used to start the corresponding video conference thread of the service platform based on the video conference initiation request received by the service platform; A user terminal access control module, used to initiate video conference invitations to different user terminals based on the running status information of the video conference thread, so as to connect the corresponding user terminals to the video conference thread; A user terminal monitoring module is used to monitor all user terminals connected to the video conference thread respectively to determine whether the user terminal is currently in an online state of the video conference; A message adding and transmission control module, used to add the messages uploaded by all the users in the online video conference to the corresponding data flow link, and adjust the transmission status of all the messages under the data flow link in the video conference thread; A conference offline event judgment module, used to judge whether a video conference offline event occurs on the user end based on the real-time working status of the user end accessing the video conference thread; The message interception and retransmission control module is used to intercept the corresponding message in the data stream link when a video conference offline event occurs, so as to perform a message retransmission operation after the user terminal comes back online.

7. The information processing system based on multi-terminal video conferencing according to claim 6, characterized in that: The video conference thread starting module is used to start the corresponding video conference thread of the service platform based on the video conference initiation request received by the service platform, including: Parsing and processing the video conference initiation request received by the service platform to obtain the status information of the user terminals participating in the video conference to be initiated; wherein the status information of the user terminals participating in the video conference includes the number of user terminals participating in the video conference and the network location of the user terminals; based on the status information of the user terminals participating in the video conference, predicting the operating resources required to execute the corresponding video conference, thereby starting the corresponding video conference thread of the service platform; The user terminal access control module is used to initiate video conference invitations to different user terminals based on the running status information of the video conference thread, so as to connect the corresponding user terminals to the video conference thread, including: The operation log of the video conference thread is analyzed to obtain the network area connection progress information of the video conference thread, and a video conference invitation is initiated to the user terminal under the corresponding network area; the invitation response from the user terminal is identified to determine whether the user terminal has the right to participate in the video conference, so as to connect the user terminal with the right to participate in the video conference to the video conference thread.

8. The information processing system based on multi-terminal video conferencing according to claim 6, characterized in that: The user terminal monitoring module is used to monitor all user terminals connected to the video conference thread respectively to determine whether the user terminal is currently in the video conference online state, including: Performing video conference window status identification on all user terminals connected to the video conference thread respectively, and determining whether the video conference window of the user terminal meets the preset interface display condition; if so, determining that the user terminal is currently in the video conference online state; if not, determining that the user terminal is currently not in the video conference online state; The message adding and transmission control module is used to add the message to the corresponding data flow link based on the messages uploaded by all the user terminals in the online state of the video conference, and adjust the transmission status of all the messages under the data flow link in the video conference thread, including: Messages uploaded by all users online in a video conference are identified to obtain data content type attributes corresponding to each message; based on the data content type attributes, the messages are added to the corresponding data flow link; the amount of added message data is identified for the data flow link to determine whether the data flow link is in a data saturation state; when the data flow link is in a data saturation state, the timeline for transmitting all messages to the video conference thread is adjusted based on the generation time of all messages under the data flow link.

9. The information processing system based on multi-terminal video conferencing according to claim 6, characterized in that: The conference offline event judgment module is used to judge whether a video conference offline event occurs on the user terminal based on the real-time working status of the user terminal accessing the video conference thread, including: Performing real-time network bandwidth usage identification on the user terminal accessing the video conference thread to determine the available connection bandwidth between the user terminal and the video conference thread; if the available connection bandwidth is less than a preset bandwidth threshold, determining that a video conference offline event has occurred on the user terminal; otherwise, determining that no video conference offline event has occurred on the user terminal; The message interception and retransmission control module is used to intercept the corresponding message in the data stream link when a video conference offline event occurs, so as to perform a message retransmission operation after the user terminal comes back online, including: When a video conference offline event occurs, all messages uploaded and added to the data flow link by the user end where the video conference offline event occurs are marked and intercepted based on the duration of the video conference offline event; and when the user end where the video conference offline event occurs comes back online, the marked and intercepted messages are resent.

10. The information processing system based on multi-terminal video conferencing according to claim 9, characterized in that: When the client that has experienced the video conference offline event comes back online, the message intercepted by the identifier is resent, including: Step S1, assuming that the difference between the time when a message that needs to be resent is generated and the current time is t, in milliseconds, the importance of the message is H, and the number of historical interactions between the user who sent the message and the user who received the message is S, then the importance score of the message that needs to be resent is: In the above formula (1), I is the importance score of the message that needs to be resent, α, β, γ, δ are all correlation coefficients, and e is a natural constant; Step S2: Assume that the current available bandwidth of the user end sending this message is w, the theoretical maximum bandwidth of the user end is W, the current network delay is Y, and the current packet loss rate is p. Then the network status score of the current user end is: In the above formula (2), F is the network status score of the current user end, P is the historical maximum packet loss rate of the user end, a, b, and c are the bandwidth impact coefficient, network delay impact coefficient, and packet loss rate impact coefficient, respectively; Step S2, based on the calculation results of the above steps S1 and S2, determine the retransmission priority score of the message that needs to be retransmitted. In the above formula (3), K is the retransmission priority score of the message that needs to be retransmitted, and C is the number of historical transmission failures. All messages that need to be retransmitted are sorted in reverse order according to the retransmission priority score. The higher the priority score, the higher the priority of transmission. When the K value is less than 0.5, the message will no longer be retransmitted. m and n are the message importance adjustment coefficient and the network status adjustment coefficient, respectively.

Citation Information

Patent Citations

  • Method and system for processing offline meeting

    CN102917045A

  • Conference control method and device based on multi-party video, equipment and storage medium

    CN115314477A

  • Virtual space microphone position resource processing method and device and computer equipment

    CN116095053A

  • Anti-jitter mechanism for monitoring online availability

    US20190327319A1

  • User devices for a wireless communication system and methods for communicating in a wireless communication system

    WO2021064135A1