A method and system for visual control of audio and video synchronization in a meeting room
By dynamically calculating the open value of user permissions and the impact value of device response, combined with hierarchical compensation algorithm and Bayesian optimization, personalized audio and video synchronization compensation for different users and devices is achieved, solving the problem of difficult dynamic adjustment of audio and video synchronization in the existing technology, and improving meeting efficiency and interaction quality.
Patent Information
- Application Number
- CN202510247779.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-03-04
- Publication Date
- 2025-06-03
- Estimated Expiration
- 2045-03-04
AI Technical Summary
The existing conference audio and video synchronization technology is difficult to achieve dynamic and accurate audio and video synchronization in complex network environments and multi-user scenarios, resulting in the impact of the interactive experience of participants and the reduction of conference efficiency.
By extracting the meeting type and recording the historical behavior data of the participating users, dynamically calculate the user permission open value and the device response impact value, combining the hierarchical compensation algorithm and Bayesian optimization, dynamically adjust the audio and video delay tolerance threshold to achieve personalized audio and video synchronization compensation for different users and devices.
It realizes dynamic adjustment of audio and video synchronization compensation based on user permissions and device status in a multi-user environment, ensuring that each user's experience is optimal, and improving meeting efficiency and interaction quality.
Smart Images

Figure CN119728912B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of conference audio and video control, and particularly to a method and system for visual control of audio and video synchronization in a conference room. Background Art
[0002] The problem of audio and video synchronization not only manifests as simple audio delay or video frame lag, but also involves the combined action of multiple factors, such as network bandwidth, device performance, the device configurations of participants, and the complexity of the conference scenario. Traditional audio and video synchronization methods mostly rely on simple buffering mechanisms or fixed time delay adjustments, but these methods often struggle to handle the complex and changing scenarios in actual conferences. For example, in the case of large fluctuations in network bandwidth, a single synchronization mechanism is likely to cause frame delay or audio lag, thereby affecting the interaction experience of participants and reducing the conference efficiency. Especially for multi-party conferences and situations with frequent interactions, the problem is more prominent.
[0003] Although existing video conferencing systems can provide basic audio and video synchronization functions, their compensation mechanisms are mostly based on static settings or simple buffering mechanisms and cannot dynamically adapt to the real-time changes of different users and devices. In addition, in traditional conference systems, the audio and video synchronization compensation for all participants is usually unified and cannot be optimized according to the actual needs of different participants. For hosts and others, their speeches are of high importance and require high synchronization accuracy. Existing technologies usually lack intelligent adjustments based on user identity factors and are difficult to provide customized and precise audio and video synchronization compensation solutions according to the actual situation, wasting computing resources.
[0004] Therefore, the present invention provides a method and system for visual control of audio and video synchronization in a conference room. Summary of the Invention
[0005] The purpose of the present invention is to provide a method and system for visual control of audio and video synchronization in a conference room to solve the existing problems mentioned in the above background art.
[0006] To achieve the above purpose, the present invention provides the following technical solution: A method for visual control of audio and video synchronization in a conference room, comprising the following steps:
[0007] S1. Extract the conference type of the initiator of the conference room, record the historical behavior data of the participating users in the current conference type, and calculate the permission opening values of all users through a dynamic weight strategy;
[0008] S2. Monitor the device status of each conference member to obtain the device response influence value;
[0009] S3. By means of a hierarchical compensation algorithm, allocate a compensation algorithm for each participant in the meeting in combination with the user permission opening value and the device status; and search for the optimal parameter combination through Bayesian optimization;
[0010] S4. Set a synchronization correction strategy. According to the permission opening value, dynamically adjust the audio and video delay tolerance threshold. When the actual delay time is greater than the delay tolerance threshold, return to S3 and adjust the Bayesian optimization period of this user.
[0011] A further improvement of the present invention lies in that the dynamic weight strategy combines the three elements of role, behavior, and violation, and suppresses the permission inflation of long-term inactive users through a logarithmic function. The specific steps include: obtaining the user behavior score through the behavior type of each participant in the meeting ; obtaining the cumulative value of the user violation event decay model through the violation events of each participant in the meeting ; and then obtaining the permission value of each participant in the meeting where represents the user basic role constant, where, represents a visitor, represents a member, represents a host, represents the time normalization base, represents the weight of the user basic role constant, represents the weight of the user behavior score, represents the weight of the cumulative value of the user violation event decay model.
[0012] A further improvement of the present invention lies in that the specific steps of S3 include:
[0013] S31. Obtain the total permission value Tpe of each participant in the meeting by weighted summing the device response influence value and the permission opening value;
[0014] S32. Set the first permission threshold TPet1 and the second permission threshold TPet2. When , it is determined as a low-permission scenario. When , it is determined as a medium-permission scenario. When , it is determined as a high-permission scenario;
[0015] S33. Implement the delay compensation requirements of different participants in the meeting through a hierarchical compensation algorithm.
[0016] A further improvement of the present invention lies in that the hierarchical compensation algorithm includes a basic delay compensation layer, an enhanced delay compensation layer, and a high-level delay compensation layer; the basic delay compensation layer calculates the change in the playback rate where is the time difference between audio and video, is the frame time of the video, and low - privilege delay compensation is achieved through pitch - shifting without speed - changing; the enhanced delay compensation layer dynamically adjusts the buffer depth according to the total privilege value, and the enhanced buffer depth , represents the size of the basic buffer; the advanced delay compensation layer is based on the LSTM network, and dynamically adjusts the delay step and signal path weight according to the total privilege value to generate a synchronization signal.
[0017] A further improvement of the present invention lies in that in the advanced delay compensation layer, the Mel spectrogram of the past M frames and the normalized privilege value PTpe are used as inputs to dynamically adjust the predicted delay compensation of the model .
[0018] A further improvement of the present invention lies in that the audio - video delay tolerance threshold is calculated by taking the predicted delay compensation in step S3 as the basis to calculate the actual audio - video delay tolerance threshold , is a coefficient used to adjust the sensitivity of the tolerance threshold; when the absolute value of the difference between the actual arrival time and the expected time of the audio - video stream is greater than the audio - video delay tolerance threshold, a synchronization correction strategy is triggered, and the synchronization correction strategy includes setting a reference correction period to obtain an updated correction period .
[0019] A further improvement of the present invention lies in that the calculation process of the behavior score includes setting a speaking duration interval, a speaking frequency interval, and the number of interactions. The speaking duration score is obtained by calculating the ratio of the mean speaking time of this type of participant in history to the deviation duration from the speaking duration and the edge value. The speaking frequency score is obtained in the same way. The speaking duration score, speaking frequency score, and normalized number of interactions of the user within a time window of 30 days are used as behavior types and fed into the user behavior data set to obtain the user behavior score , where noa represents the number of meetings of this participant within 30 days, represents the th meeting of this participant, and the th behavior type score, represents the th weight coefficient of the behavior type, represents the attenuation coefficient, represents the time when the th behavior type occurs, represents the current time.
[0020] A further improvement of the present invention lies in that the cumulative value of the user violation event attenuation model includes determining the user's violation behavior. When the number of times the user interrupts the speech is greater than 0 and less than the set first interruption threshold, it is determined as a minor violation. When the number of times the user interrupts the speech is greater than the set first interruption threshold, it is determined as a serious violation. Extract the violation behavior of the participating users within a time window of 30 days to obtain the user violation event attenuation model. , represents the defined severity of the violation event, H = 720min represents the half-life period, represents the time when the
[0021] A further improvement of the present invention lies in that the device response influence value is obtained by monitoring the average value of the historical device synchronization delay of the meeting members. Calculate the delay of the th meeting of the participating members:
[0022] ;
[0023] wherein, represents the th meeting th speech audio transmission time, represents the th meeting th speech video time, represents the number of user meetings within a time window of 30 days, and represent the set weights.
[0024] On the other hand, the present invention provides a conference room audio-video synchronization visualization control system, including:
[0025] A user permission opening calculation module for extracting the meeting type of the meeting initiator of this conference room, recording the historical behavior data of the participating users in the current meeting type, and calculating the permission opening value of all users through a dynamic weight strategy;
[0026] A device response monitoring module for monitoring the device status of each meeting member to obtain the device response influence value;
[0027] A hierarchical compensation algorithm module for allocating a compensation algorithm for each participating person in combination with the user permission opening value and the device status; and searching for the optimal parameter combination through Bayesian optimization;
[0028] A synchronization correction strategy module for dynamically adjusting the audio-video delay tolerance threshold according to the permission opening value. When the actual delay time is greater than the delay tolerance threshold, return to S3 to adjust the Bayesian optimization period of this user.
[0029] Compared with the prior art, the beneficial effects of the present invention are as follows:
[0030] First, the present invention divides users into different privilege levels and adopts compensation algorithms suitable for different needs. Low-privilege users use relatively simple compensation algorithms, while high-privilege users use complex compensation algorithms, ensuring that the synchronization effects of different users are best satisfied. According to factors such as the device status and privilege value of the user, the compensation level is dynamically adjusted to ensure real-time audio and video synchronization. Especially in a multi-user environment, the experience of each user is ensured to reach the optimal level;
[0031] By combining the total privilege value of the user and the delay compensation predicted by the model, the audio and video delay tolerance threshold is dynamically adjusted. In the case of high-privilege users, the delay prediction is small, and the system sets a low delay tolerance threshold; while for low-privilege users, the tolerance is correspondingly increased; this enables the system to be flexibly adjusted according to the needs of different users, avoiding unnecessary delay corrections, and improving the overall efficiency and accuracy. BRIEF DESCRIPTION OF THE DRAWINGS
[0032] Figure 1 It is a flowchart of a method for visual control of audio and video synchronization in a conference room according to the present invention;
[0033] Figure 2 It is a flowchart of a hierarchical compensation algorithm for a method for visual control of audio and video synchronization in a conference room according to the present invention;
[0034] Figure 3 It is a framework diagram of a system for visual control of audio and video synchronization in a conference room according to the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0035] The technical solution of the present invention will be described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the embodiments of the present invention and the specific features in the embodiments are detailed descriptions of the technical solution of the present invention, rather than limitations on the technical solution of the present invention. Without conflict, the technical features in the embodiments of the present invention and the embodiments can be combined with each other.
[0036] The term "and / or" merely describes an association relationship of associated objects and indicates that three relationships may exist. For example, A and / or B may represent: A exists alone, A and B exist simultaneously, and B exists alone. In addition, the character " / " generally indicates that the associated objects before and after are in an "or" relationship.
[0037] Embodiment 1
[0038] Figure 1 A flowchart of a method for visual control of audio and video synchronization in a conference room disclosed in this embodiment is shown as follows:
[0039] S1. Extract the meeting type of the meeting initiator in this conference room, record the historical behavior data of the participating users in the current meeting type, and calculate the permission opening value of all users through the dynamic weight strategy;
[0040] S2. Monitor the device status of each meeting member to obtain the device response impact value (the worse the device status, the more likely it is that the member will face network latency, and a higher compensation algorithm should be assigned)
[0041] S3. Through the hierarchical compensation algorithm, combine the user permission opening value and the device status to assign a compensation algorithm to each participating person; and search for the optimal parameter combination through Bayesian optimization;
[0042] S4. Set the synchronization correction strategy, dynamically adjust the audio and video delay tolerance threshold according to the permission opening value. When the actual delay time is greater than the delay tolerance threshold, return to S3 and adjust the Bayesian optimization period of this user.
[0043] The dynamic weight strategy combines the three elements of role, behavior, and violation, and suppresses the permission inflation of long-term inactive users through the logarithmic function. The specific steps include: obtaining the user behavior score through the behavior type of each participating user ; obtaining the cumulative value of the user violation event decay model through the violation events of each participating user ; and then obtaining the permission value of each participating user , where represents the user base role constant, , where, represents a visitor, represents a member, represents a host, represents the time normalization base, represents the weight of the user base role constant, represents the weight of the user behavior score, represents the weight of the cumulative value of the user violation event decay model.
[0044] The calculation process of the behavior score includes setting the speaking duration interval, speaking frequency interval, and interaction times. The speaking duration score is obtained by calculating the ratio of the average speaking time of the participants of this type in history to the deviation duration between the speaking duration and the edge value. The speaking frequency score is obtained in the same way. The speaking duration score, speaking frequency score, and normalized interaction times of the user within a 30-day time window are used as the behavior types and sent into the user behavior data set to obtain the user behavior score , where, noa represents the number of meetings of this participating person within 30 days, represents the th meeting of this participating person, and the th behavior type score, represents the weight coefficient of the th behavior type, represents the attenuation coefficient, represents the th time when the th behavior type occurs,
[0045] For example, if the speaking duration range is [5 min, 10 min], and the speaking duration of this participant is 3 min this time, then the user behavior score of this participant is a / (5 - 3). If the speaking duration of this participant is 15 min this time, then the user behavior score of this participant is a / (15 - 10), where a represents the average speaking time of historical participants of this type.
[0046] The cumulative value of the user violation event attenuation model includes determining the user's violation behavior. When the number of times the user interrupts the speech is greater than 0 and less than the set first interruption times threshold, it is determined as a minor violation. When the number of times the user interrupts the speech is greater than the set first interruption times threshold, it is determined as a severe violation. Extract the violation behaviors of the participating users within a 30-day time window to obtain the user violation event attenuation model , represents the defined severity of the violation event, H = 720 min represents the half-life period, represents the th time when the
[0047] The device response impact value is obtained by monitoring the average value of the historical device synchronization delay of the meeting members. Calculate the delay amount of the th meeting of the participating members:
[0048] ;
[0049] Among them, represents the th time of the th speech audio transmission in the th meeting, represents the th time of the th speech video in the th meeting, represents the number of user meetings within a 30-day time window,
[0050] By monitoring the device response impact value, the device performance can be comprehensively considered, avoiding calculation anomalies caused by network delays due to occasional lags, and thus wasting delay compensation resources.
[0051] Embodiment 2
[0052] Based on the technical solution of Embodiment 1, the present invention proposes a hierarchical compensation algorithm. Figure 2 The flowchart of the hierarchical compensation algorithm of a conference audio and video synchronization visualization control method disclosed in this embodiment is shown as follows:
[0053] S31. Obtain the total permission value Tpe of each participating member by weighted summation of the device response influence value and the permission opening value.
[0054] S32. Set the first permission threshold TPet1 and the second permission threshold TPet2. When , it is determined as a low-permission scenario. When , it is determined as a medium-permission scenario. When , it is determined as a high-permission scenario.
[0055] In the present invention, high-permission users often face frequent speaking, and both the speaking duration and the importance of the speech are relatively high. To ensure the experience of all meeting participants, the algorithm for high-permission users should be more complex. While low-permission users' speaking is intermittent and of short duration, so a relatively simple compensation algorithm can also meet the needs of the participants.
[0056] S33. Implement the delay compensation requirements of different participating users through the hierarchical compensation algorithm.
[0057] The hierarchical compensation algorithm includes a basic delay compensation layer, an enhanced delay compensation layer, and a high-level delay compensation layer. The basic delay compensation layer calculates the change in the playback rate , where is the time difference between audio and video, is the frame time of the video, and realizes the delay compensation of low permissions by changing the pitch without changing the speed. The enhanced delay compensation layer dynamically adjusts the buffer depth according to the total permission value, and the enhanced buffer depth , represents the size of the basic buffer. The high-level delay compensation layer is based on the LSTM network, and dynamically adjusts the delay step and the signal path weight according to the total permission value to generate a synchronization signal.
[0058] In the high-level delay compensation layer, the Mel spectrogram of the past M frames and the normalized permission value PTpe are used as inputs to dynamically adjust the predicted delay compensation of the model ;
[0059] The role of the permission value is to affect the adjustment of the delay step, ensuring that higher-permission users can obtain more accurate synchronization. And weights are assigned to the signal paths according to the total permission value, and the weight of each path is expressed as , represents the quality score of the k-th path, ensuring that higher-permission users obtain better path weighting.
[0060] The audio - video delay tolerance threshold calculates the actual audio - video delay tolerance threshold by using the delay compensation predicted in step S3 as a basis. As a basis, calculate the actual audio - video delay tolerance threshold , is a coefficient used to adjust the sensitivity of the tolerance threshold; represents the maximum audio - video delay deviation allowed under the current total permission value. By using the delay compensation value predicted by the model as the dynamic delay tolerance threshold, the tolerance of the system can be adjusted according to the predicted delay. For example, in the case of high - privilege users, the predicted delay may be small, so a smaller tolerance threshold can be set; while in the case of low - privilege users, the delay prediction is large, and the tolerance threshold can be increased accordingly. When the absolute value of the difference between the actual arrival time and the expected time of the audio - video stream is greater than the audio - video delay tolerance threshold, a synchronization correction strategy is triggered. The synchronization correction strategy includes setting a reference correction period , and obtaining the updated correction period as the Bayesian optimization period .
[0061] The setting of the threshold and weight can be based on the default settings of the present invention or can be set by the operator himself.
[0062] Embodiment 3
[0063] Figure 3 shows a framework diagram of a conference room audio - video synchronization visualization control system according to the present invention. Based on the same inventive concept as Embodiment 1 and Embodiment 2, the present invention provides a conference room audio - video synchronization visualization control system, including:
[0064] A user permission opening calculation module, which is used to extract the meeting type of the conference room initiator, record the historical behavior data of the participating users in the current meeting type, and calculate the permission opening values of all users through a dynamic weight strategy;
[0065] A device response monitoring module, which is used to monitor the device status of each conference member to obtain the device response influence value;
[0066] A hierarchical compensation algorithm module, which is used to allocate a compensation algorithm for each participating person by combining the user permission opening value and the device status; and search for the optimal parameter combination through Bayesian optimization;
[0067] A synchronization correction strategy module, which is used to dynamically adjust the audio - video delay tolerance threshold according to the permission opening value. When the actual delay time is greater than the delay tolerance threshold, return to S3 and adjust the Bayesian optimization period of this user.
[0068] The synchronization correction strategy module includes an audio-video delay tolerance threshold calculation unit and an optimization period calculation unit; the audio-video delay tolerance threshold calculation unit is used to calculate the actual audio-video delay tolerance threshold according to the predicted delay compensation; the optimization period calculation unit is used to set a reference correction period and obtain an updated correction period as the Bayesian optimization period
[0069] Those skilled in the art should understand that the embodiments of the present invention can be provided as a method, a system, or a computer program product. Therefore, the present invention can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present invention can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk memory, CD-ROM, optical memory, etc.) containing computer-usable program code
[0070] The present invention is described with reference to the flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, and the combination of processes and / or blocks in the flowchart and / or block diagram, can be realized by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices generate for realizing in the process Figure 1 one process or multiple processes and / or blocks Figure 1 a device for the functions specified in one block or multiple blocks
[0071] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory generate a manufactured product including an instruction device, and the instruction device realizes in the process Figure 1 one process or multiple processes and / or blocks Figure 1 a device for the functions specified in one block or multiple blocks
[0072] These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to generate a computer-implemented process, and thus the instructions executed on the computer or other programmable device provide steps for realizing the functions specified in Figure 1 one process or multiple processes and / or blocks Figure 1 a device for the functions specified in one block or multiple blocks
[0073] The embodiments of the present invention have been described above in conjunction with the accompanying drawings. However, the present invention is not limited to the above specific embodiments. The above specific embodiments are merely illustrative rather than restrictive. Under the inspiration of the present invention, those of ordinary skill in the art can also make many forms without departing from the spirit of the present invention and the scope protected by the claims. All of these are within the protection scope of the present invention.
Claims
1. A conference room audio and video synchronization visualization control method, characterized in that: The following steps are involved: S1. Extract the conference type of the conference room initiator, record the historical behavior data of the participating users in the current conference type, and calculate the permission opening value of all users through the dynamic weight strategy; S2. Monitor the device status of each conference member and obtain the device response impact value; S3. A compensation algorithm is assigned to each participant through a hierarchical compensation algorithm, combined with the user permission opening value and device status; and the optimal parameter combination is searched through Bayesian optimization; S4, setting a synchronization correction strategy, dynamically adjusting the audio and video delay tolerance threshold according to the permission opening value, and when the actual delay time is greater than the delay tolerance threshold, returning to S3 and adjusting the Bayesian optimization cycle of the user; The layered compensation algorithm includes a basic delay compensation layer, an enhanced delay compensation layer and an advanced delay compensation layer; the basic delay compensation layer calculates the change of the playback rate ,in is the time difference between audio and video, is the frame time of the video, and the delay compensation of low authority is realized by changing the pitch without changing the speed; the enhanced delay compensation layer dynamically adjusts the buffer depth according to the total value of the authority, and the enhanced buffer depth , Indicates the size of the basic buffer, Tpe indicates the total value of the authority of each participant; the advanced delay compensation layer is based on the LSTM network, dynamically adjusts the delay step and signal path weight through the total value of the authority, and generates a synchronization signal; The advanced delay compensation layer takes the Mel spectrum of the past M frames and the normalized permission value PTpe as input to dynamically adjust the model's predicted delay compensation .
2. A conference room audio and video synchronization visualization control method according to claim 1, characterized in that: The dynamic weight strategy combines the three elements of role, behavior, and violation, and suppresses the expansion of the rights of long-term inactive users through a logarithmic function. The specific steps include: obtaining a user behavior score based on the behavior type of each participating user ; Obtain the cumulative value of the user violation event attenuation model through the violation events of each participating user ; And then get the permission value of each participating user ,in Indicates the user's basic role constant. ,in, On behalf of the visitor, Indicates members, Indicates the host, represents the time normalization base, Indicates the constant weight of the user's basic role, represents the user behavior score weight, Represents the cumulative value weight of the user violation event attenuation model.
3. A conference room audio and video synchronization visualization control method according to claim 1, characterized in that: The specific steps of S3 include: S31, obtaining the total authority value Tpe of each conference participant by weighted summing up the device response impact value and the authority opening value; S32, setting a first permission threshold TPe1 and a second permission threshold TPe2, when When When When the system detects the error, it is judged as a high-authority scenario; S33. A hierarchical compensation algorithm is used to realize the delay compensation requirements of different conference participants.
4. A conference room audio and video synchronization visualization control method according to claim 1, characterized in that: The audio and video delay tolerance threshold is calculated by compensating the delay predicted in step S3 As a basis, calculate the actual audio and video delay tolerance threshold , is a coefficient used to adjust the sensitivity of the tolerance threshold; when the absolute value of the difference between the actual arrival time of the audio and video stream and the expected time When the delay is greater than the audio and video delay tolerance threshold, the synchronization correction strategy is triggered, and the synchronization correction strategy includes setting a reference correction period , get the updated correction period .
5. A conference room audio and video synchronization visualization control method according to claim 2, characterized in that: The calculation process of the behavior score includes setting the speech duration interval, speech frequency interval and interaction times, and calculating the ratio of the historical average speech time of the participants of this type to the speech duration and the deviation time of the edge value to obtain the speech duration score. The speech frequency score is obtained in the same way. The speech duration score, speech frequency score and standardized interaction times of users with a time window of 30 days are taken as the behavior type and sent to the user behavior dataset. Get the user behavior score , where noa indicates the number of meetings of the participant within 30 days. Indicates that the participant The first participant Behavior type scores, Indicates The weight coefficient of each behavior type, represents the attenuation coefficient, Indicates The time when each behavior type occurs, Indicates the current time.
6. A conference room audio and video synchronization visualization control method according to claim 2, characterized in that: The cumulative value of the user violation event attenuation model includes determining user violation behavior. When the number of user interruptions is greater than 0 and less than the set first interruption threshold, it is determined to be a minor violation. When the number of user interruptions is greater than the set first interruption threshold, it is determined to be a severe violation. The violation behavior of the participating users with a time window of 30 days is extracted to obtain the user violation event attenuation model. , Indicates the severity of the defined violation event, H=720min indicates the half-decay period, Indicates The time when the violation occurred.
7. A conference room audio and video synchronization visualization control method according to claim 1, characterized in that: The device response impact value is obtained by monitoring the average value of the historical device synchronization delay of the conference members, and calculating the first Delay per meeting: ; in, Indicates Meeting No. The time of audio transmission of each speech, Indicates Meeting No. The time of the speech video, Indicates the number of user meetings within a 30-day time window. and Indicates the weight of the setting.
8. A conference room audio and video synchronization visualization control system, used to execute a conference room audio and video synchronization visualization control method according to any one of claims 1 to 7, characterized in that: include: The user rights opening calculation module is used to extract the conference type of the conference room initiator, record the historical behavior data of the participating users in the current conference type, and calculate the rights opening values of all users through the dynamic weight strategy; The device response monitoring module is used to monitor the device status of each conference member and obtain the device response impact value; The hierarchical compensation algorithm module is used to assign a compensation algorithm to each participant based on the user permission opening value and device status; and search for the optimal parameter combination through Bayesian optimization; The synchronization correction strategy module is used to dynamically adjust the audio and video delay tolerance threshold according to the permission opening value. When the actual delay time is greater than the delay tolerance threshold, it returns to S3 and adjusts the Bayesian optimization cycle of the user.
Citation Information
Patent Citations
Data processing method and video conference equipment
CN113132672A
Virtual resource compensation method, apparatus and device, and computer storage medium
CN116362729A