A matrix switching system for video conferencing
By monitoring network parameters and signal characteristics in real time, dynamically adjusting bandwidth allocation, signal compression and encryption levels, and selecting appropriate character overlay templates, it solves the real-time and security problems of video conferencing systems under high-frequency switching of multiple signal sources, and improves user experience and signal transmission efficiency.
Patent Information
- Application Number
- CN202411848105.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-16
- Publication Date
- 2025-07-18
- Estimated Expiration
- 2044-12-16
AI Technical Summary
The existing video conferencing system has low switching efficiency in multi-signal source high-frequency switching scenarios, failing to fully consider real-time and accuracy, and the encryption capacity and bit error rate adjustment methods fail to fully solve the security and performance balance problems in high-bandwidth signal transmission. The character overlay module fails to realize efficient management of dynamic information or multilingual characters, reducing the flexibility and real-timeness of the user experience.
The network performance detection module is used to monitor network transmission parameters in real time, generate bandwidth allocation and signal compression optimization parameters, prioritize it with signal source attributes, dynamically adjust encryption capacity and level, select appropriate character overlay templates and adjust refresh rate to optimize signal transmission and display effects.
It improves the stability and transmission efficiency of video conferencing, ensures signal security and user experience, improves the clarity and real-timeness of video content and character information, and optimizes the switching process of multiple signal sources.
Smart Images

Figure CN119629296B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of video conferencing, and specifically provides a matrix switching system for video conferencing. Background Art
[0002] With the continuous development of informatization and intelligent technologies, video conferencing has become an important means for modern enterprise collaboration, government agency decision-making, and educational distance teaching. Video conferencing systems can break through geographical restrictions and achieve real-time and efficient communication and collaboration. However, with the increasing complexity of meeting scenarios, video conferencing systems face higher technical requirements, such as real-time switching of multiple signal sources, stability of signal transmission, and interactivity of video display. These demands have promoted the continuous upgrading of video conferencing technologies to meet diverse usage scenarios and higher user experience requirements.
[0003] For example, a Chinese invention patent with the publication number CN117354448B discloses a matrix switching system for video conferencing, including: an information acquisition module for identifying and processing matrix switching information to output switching feature information, and an information encryption module including an encryption capacity control component for determining the maximum capacity ratio of information encryption according to the variance of matrix switching duration, and a security risk control component for adjusting the information encryption level according to the actual error rate determined by the maximum capacity ratio of information encryption; a character overlay control module including a cache rate control component for determining the cache rate according to the byte ratio of the character overlay words selected from the local database. The present invention realizes the improvement of the stability of the matrix switching process and the effectiveness of character overlay in video display.
[0004] The existing system only performs switching control through feature extraction of matrix switching information, without fully considering the real-time performance and accuracy in the scenario of high-frequency switching of multiple signal sources, resulting in low switching efficiency in complex scenarios. The method of controlling information security by adjusting encryption capacity and error rate fails to comprehensively solve the problem of balance between security and performance in high-bandwidth signal transmission. The current character overlay module only controls the cache rate based on the byte ratio of words in the local database, and fails to achieve efficient management of dynamic input information or multi-language character overlay, reducing the flexibility and real-time performance of the user experience. Summary of the Invention
[0005] Aiming at the deficiencies of the prior art, the present invention provides a matrix switching system for video conferencing, which solves the problems in the above background art.
[0006] To achieve the above objectives, the present invention is realized through the following technical solutions: A matrix switching system for video conferencing, including the following modules: a network performance detection module, a signal switching module, a dynamic encryption control module, and a character overlay module; the network performance detection module is used to monitor the network transmission parameters of the video conferencing in real time, analyze and generate bandwidth allocation parameters and signal compression optimization parameters; the signal switching module is used to, based on the bandwidth allocation parameters and signal compression optimization parameters, combine with the signal source attributes to rank the priority of each signal source required for video conferencing matrix switching, determine the preferred mapping position of the signal source in the matrix, allocate matrix positions, execute signal switching, and identify the signal characteristics after switching; the dynamic encryption control module is used to dynamically adjust the encryption capacity and level according to the signal characteristics after switching; the character overlay module is used to select a character overlay template and adjust the refresh rate according to the signal characteristics after switching by the signal switching module.
[0007] Further, the specific process of analyzing and generating the bandwidth allocation parameters and signal compression optimization parameters is as follows: According to the network transmission parameters of the video conferencing, analyze the network status and evaluate the availability of the current bandwidth and the requirements of signal compression to generate the bandwidth allocation parameters; the generation of the bandwidth allocation parameters includes bandwidth demand analysis parameters, current network delay parameters, and bandwidth availability evaluation parameters; according to the bandwidth allocation situation, generate signal compression optimization parameters to optimize the efficiency and quality of signal transmission; the signal compression optimization parameters include signal compression ratio parameters, compression algorithm selection parameters, and transmission error rate optimization parameters.
[0008] Further, the specific process of ranking the priority of each signal source required for video conferencing matrix switching based on the bandwidth allocation parameters and signal compression optimization parameters and combining with the signal source attributes is as follows: According to the bandwidth demand analysis parameters, current network delay parameters, and bandwidth availability evaluation parameters, evaluate the bandwidth demand, delay, and bandwidth availability during the transmission of the signal source, and prioritize the signal sources with low bandwidth demand, low delay, and high bandwidth availability; according to the signal compression ratio parameters, compression algorithm selection parameters, and transmission error rate optimization parameters, evaluate the compression ratio, compression algorithm efficiency, and transmission error rate of each signal source, and prioritize the signal sources with low compression ratio, high compression algorithm efficiency, and low transmission error rate.
[0009] Further, the specific process of determining the preferred mapping position of the signal source in the matrix is as follows: Assign weights to the bandwidth allocation parameters and signal compression optimization parameters, comprehensively evaluate the bandwidth demand, delay requirements, bandwidth availability, compression efficiency, and error rate of the signal source, determine the priority ranking of each signal source in the matrix, and determine the priority ranking of each signal source in the matrix.
[0010] Further, the specific process of allocating matrix positions and performing signal switching is as follows: According to the priority sorting after weight allocation, map the signal sources to the corresponding positions in the matrix. The signal source with a higher priority is allocated to a preferred matrix position. According to the allocated matrix positions, the signal switching module transmits the high-priority signal sources to the corresponding matrix positions, replaces the low-priority signal sources in the matrix, and performs signal switching. According to the matrix configuration, adjust the signal transmission link, including updating the video display position, adjusting the signal output source, and switching the input and output ports. After the signal switching is completed, monitor the characteristics of the switched signal.
[0011] Further, the specific process of dynamically adjusting the encryption capacity and level according to the characteristics of the switched signal is as follows: Analyze the characteristics of the signal after switching, including bandwidth requirements, latency, compression efficiency, and bit error rate, to determine the security requirements of the signal. According to the transmission characteristics of the signal, calculate the required encryption capacity and encryption level, and determine whether it is necessary to enhance the encryption intensity. According to the signal characteristics and the calculation results, dynamically adjust the encryption capacity and level.
[0012] Further, the specific process of selecting a character overlay template according to the characteristics of the signal after switching by the signal switching module is as follows: According to the characteristics of the switched signal, evaluate the transmission quality and stability of the signal, and identify the character overlay template that matches the current signal conditions. After the signal is switched, load and apply the selected character overlay template to the video stream to ensure that the character content can be clearly integrated with the video signal and is compatible with the transmission characteristics of the current signal.
[0013] Further, the specific process of adjusting the refresh rate is as follows: According to the characteristics of the switched signal, evaluate the stability and bandwidth availability of the signal to obtain a signal quality index. Compare the signal quality index with a preset signal quality index threshold. When the signal quality index is greater than or equal to the threshold, maintain or increase the refresh rate. When the signal quality index is less than the threshold, reduce the refresh rate.
[0014] The present invention has the following beneficial effects:
[0015] (1) This matrix switching system for video conferencing can intelligently analyze and generate bandwidth allocation parameters and signal compression optimization parameters by real-time monitoring of network transmission parameters. By combining these parameters with the signal source attributes, perform priority sorting and matrix position allocation for each signal source in the video conferencing, ensure the preferred mapping position of the signal source in the matrix, optimize signal transmission and processing, and improve the stability and transmission efficiency of the video conferencing.
[0016] (2) The matrix switching system for video conferencing dynamically adjusts the encryption capacity and level according to the characteristics of the switched signal to ensure signal security in video conferencing. At the same time, it selects a suitable character overlay template according to the signal characteristics and adjusts the refresh rate to ensure the clarity and real-time nature of video content and character information, further enhancing the user experience and conferencing effect.
[0017] Of course, it is not necessary for any product implementing the present invention to achieve all the above-mentioned advantages simultaneously. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] Figure 1 It is a flowchart of a matrix switching system for video conferencing according to the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0019] In the embodiments of the present application, a matrix switching system for video conferencing is used to solve the problems of video delay, freezing, and information loss caused by fluctuations in bandwidth and signal quality during the video signal switching process. The system ensures the stability and clarity of the video stream by real-time monitoring of network transmission parameters and optimizing bandwidth allocation and signal compression, thereby improving the overall quality and smoothness of video conferencing.
[0020] The general idea of the solution in the embodiments of the present application is as follows:
[0021] Real-time monitor the network transmission parameters of the video conferencing, analyze and generate bandwidth allocation parameters and signal compression optimization parameters.
[0022] Based on the bandwidth allocation parameters and signal compression optimization parameters, combined with the signal source attributes, prioritize each signal source required for matrix switching in the video conferencing, determine the preferred mapping positions of the signal sources in the matrix, allocate matrix positions, perform signal switching, and identify the characteristics of the switched signal.
[0023] Dynamically adjust the encryption capacity and level according to the characteristics of the switched signal.
[0024] Select a character overlay template according to the characteristics of the signal switched by the signal switching module and adjust the refresh rate.
[0025] Please refer to Figure 1, an embodiment of the present invention provides a technical solution: a matrix switching system for video conferencing, including the following modules: a network performance detection module, a signal switching module, a dynamic encryption control module, and a character overlay module; the network performance detection module is used to monitor the network transmission parameters of the video conferencing in real time, analyze and generate bandwidth allocation parameters and signal compression optimization parameters; the signal switching module is used to, based on the bandwidth allocation parameters and signal compression optimization parameters, combine with the signal source attributes to rank the priorities of the respective signal sources required for the video conferencing matrix switching, determine the preferred mapping positions of the signal sources in the matrix, allocate matrix positions, perform signal switching, and identify the signal characteristics after switching; the dynamic encryption control module is used to dynamically adjust the encryption capacity and level according to the signal characteristics after switching; the character overlay module is used to select a character overlay template and adjust the refresh rate according to the signal characteristics after switching by the signal switching module.
[0026] In this implementation scheme, the matrix switching system: The matrix switching system is a device commonly used for video and audio signal management. It can flexibly match and switch multiple input signals (for example, images from different video sources) with multiple output devices (such as monitors or projectors). Through this system, users can control which input signal is transmitted to which output device, thus realizing the priority allocation and switching of signals. Network performance detection module: This module is used to monitor the network transmission situation in a video conference in real time, mainly including key parameters such as bandwidth, latency, and packet loss rate. Bandwidth refers to the maximum rate of data transmission over the network, latency refers to the time required for data to travel from the sender to the receiver, and packet loss rate refers to the proportion of data packets lost during transmission. Through these parameters, the network performance detection module can evaluate the quality of the current network, and then provide data support for subsequent signal processing and optimization. Bandwidth allocation parameters: Bandwidth allocation parameters refer to the rules and allocation methods for dividing the available bandwidth in the network. The purpose of bandwidth allocation is to reasonably allocate network resources according to the actual situation of the network (such as bandwidth requirements, network latency, etc.), ensure that each signal source in the video conference can obtain sufficient bandwidth, and avoid network congestion or signal loss. Signal compression optimization parameters: Signal compression optimization parameters refer to the relevant parameters for compressing video signals during transmission. Video signal compression is to reduce the required bandwidth for transmission, so that the signal can be transmitted smoothly under limited network conditions. Compression optimization parameters include compression ratio, algorithm selection, etc. By setting reasonable parameters, both signal quality and bandwidth utilization efficiency can be optimized. Signal switching module: The signal switching module is a key component responsible for controlling the switching between input signals and output devices. In a video conference, there are multiple signal sources (such as images from different cameras). The signal switching module distributes these signals to different output devices according to the priority settings of the system. This module determines the priority of each signal source based on factors such as network status and signal source attributes, and performs corresponding switching operations. Signal source attributes: Signal source attributes refer to the characteristics and requirements of each video signal source, such as bandwidth requirements, latency tolerance, resolution, etc. In a video conference system, signal sources may come from different devices (such as cameras, computers, or other video input devices), and the signal attributes of each device may be different. The system needs to perform reasonable signal switching and allocation based on these attributes. Dynamic encryption control module: This module is used to dynamically adjust the encryption level and encryption capacity of video signals according to the characteristics of video signals. In a video conference, protecting data security is crucial, especially in a complex network environment. Through the encryption control module, the system can automatically adjust the encryption strategy according to the transmission quality and security requirements of the signal, ensure data security, and avoid excessive encryption from affecting the transmission efficiency of the signal. Character overlay module: The character overlay module is a technology for overlaying text information (such as status, timestamp, or identification) on video signals.In a video conference, the overlay module can directly display specific characters, logos, or warning messages on the video signal, helping participants quickly understand the meeting information. According to the quality and characteristics of the video signal, the system will select different overlay templates. For example, when the signal quality is low, a more fault-tolerant template will be selected; when the signal quality is good, a simple and clear template will be selected. Refresh rate: The refresh rate refers to the number of times the video signal is updated per second, usually measured in Hertz (Hz). The refresh rate has a direct impact on the smoothness and picture quality of the video conference. In a network environment with low bandwidth or high latency, the system may need to adjust the refresh rate to ensure stable signal transmission. This process is controlled by the character overlay module according to the real-time network situation to optimize the video quality.
[0027] Specifically, the specific process of analyzing and generating bandwidth allocation parameters and signal compression optimization parameters is as follows: According to the network transmission parameters of the video conference, analyze the network status and evaluate the availability of the current bandwidth and the need for signal compression to generate bandwidth allocation parameters; The generated bandwidth allocation parameters include bandwidth demand analysis parameters, current network latency parameters, and bandwidth availability evaluation parameters; According to the bandwidth allocation situation, generate signal compression optimization parameters to optimize the efficiency and quality of signal transmission; The signal compression optimization parameters include signal compression ratio parameters, compression algorithm selection parameters, and transmission error rate optimization parameters.
[0028] In this implementation scheme, in a video conference, the quality of network transmission directly affects the smoothness and stability of video signals. Network transmission parameters include bandwidth, latency, packet loss rate, etc., which are key indicators for determining signal quality and transmission efficiency. Therefore, the network performance detection module first needs to monitor these network transmission parameters in real time to obtain the network status information required for the video conference. Bandwidth: It is the maximum rate at which data can be transmitted in a network, usually expressed in Mbps (megabits per second). The size of the bandwidth determines the carrying capacity of the data stream in the video conference and affects video and audio quality, especially in high-definition video conferences. Latency: It refers to the time delay of data from the sending end to the receiving end. The smaller the latency, the better the synchronization of video and audio. Excessive latency will cause audio and video out-of-sync and affect the conference experience. Packet loss rate: It refers to the proportion of data packets lost during data transmission. A high packet loss rate will cause a decline in video signal quality or audio interruption. Bandwidth availability refers to whether the current network environment can meet the transmission requirements of all signal sources. The network status may change due to various reasons (such as network congestion, other traffic occupying bandwidth, etc.), so it is necessary to evaluate the available situation of the bandwidth in real time. This evaluation includes: Bandwidth demand analysis parameters: Different signal sources may have different bandwidth requirements. For example, a high-definition (HD) video source requires more bandwidth, while a standard definition (SD) video source has a lower bandwidth requirement. According to the requirements of each signal source, evaluate whether the current network is sufficient to support the smooth transmission of these signals. Current network latency parameters: The evaluation of latency is an important basis for judging whether the network can support real-time video streams. If the latency is too high, the synchronization of video and audio may be affected. Bandwidth availability evaluation parameters: Based on the data monitored by the network status, evaluate the size of the current available bandwidth and whether it meets the signal transmission requirements. If the bandwidth is insufficient, adjustments may be needed through means such as compression optimization. Bandwidth allocation parameters are strategies for reasonably allocating network resources, aiming to ensure that each signal source in the video conference can obtain sufficient bandwidth and guarantee the stability and high quality of signal transmission. The process of generating bandwidth allocation parameters includes: Determine the bandwidth requirements of each signal source according to the bandwidth demand analysis parameters. According to the network latency and bandwidth availability evaluation parameters, judge whether the network is sufficient to support the required bandwidth and reasonably adjust the allocation strategy. Optimize the bandwidth allocation to ensure that the bandwidth allocation for each signal source not only meets the requirements but also does not cause network bottlenecks. The purpose of signal compression optimization is to reduce the bandwidth required for transmission while ensuring video quality, thereby improving the efficiency of signal transmission. In the case of limited bandwidth, compression is a key step to ensure the smooth progress of the video conference. The process of generating signal compression optimization parameters includes: Signal compression ratio parameter: The signal compression ratio refers to the ratio of the size of the original signal to the size of the compressed signal. The higher the compression ratio, the smaller the bandwidth required for transmission, but excessive compression will affect signal quality. The selection of the signal compression ratio needs to balance bandwidth utilization and video quality.Compression algorithm selection parameters: Selecting an appropriate video compression algorithm (such as H.264, H.265, etc.) is an important step in signal compression optimization. Different algorithms have different compression efficiencies and computational complexities, so it is necessary to select according to factors such as network bandwidth and signal quality. Transmission error rate optimization parameters: Video signals may have errors during transmission, and the error rate will affect the quality of video signals. The transmission error rate optimization parameters reduce the impact of errors and improve the stability of signal transmission by selecting appropriate encoding and error correction mechanisms.
[0029] Specifically, based on the bandwidth allocation parameters and signal compression optimization parameters, the specific process of prioritizing each signal source required for video conference matrix switching in combination with the signal source attributes is as follows: According to the bandwidth demand analysis parameters, current network latency parameters, and bandwidth availability evaluation parameters, evaluate the bandwidth demand, latency, and bandwidth availability during the transmission of the signal source, and prioritize the signal sources with low bandwidth demand, low latency, and high bandwidth availability; According to the signal compression rate parameters, compression algorithm selection parameters, and transmission error rate optimization parameters, evaluate the compression rate, compression algorithm efficiency, and transmission error rate of each signal source, and prioritize the signal sources with low compression rate, high compression algorithm efficiency, and low transmission error rate.
[0030] In this implementation solution, there are bandwidth requirement analysis parameters, current network latency parameters, and bandwidth availability evaluation parameters: Bandwidth requirement analysis parameters: refer to evaluating the bandwidth required for each signal source during transmission and calculating the minimum bandwidth value required for each signal source during transmission. Current network latency parameters: refer to the latency situation in the network, that is, the transmission time from the sending end to the receiving end, usually measured in milliseconds (ms). The lower the network latency, the faster the response of the signal source and the higher the priority. Bandwidth availability evaluation parameters: refer to evaluating the available situation of the current network bandwidth, analyzing whether there are bandwidth bottlenecks or network congestion in the current network, and determining the priority allocation of signal sources. Priority sorting of signal sources with low bandwidth requirements, low latency, and high bandwidth availability: Through the comprehensive evaluation of these parameters, those signal sources that require less network bandwidth, have less latency, and have higher available bandwidth in the current network environment are preferentially selected, which can ensure the smoothness and low latency of video conferencing. Signal compression ratio parameters, compression algorithm selection parameters, transmission error rate optimization parameters: Signal compression ratio parameters: refer to the compression ratio adopted when compressing the signal source. A high compression ratio means that less bandwidth is required for transmission, but it may reduce the quality of the image or video. Compression algorithm selection parameters: refer to the efficiency of the compression algorithm adopted. For example, some efficient compression algorithms (such as H.264 or HEVC) can maintain better signal quality at a higher compression ratio. Transmission error rate optimization parameters: refer to the proportion of signal errors during transmission. The lower the error rate, the more stable the signal quality. Priority sorting of signal sources with low compression ratio, efficient compression algorithm, and low transmission error rate: These signal sources are processed with efficient compression and have a low error rate during transmission, which can ensure better video quality under limited bandwidth, so they should be preferentially sorted. Comprehensive sorting process: Comprehensive parameters such as bandwidth requirement, latency, bandwidth availability, and compression efficiency are used to perform priority sorting on each signal source. During the sorting process, first ensure that signal sources with low bandwidth occupancy and low latency obtain the priority mapping position, and then perform priority sorting on the compression efficiency and transmission stability of the signal sources. Through this comprehensive sorting, it can be ensured that the video conferencing system operates stably and provides a good experience in a dynamic bandwidth and signal environment.
[0031] Specifically, the specific process of determining the priority mapping position of the signal source in the matrix is as follows: Weights are assigned to the bandwidth allocation parameters and signal compression optimization parameters, and the bandwidth requirements, latency requirements, bandwidth availability, compression efficiency, and error rate of the signal sources are comprehensively evaluated to determine the priority sorting of each signal source in the matrix and determine the priority sorting of each signal source in the matrix.
[0032] In this implementation, weights are assigned to the bandwidth allocation parameters and signal compression optimization parameters: Bandwidth allocation parameter weight: Based on the tightness of network resources and the priority of bandwidth allocation, certain weights are assigned to parameters such as bandwidth demand, network latency, and bandwidth availability. Generally speaking, in the case of limited bandwidth, signal sources with lower bandwidth demand and smaller latency should be given higher weights. Signal compression optimization parameter weight: Similarly, weights are assigned to parameters such as signal compression ratio, compression algorithm efficiency, and transmission error rate. Signal sources with high compression efficiency and low error rate may require fewer bandwidth resources, so they also need to be considered in weight assignment. The purpose of weight assignment is to ensure that the priority requirements of the system are more reasonably reflected in the comprehensive evaluation by assigning different importance to different performance parameters. Comprehensive evaluation of the bandwidth demand, latency requirement, bandwidth availability, compression efficiency, and error rate of signal sources: Bandwidth demand: That is, the amount of bandwidth required for each signal source to transmit. Signal sources with low bandwidth demand should be given priority to avoid network congestion. Latency requirement: The latency requirement of each signal source. Signal sources with low latency requirements should be processed first to ensure the real-time nature of video calls. Bandwidth availability: Refers to the size of the available bandwidth in the current network. If the bandwidth is sufficient, the system can support the simultaneous transmission of more signal sources; if the bandwidth is limited, signal sources with higher priorities should be arranged in the preferred matrix positions. Compression efficiency: Refers to the amount of data after the signal is compressed before transmission. A high compression ratio means lower bandwidth consumption, so it has a higher priority. Error rate: The error situation of the signal during transmission. Signal sources with low error rates should be given priority because they can provide more stable and high-quality video transmission. Comprehensive evaluation process: By using the method of weighted average, the bandwidth demand, latency requirement, bandwidth availability, compression efficiency, and error rate of each signal source are comprehensively considered to generate a comprehensive score for each signal source, reflecting the priority of the signal source.
[0033] Specifically, the specific process of allocating matrix positions and performing signal switching is as follows: According to the priority order after weight assignment, the signal sources are mapped to the corresponding positions in the matrix, and signal sources with higher priorities are assigned to the preferred matrix positions; According to the assigned matrix positions, the signal switching module transmits the high-priority signal sources to the corresponding matrix positions, replaces the low-priority signal sources in the matrix, and performs signal switching; According to the matrix configuration, the signal transmission link is adjusted, including updating the video display position, adjusting the signal output source, and switching the input and output ports; After the signal switching is completed, the characteristics of the switched signal are monitored.
[0034] In this implementation solution, according to the priority sorting after weight allocation, the signal sources are mapped to the corresponding positions in the matrix. The signal sources with higher priority are assigned to the preferred matrix positions: Signal source mapping: According to the priority sorting obtained in the previous steps, the system maps the signal sources to various positions in the matrix. The signal sources with high priority are assigned to the optimal positions in the matrix, and these positions usually occupy channels with higher bandwidth and lower latency. Preferred matrix positions: The positions of the matrix are usually divided into different levels, and the signal sources with higher priority are assigned to the preferred levels (for example, the first row, the first few ports, or the preferred display areas) to ensure their transmission quality and real-time performance. According to the assigned matrix positions, the signal switching module transmits the high-priority signal sources to the corresponding matrix positions, replaces the low-priority signal sources in the matrix, and performs signal switching: Signal switching operation: The signal switching module transmits the high-priority signal sources to the corresponding positions in the matrix according to the priority positions pre-assigned in the matrix. At the same time, the low-priority signal sources will be replaced or rescheduled to secondary positions to free up bandwidth or display space. Signal source replacement: This replacement process ensures that the resources of the matrix positions are always assigned to the optimal signal sources, thereby improving the fluency and picture quality of the video conference. The transmission of low-priority signal sources may reduce the bandwidth or significantly degrade the display effect, so they need to be adjusted. According to the matrix configuration, adjust the signal transmission link, including updating the video display position, adjusting the signal output source, and switching the input and output ports: Adjusting the signal transmission link: After signal switching, the system updates the signal transmission link according to the matrix configuration. This includes: Updating the video display position: According to the priority of the signal source, adjust the display position of the video signal, such as adjusting the picture layout on the video wall or monitor. Adjusting the signal output source: In the matrix, the output ports of the signal sources may change, so it is necessary to adjust the signal output path to ensure that the high-priority signals are transmitted through the best channels. Switching the input and output ports: If the configuration of the input and output ports of the video signal source and the matrix changes, the system will automatically switch the port configuration to adapt to the new signal source position. This step helps to ensure the stable output and timely transmission of the signal. After the signal switching is completed, monitor the characteristics of the switched signal: Monitoring the signal characteristics: After the signal switching is completed, the system needs to monitor the quality and stability of the signal in real time, including parameters such as the bandwidth, latency, and bit error rate of the signal. This is to ensure that the video conference quality is not affected after the signal switching and that a high-quality video stream can be continuously provided. Signal characteristic evaluation: The monitoring process may include automatically detecting whether the signal has problems such as excessive latency, packet loss, image freezing, or other issues. If an abnormality occurs, the system can adjust the priority of the signal source again and perform matrix switching again to ensure the smooth progress of the meeting.
[0035] Specifically, according to the signal characteristics after switching, the specific process of dynamically adjusting the encryption capacity and level is as follows: Analyze the signal characteristics after signal switching, including bandwidth requirements, latency, compression efficiency, and bit error rate, to determine the security requirements of the signal; Calculate the required encryption capacity and encryption level according to the transmission characteristics of the signal, and judge whether it is necessary to enhance the encryption intensity; Dynamically adjust the encryption capacity and level according to the signal characteristics and calculation results.
[0036] In this implementation, analyze the signal characteristics after signal switching, including bandwidth requirements, latency, compression efficiency, and bit error rate, to determine the security requirements of the signal: Bandwidth requirements: The bandwidth requirements of the signal determine the amount of data transmission. Signals with higher bandwidths may require more encryption resources to ensure data integrity and security, especially when the network transmission load is heavy. Latency: The latency parameter reflects the transmission time of the signal from the source to the destination. Higher latency may affect the real-time nature of encryption processing. Therefore, it is necessary to evaluate the impact of the encryption process on latency to avoid a too-long encryption process from affecting the signal quality. Compression efficiency: The higher the compression efficiency, the smaller the data volume, and the lower the bandwidth requirements during transmission. This may mean that the data compression algorithm can retain more information without affecting security. Therefore, in signals with high compression efficiency, the encryption complexity may be reduced. Bit error rate: The bit error rate is the frequency of errors occurring during signal transmission. Signals with a high bit error rate may be vulnerable to attacks during transmission. Therefore, it is necessary to strengthen the encryption intensity to ensure data confidentiality and integrity. Security requirements of the signal: Considering these characteristics, the system can evaluate the security requirements of the signal and determine whether additional encryption measures need to be applied, such as selecting a higher encryption intensity or increasing the encryption capacity. Calculate the required encryption capacity and encryption level based on the signal transmission characteristics, and determine whether to enhance the encryption intensity: Calculate the encryption capacity and level: By analyzing the bandwidth, latency, compression efficiency, and bit error rate of the signal, the system can calculate the appropriate encryption capacity and level. For example: If the bandwidth requirements are high, the system may need to increase the encryption capacity to ensure the effective transmission of encrypted data. If the bit error rate is high, it may be necessary to increase the encryption intensity to ensure that the signal is not attacked and the data is secure. Determine the encryption intensity: Based on these parameters, the system will decide whether to enhance the encryption intensity. For example, signals with low bandwidth or high bit error rate may require the application of strong encryption algorithms such as AES-256-bit encryption; conversely, lower-intensity encryption algorithms can be used to reduce the system burden. Dynamically adjust the encryption capacity and level according to the signal characteristics and calculation results: Dynamically adjust the encryption: Once the security requirements and encryption requirements of the signal are calculated, the system will dynamically adjust the encryption capacity and level. At this time, the encryption intensity will be automatically increased or decreased according to the signal characteristics to balance the performance and security of the system: Enhance the encryption capacity: If the signal requires more protection (such as high-bandwidth, low-latency, or high-bit-error-rate signals), the system will allocate more encryption resources. Increase the encryption level: If there are high security risks during transmission, the system will increase the encryption level, such as using a stronger encryption algorithm or a larger key length. Optimize the encryption process: Through dynamic adjustment, ensure that the encryption and decryption processes do not affect the real-time nature and quality of the signal, while ensuring the confidentiality and integrity of the signal.
[0037] Specifically, the specific process of selecting the character overlay template according to the signal characteristics after switching by the signal switching module is as follows: According to the signal characteristics after switching, evaluate the transmission quality and stability of the signal, and identify the character overlay template that matches the current signal conditions; After the signal is switched, load and apply the selected character overlay template to the video stream to ensure that the character content can be clearly fused with the video signal while being compatible with the transmission characteristics of the current signal.
[0038] In this implementation plan, according to the signal characteristics after switching, evaluate the transmission quality and stability of the signal, and identify the character overlay template that matches the current signal conditions: Evaluation of transmission quality and stability: After the signal switching is completed, evaluate the quality and stability of the signal. Select the matching character overlay template: According to the signal quality evaluation results, the system will select a suitable character overlay template. For signals with high quality, low latency, and low bit error rate, a simple template that is not easy to interfere with the signal can be selected; For low-quality signals, a template with stronger fault tolerance may be selected (for example, increasing the border of the characters, enhancing the contrast, etc.). After the signal is switched, load and apply the selected character overlay template to the video stream to ensure that the character content can be clearly fused with the video signal: Load the selected template: Once the character overlay template is determined, the system will load the template into the video signal stream and prepare to combine it with the video content. Character overlay usually includes information such as timestamps, identifiers, titles, etc. Ensure clear fusion: After loading the template, it is necessary to ensure that the character information can be clearly displayed and perfectly fused with the video signal. This usually involves adjusting parameters such as the size, color, transparency, and position of the characters to avoid conflicts between the character information and the video content or blocking of important details. At the same time, be compatible with the transmission characteristics of the current signal: Compatibility processing: Ensure that the selected character overlay template not only adapts to the signal quality but also is compatible with the transmission characteristics of the signal. For example: If the network bandwidth is low, a more concise character style may be used to avoid excessive character overlay affecting the video fluency. If there is a high latency or bit error, redundant information may be applied or the format of the template may be adjusted to ensure that even if the signal is slightly lost, the character information can still be stably displayed. Adapt to different conditions: The design of the character overlay template needs to be able to adapt to different signal conditions and maintain sufficient readability and visual effects in any case to ensure clear and accurate information transmission.
[0039] Specifically, the specific process of adjusting the refresh rate is as follows: According to the signal characteristics after switching, evaluate the stability and bandwidth availability of the signal, and obtain the signal quality index; Compare the signal quality index with the preset signal quality index threshold; When the signal quality index is greater than or equal to the threshold, maintain or increase the refresh rate; When the signal quality index is less than the threshold, reduce the refresh rate.
[0040] In this implementation scheme, according to the characteristics of the switched signal, the stability and bandwidth availability of the signal are evaluated to obtain the signal quality index: the quality of the signal is evaluated by analyzing the stability of the signal, such as delay, jitter, and bit error rate. When the signal stability is high, it means the signal is relatively stable and not prone to stuttering or image distortion. Bandwidth is a key factor affecting the quality of video signals. By measuring the bandwidth allocation of the current network, the system can determine whether the bandwidth is sufficient to meet the transmission requirements of high-quality video signals.
[0041] Obtain the signal quality index: Based on the stability and bandwidth availability of the signal, these factors are combined to calculate the signal quality index, which reflects the overall quality of the signal and is used for further decision-making. The signal quality index formula is as follows: The signal quality index formula is as follows: Explanation of formula parameters: BW avail : Represents the available bandwidth in the current network, BW max is the maximum bandwidth capacity of the network. The larger the bandwidth, the stronger the transmission ability and the better the video quality. α is the influence weight coefficient of bandwidth availability on signal quality, usually a positive value, which controls the influence degree of bandwidth. This item affects the signal quality through the relative availability of bandwidth. β is the exponential factor, which can adjust the influence of bandwidth. Delay avg : The average delay of the signal from the source to the receiver. The smaller the delay, the stronger the real-time performance of the video. γ is the influence weight coefficient of delay on signal quality, usually a positive value, which adjusts the influence of delay on video quality. The influence of delay on signal quality is non-linear. The higher the delay, the greater the influence. The logarithmic function is used to compress the influence of delay. BER: Represents the bit error rate during signal transmission. The lower the bit error rate, the higher the video quality. δ is the influence weight coefficient of bit error rate on signal quality. This item uses the exponential function (ζ is the exponential factor) to perform non-linear weighting on the bit error rate. The higher the bit error rate, the greater the influence. PLR (packet loss rate): Represents the ratio of packets lost during transmission. The higher the packet loss rate, the worse the video quality. η is the influence weight coefficient of packet loss rate on signal quality. This item processes through the exponential function of the packet loss rate. The larger the packet loss rate, the stronger the influence. Variance: Represents the volatility of signal quality. The greater the volatility, the worse the stability and continuity of the video stream. θ is the influence weight coefficient of volatility on signal quality. The absolute value of volatility is used to represent the stability of the signal. ξ is the influence degree of volatility on signal quality.
[0042] Compare the signal quality index with a preset signal quality index threshold: The signal quality index is compared with the threshold: The system sets a signal quality index threshold, which represents the minimum quality standard for signal transmission. By comparing the current signal quality index with this threshold, the system can determine whether the signal quality meets the expected standard. When the signal quality index is greater than or equal to the threshold: If the signal quality index meets or exceeds the preset threshold, it indicates that the signal quality is good, and the refresh rate can be maintained or increased to maintain video smoothness and clarity. When the signal quality index is less than the threshold: If the signal quality index is lower than the preset threshold, it indicates that the signal quality is poor, and there may be stuttering or delay phenomena. At this time, the system will reduce the refresh rate to reduce the pressure on bandwidth and computing resources, thereby ensuring the smooth transmission of video signals. Adjust the refresh rate: Maintain or increase the refresh rate: When the signal quality is good, the system can increase the refresh rate to ensure the smooth display of video content and reduce image blurring or lag. Reduce the refresh rate: When the signal quality is poor, reducing the refresh rate helps reduce bandwidth requirements and, by reducing the amount of data transmitted, alleviates the network burden, thereby maintaining the stability of video signals and enabling normal playback even under bandwidth constraints.
[0043] In summary, the present application has at least the following effects:
[0044] A matrix switching system for video conferencing comprehensively considers factors such as bandwidth availability, latency, bit error rate, packet loss rate, and signal volatility to accurately evaluate the quality of video signals and dynamically adjust the refresh rate and encryption level according to signal characteristics, effectively improving the video quality and real-time performance in video conferencing. According to real-time network performance monitoring, it reasonably allocates bandwidth and optimizes signal compression, not only ensuring the efficiency of signal source transmission but also minimizing the impact of network bandwidth and transmission latency on video conferencing. By dynamically adjusting the encryption capacity and encryption level, it ensures that video signals meet security requirements during transmission. Especially when the network state changes, it can timely adjust the encryption strength to protect the privacy and security of conference content. Based on the signal source attributes, it prioritizes the video conferencing matrix to ensure the preferred mapping position of high-priority signal sources in the matrix, thereby ensuring the preferential processing and higher-quality display effects of important signal sources. By selecting an appropriate character overlay template and adjusting the refresh rate, it can adjust the display effect in real time according to the signal quality, enabling the text information in the video conferencing to be stably integrated with the video signal and improving the clarity and stability of information transmission.
[0045] Those skilled in the art should understand that the embodiments of the present invention can be provided as a method, a system, or a computer program product. Therefore, the present invention can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present invention can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk memory, CD-ROM, optical memory, etc.) that contain computer-usable program code.
[0046] The present invention is described with reference to the flowcharts and / or block diagrams of systems, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each flow and / or block in the flowchart and / or block diagram, as well as the combination of flows and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, such that the instructions executed by the processor of the computer or other programmable data processing devices generate means for implementing the functions specified in Figure 1 one flow or multiple flows and / or blocks Figure 1 one block or multiple blocks.
[0047] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, such that the instructions stored in the computer-readable memory generate a manufactured article including instruction means that implement the functions specified in Figure 1 one flow or multiple flows and / or blocks Figure 1 one block or multiple blocks.
[0048] These computer program instructions can also be loaded onto a computer or other programmable data processing device, such that a series of operation steps are executed on the computer or other programmable device to generate a computer-implemented process, and thus the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in Figure 1 one flow or multiple flows and / or blocks Figure 1 one block or multiple blocks.
[0049] Although the preferred embodiments of the present invention have been described, those skilled in the art can make additional changes and modifications once they learn the basic creative concepts. Therefore, the appended claims are intended to be construed to include the preferred embodiments as well as all changes and modifications that fall within the scope of the present invention.
[0050] Obviously, those skilled in the art can make various modifications and variations to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention is also intended to include these modifications and variations.
Claims
1. A matrix switching system for video conferencing, characterized in that, It includes the following modules: network performance detection module, signal switching module, dynamic encryption control module, and character overlay module; The network performance detection module is used to monitor the network transmission parameters of the video conference in real time, analyze and generate bandwidth allocation parameters and signal compression optimization parameters; The signal switching module is used to prioritize each signal source required for video conference matrix switching based on the bandwidth allocation parameters and signal compression optimization parameters, combined with the signal source attributes, determine the priority mapping position of the signal source in the matrix, allocate matrix positions, perform signal switching, and identify the signal characteristics after switching; The dynamic encryption control module is used to dynamically adjust the encryption capacity and level according to the signal characteristics after switching; The character overlay module is used to select a character overlay template and adjust the refresh rate according to the signal characteristics after switching by the signal switching module; The specific process of prioritizing each signal source required for video conference matrix switching based on the bandwidth allocation parameters and signal compression optimization parameters, combined with the signal source attributes is as follows: According to the bandwidth demand analysis parameters, current network delay parameters, and bandwidth availability evaluation parameters, evaluate the bandwidth demand, delay, and bandwidth availability during the transmission of the signal source, and prioritize the signal sources with low bandwidth demand, low delay, and high bandwidth availability; According to the signal compression rate parameters, compression algorithm selection parameters, and transmission error rate optimization parameters, evaluate the compression rate, compression algorithm efficiency, and transmission error rate of each signal source, and prioritize the signal sources with low compression rate, high compression algorithm efficiency, and low transmission error rate; The specific process of determining the priority mapping position of the signal source in the matrix is as follows: Assign weights to the bandwidth allocation parameters and signal compression optimization parameters, comprehensively evaluate the bandwidth demand, delay requirement, bandwidth availability, compression efficiency, and error rate of the signal source, determine the priority ranking of each signal source in the matrix, and determine the priority ranking of each signal source in the matrix; The specific process of allocating matrix positions and performing signal switching is as follows: According to the priority ranking after weight allocation, map the signal source to the corresponding position in the matrix, and the signal source with a higher priority is assigned to a preferred matrix position; According to the allocated matrix positions, the signal switching module transmits the high-priority signal source to the corresponding matrix position, replaces the low-priority signal source in the matrix, and performs signal switching; According to the matrix configuration, adjust the signal transmission link, including updating the video display position, adjusting the signal output source, and switching the input and output ports; After the signal switching is completed, monitor the signal characteristics after switching; The specific process of dynamically adjusting the encryption capacity and level according to the signal characteristics after switching is as follows: Analyze the signal characteristics after signal switching, including bandwidth demand, delay, compression efficiency, and error rate, and determine the security requirements of the signal; According to the transmission characteristics of the signal, calculate the required encryption capacity and encryption level, and judge whether it is necessary to enhance the encryption intensity; Dynamically adjust the encryption capacity and level according to the signal characteristics and calculation results; The specific process of selecting a character overlay template according to the signal characteristics after switching by the signal switching module is as follows: Evaluate the transmission quality and stability of the signal according to the characteristics of the switched signal, and identify the character overlay template that matches the current signal conditions; After the signal is switched, load and apply the selected character overlay template to the video stream to ensure that the character content can be clearly integrated with the video signal while being compatible with the transmission characteristics of the current signal; The specific process of adjusting the refresh rate is as follows: According to the characteristics of the switched signal, evaluate the signal stability and bandwidth availability, and obtain the signal quality index; Compare the signal quality index with the preset signal quality index threshold; When the signal quality index is greater than or equal to the threshold, maintain or increase the refresh rate; When the signal quality index is less than the threshold, reduce the refresh rate.
2. The matrix switching system for video conferencing according to claim 1, characterized in that: The specific process of analyzing and generating bandwidth allocation parameters and signal compression optimization parameters is as follows: According to the network transmission parameters of the video conference, analyze the network status and evaluate the availability of the current bandwidth and the need for signal compression to generate bandwidth allocation parameters; The generated bandwidth allocation parameters include bandwidth demand analysis parameters, current network delay parameters, and bandwidth availability evaluation parameters; Generate signal compression optimization parameters according to the bandwidth allocation situation to optimize the efficiency and quality of signal transmission; The signal compression optimization parameters include signal compression rate parameters, compression algorithm selection parameters, and transmission error rate optimization parameters.
Citation Information
Patent Citations
A matrix switching system for video conferencing
CN117354448B
Matrix switching system for video conference
CN117354448A
System and method for a conference server architecture for low delay and distributed conferencing applications
WO2008082375A2