A method and system for synchronously controlling picture frame rates of multiple projection devices
By calculating the network quality and stability scores of multi-projection devices, identifying and adjusting the frame rate and code rate of the worst network devices, the frame rate synchronization problem in multi-projection devices is solved, and the synchronization of video streams and high-quality multi- Screen playback experience.
Patent Information
- Application Number
- CN202411559675.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-04
- Publication Date
- 2025-01-03
- Estimated Expiration
- 2044-11-04
AI Technical Summary
In multi-projection device scenarios, traditional frame rate synchronization control methods fail to effectively consider the differences in the network environment, resulting in the frame rate of video streams being out of sync on different devices, and the picture skips or delays occur, affecting the audience's visual experience and multimedia Interactiveness of content.
By calculating the network quality and stability score of the projection device, identify the devices with the worst network status, and adjust the frame rate and code rate of the video stream according to their network bandwidth and packet loss rate, synchronously adjust the video streams of all devices to reduce the number of reasons. The phenomenon of video playback out of synchronization caused by network quality differences.
It effectively reduces visual inconsistency, prevents picture tearing and frame skipping, ensures the consistency of multi-screen video playback and the unity of visual effects, and improves the viewing experience.
Smart Images

Figure CN119094715B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of frame rate control technology, and in particular to a method and system for synchronously controlling picture frame rates of a multi-projection device. Background Art
[0002] The field of frame rate control technology focuses on maintaining the coherence and synchronization of image frames during the processing, transmission and display of video content. This field involves a variety of technologies, including video encoding and decoding, signal processing, image rendering technology, and data buffering strategies, with the goal of optimizing visual display effects, reducing latency, and preventing screen tearing and frame skipping. Frame rate control is critical to ensuring the smoothness of video playback and the overall quality of the visual experience, especially in the presentation of high-dynamic, high-resolution visual content such as movies, video games, and professional broadcasting. In addition, frame rate control is also closely related to the responsiveness of the user interface and the interactivity of multimedia applications, and plays an indispensable role in enhancing the user experience.
[0003] Among them, the picture frame rate synchronization control method for multiple projection devices is mainly used to ensure that the image frames output by each device can be synchronized when using multiple projection devices. This control method is mainly used in occasions that require multi-screen cooperation, such as large-scale exhibitions, conferences, performances and virtual reality scenes. By synchronizing the frame rates of multiple devices, visual inconsistency can be effectively avoided, frame skipping can be prevented, and the audience can be ensured to have a seamless and consistent visual experience.
[0004] Traditional control methods focus on performance optimization in a single device or standard network environment, and fail to fully consider the impact of the network environment on frame rate synchronization. Especially when using multiple projection devices for large-scale exhibitions or conferences, the unevenness of network quality will cause the frame rates of video streams on different devices to be out of sync, affecting the audience's visual experience. Traditional methods lack a dynamic evaluation and adjustment mechanism for network quality differences between projection devices, making it difficult to ensure the quality and synchronization of video streams when network conditions change, resulting in frame skipping or delays, affecting the interactivity of multimedia content and viewing continuity, and significantly reducing the audience experience. Summary of the invention
[0005] The purpose of the present invention is to solve the shortcomings in the prior art and to propose a method and system for synchronously controlling the frame rate of a multi-projection device.
[0006] In order to achieve the above object, the present invention adopts the following technical solution: a method for synchronously controlling the frame rate of a multi-projection device, comprising the following steps:
[0007] S1: Based on the network data of the differentiated projection device, the network data includes network bandwidth, packet loss rate and delay, the network quality score is calculated, and according to the fluctuation of the network bandwidth, packet loss rate and delay of the projection device, the network stability score is calculated to obtain the network status information;
[0008] S2: Based on the network status information, calculate the network status index, identify the projection device with the worst network status index, and obtain a low-end device identification result;
[0009] S3: Based on the low-end device identification result, according to the network status indicator of the low-end device and the device bandwidth, the frame rate and bit rate of the projection video stream of the low-end device are adjusted, and the frame rate and bit rate of the video stream of the differentiated projection device are synchronously adjusted to obtain the projection device synchronization adjustment result;
[0010] S4: Based on the synchronous adjustment result of the projection device, the network status indicator deviation between the differentiated projection device and the low-end device is analyzed, the degree of deviation of the network status indicator is calculated, and the bit rate compensation amount of the differentiated projection device is calculated according to the degree of deviation of the network status indicator and the bandwidth deviation amount, and the video stream bit rate of the differentiated projection device is adjusted to obtain the synchronous projection bit rate optimization result.
[0011] The present invention is improved in that the method for calculating the network quality score is:
[0012] S111: Based on the differentiated projection devices, collect network data of the projection devices, where the network data includes network bandwidth, packet loss rate, and delay;
[0013] S112: Based on the network data, preprocess the data to remove abnormal values and fill in data missing points to obtain preprocessed network data;
[0014] S113: Based on the pre-processed network data, by formula:
[0015] Calculate the network quality score S, where: , and is the weight coefficient, B, P and d represent bandwidth, packet loss rate and delay data respectively, and S is the network quality score.
[0016] The present invention is improved in that the steps of obtaining the network status information are:
[0017] S121: Based on the differentiated projection device, collect network bandwidth, packet loss rate and delay data within a period of time, and each data is recorded in a time series form to obtain time series data;
[0018] S122: Calculate standard deviations of bandwidth, packet loss rate, and delay based on the time series data to obtain standard deviation information;
[0019] S123: Based on the standard deviation information, by formula:
[0020] Calculate the network stability score W, where , and are the standard deviations of bandwidth, packet loss rate and delay, respectively. , and is the weight coefficient, W is the network stability score;
[0021] S124: Based on the network stability score W, the current network quality score S is integrated to obtain network status information.
[0022] The present invention is improved in that the steps of obtaining the identification result of the low-end device are:
[0023] S211: Based on the network status information, according to the network quality score S and the network stability score W of each projection device, the formula:
[0024] Calculate the network status index N, where: and is the weight parameter, S is the network quality score, W is the network stability score, and N is the network status indicator;
[0025] S212: Based on the network status indicator N, by comparing the N values of the differentiated projection devices, marking the projection device with the smallest N value, and obtaining a low-end device identification result.
[0026] The present invention is improved in that the step of acquiring the synchronization adjustment result of the projection device is:
[0027] S311: based on the low-end device identification result, extract the current network status indicator N and network bandwidth B of the low-end device to obtain projection adjustment associated data;
[0028] S312: Adjust the associated data based on the projection, by formula:
[0029] Calculate the adjusted bitrate , and by the formula: Calculate the adjusted frame rate , where R is the basic bit rate, F is the basic frame rate, and B is the current network bandwidth. is the network bandwidth benchmark value, N is the current network status indicator, is the network status indicator benchmark value, is the adjusted bit rate, is the adjusted frame rate, and is the adjustment factor, and is the scaling factor;
[0030] S313: Based on the adjusted bit rate and adjusted frame rate , adjust the frame rate and bit rate of the projection video stream of the low-end device, and synchronously adjust the frame rate and bit rate of the video stream of the differentiated projection device to obtain the synchronization adjustment result of the projection device.
[0031] The present invention is improved in that the method for calculating the deviation degree of the network status indicator is:
[0032] S411: Based on the synchronization adjustment result of the projection device, current network status indicators of the differentiated projection device and the low-end device are collected to obtain deviation correlation data;
[0033] S412: Based on the deviation correlation data, by formula:
[0034] Calculate the deviation degree D of the network status indicator, where is the adjustment index, It is the network status indicator of the differentiated projection device. is the network status indicator of the low-end device, and D is the deviation degree of the network status indicator.
[0035] The present invention is improved in that the steps of obtaining the synchronous projection code rate optimization result are:
[0036] S421: Based on the deviation degree D of the network status indicator, by formula:
[0037] Calculate the bit rate compensation amount C, where is the bandwidth-to-bitrate conversion factor, is the nonlinear adjustment coefficient, is the proportional coefficient, D is the deviation degree of the network status indicator, and are the bandwidths of differentiated devices and low-end devices, respectively, and C is the bit rate compensation amount;
[0038] S422: Based on the bit rate compensation amount C, the compensated video stream bit rate is calculated, and the video stream bit rate of the differentiated projection device is adjusted to obtain a synchronous projection bit rate optimization result.
[0039] A picture frame rate synchronization control system for a multi-projection device, the picture frame rate synchronization control system for a multi-projection device is used to execute the picture frame rate synchronization control method for a multi-projection device, the system comprising:
[0040] The network quality assessment module calculates the network quality score based on the network data of the differentiated projection device, including network bandwidth, packet loss rate and delay, and obtains network quality information;
[0041] The network stability analysis module calculates the network stability score based on the network quality information and the fluctuation of the network bandwidth, packet loss rate and delay of the projection device to obtain network status information;
[0042] The low-end device identification module calculates the network status index based on the network status information, identifies the projection device with the worst network status index, and obtains the low-end device identification result;
[0043] The projection synchronization adjustment module adjusts the frame rate and bit rate of the projection video stream of the low-end device based on the low-end device identification result, according to the network status indicator of the low-end device and the device bandwidth size, and synchronously adjusts the video stream frame rate and bit rate of the differentiated projection device to obtain the projection device synchronization adjustment result;
[0044] The projection bit rate optimization module analyzes the network status indicator deviation between the differentiated projection device and the low-end device based on the synchronization adjustment result of the projection device, calculates the deviation degree of the network status indicator, calculates the bit rate compensation amount of the differentiated projection device in combination with the bandwidth deviation, adjusts the video stream bit rate of the differentiated projection device, and obtains the synchronization projection bit rate optimization result.
[0045] Compared with the prior art, the advantages and positive effects of the present invention are:
[0046] In the present invention, by calculating the network quality and stability score, it is possible to identify the device with the worst network status indicator, adjust its frame rate and bit rate, and synchronously adjust the video stream frame rate and bit rate of the differentiated projection device, effectively reducing the phenomenon of video playback asynchrony caused by network quality differences, ensuring the visual consistency of the output images of all devices, reducing visual incoherence, preventing image tearing and frame skipping caused by differences in network conditions, ensuring the consistency of video content on multiple screens and the unity of visual effects, and adjusting the bit rate by calculating and applying the degree of deviation of the network status indicator, optimizing the projected image quality, and improving the overall quality and viewing experience of multi-screen video playback. BRIEF DESCRIPTION OF THE DRAWINGS
[0047] Figure 1 is a flow chart of the method of the present invention;
[0048] Figure 2A flow chart for calculating a network quality score for the present invention;
[0049] Figure 3 A flow chart of obtaining network status information according to the present invention;
[0050] Figure 4 A flow chart of obtaining low-end device identification results for the present invention;
[0051] Figure 5 A flow chart of obtaining the synchronization adjustment result of the projection device according to the present invention;
[0052] Figure 6 A flow chart of calculating the degree of deviation of a network status indicator according to the present invention;
[0053] Figure 7 The present invention is a flow chart for obtaining synchronous projection code rate optimization results. DETAILED DESCRIPTION
[0054] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.
[0055] In the description of the present invention, it should be understood that the terms "length", "width", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc., indicating positions or positional relationships, are based on the positions or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, in the description of the present invention, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.
[0056] See also Figure 1 The present invention provides a technical solution: a method for synchronously controlling the frame rate of a multi-projection device, comprising the following steps:
[0057] S1: Based on the network data of the differentiated projection device, the network data includes network bandwidth, packet loss rate and delay, the network quality score is calculated, and according to the fluctuation of the network bandwidth, packet loss rate and delay of the projection device, the network stability score is calculated to obtain the network status information;
[0058] S2: Based on the network status information, the network status index is calculated, and the projection device with the worst network status index is identified to obtain the low-end device identification result;
[0059] S3: Based on the low-end device identification result, according to the network status indicator of the low-end device and the device bandwidth, the frame rate and bit rate of the projection video stream of the low-end device are adjusted, and the frame rate and bit rate of the video stream of the differentiated projection device are adjusted synchronously to obtain the projection device synchronization adjustment result;
[0060] S4: Based on the synchronous adjustment result of the projection device, the network status indicator deviation between the differentiated projection device and the low-end device is analyzed, the deviation degree of the network status indicator is calculated, and the bit rate compensation amount of the differentiated projection device is calculated according to the deviation degree of the network status indicator and the bandwidth deviation amount, and the video stream bit rate of the differentiated projection device is adjusted to obtain the synchronous projection bit rate optimization result;
[0061] The network status information includes the network stability index and network quality of each device. The low-end device identification results include the network bandwidth and network status indicators of the identified projection devices. The projection device synchronization adjustment results include the frame rate value, bit rate value and synchronization execution time point of each device after synchronization adjustment. The synchronous projection bit rate optimization results include the bit rate compensation value and the compensated bit rate value of each device.
[0062] See also Figure 2 , the method for calculating the network quality score is:
[0063] S111: Based on the differentiated projection devices, collect network data of the projection devices, where the network data includes network bandwidth, packet loss rate, and delay;
[0064] S112: Based on the network data, preprocess the data to remove outliers and fill in data missing points to obtain preprocessed network data;
[0065] S113: Based on the preprocessed network data, the formula:
[0066] Calculate the network quality score S, where , and is the weight coefficient, B, P and d represent bandwidth, packet loss rate and delay data respectively, and S is the network quality score.
[0067] formula:
[0068]
[0069] Parameter meaning and acquisition method:
[0070] , and : It is the weight coefficient of bandwidth, packet loss rate and delay, which is usually set by network engineers according to network performance evaluation standards, such as =0.5, =0.3, =0.2, and the weight reflects the relative importance of each indicator in the scoring system.
[0071] B: indicates pre-processed bandwidth data, which is usually obtained through network monitoring tools, such as using SNMP protocol to obtain real-time bandwidth usage from routers or switches. For example, the average bandwidth obtained within a certain time window is 100Mbps.
[0072] P: Packet loss rate data, usually obtained through network test packages such as ICMPEcho or other network performance test tools. For example, the test results show that the average packet loss rate is 0.02 (2%).
[0073] d: Delay data, which can also be obtained through ICMPEcho request or other network delay test tools. For example, the average network delay obtained from the test is 50 milliseconds.
[0074] Calculation example:
[0075] Calculation process:
[0076] Set the parameter values as above. Substitute the values into the formula for calculation:
[0077]
[0078] calculate : Approximately equal to 4.615.
[0079] calculate : The result is 0.98.
[0080] calculate : Approximately equal to 0.951.
[0081] Substitute the values into the formula to calculate S:
[0082] The calculated network quality score S=2.7917. The score reflects the network performance evaluation after integrating bandwidth, packet loss rate and latency. The higher the score, the better the network quality.
[0083] See also Figure 3 , the steps to obtain network status information are:
[0084] S121: Based on the differentiated projection device, collect network bandwidth, packet loss rate and delay data within a period of time, and each data is recorded in a time series form to obtain time series data;
[0085] S122: Based on time series data, through the formula:
[0086] Calculate the standard deviation of bandwidth, packet loss rate and delay to obtain standard deviation information, where represents the i-th data point, is the mean, n is the total number of data points, is the standard deviation;
[0087] S123: Based on the standard deviation information, the formula is:
[0088] Calculate the network stability score W, where , and are the standard deviations of bandwidth, packet loss rate and delay, respectively. , and is the weight coefficient, W is the network stability score;
[0089] S124: Based on the network stability score W, the current network quality score S is integrated to obtain network status information.
[0090] formula: and
[0091]
[0092] Parameter details and how to obtain them:
[0093] , and : is the standard deviation of bandwidth, packet loss rate and latency, which is used to measure the volatility of each indicator.
[0094] , and : is the weight coefficient of the impact of bandwidth, packet loss rate and delay volatility on the network stability score. The choice of weight reflects the relative importance of different parameters in the network stability assessment and is usually set by network engineers based on network design and performance requirements.
[0095] : A single data point representing a specific value of network bandwidth, packet loss rate, or latency collected during a specific time interval. The data is collected in real time from network devices using network monitoring tools such as SNMP tools or other network performance monitoring software.
[0096] : The average value is the arithmetic mean of all data points during the observation period. The average is calculated to determine a baseline for the trend in the data set, measuring how much each individual data point deviates from the average.
[0097] n: The total number of data points, representing the number of data samples collected within a specific period of time.
[0098] Calculation Example
[0099] Set the data points and parameters as follows:
[0100] Bandwidth data points: .
[0101] Packet loss rate data points: .
[0102] Delayed data points: .
[0103] Weight coefficient: .
[0104] Calculate the standard deviation:
[0105] Bandwidth standard deviation :
[0106]
[0107] Packet loss rate standard deviation :
[0108]
[0109] Latency Standard Deviation :
[0110]
[0111] Calculate the network stability score W:
[0112] Calculated network stability score , reflecting the comprehensive impact of network fluctuations in bandwidth, packet loss rate, and latency on overall network stability. A lower score indicates that the network is more volatile, affecting the stability of network performance.
[0113] See also Figure 4 , the steps to obtain the recognition results of low-end devices are:
[0114] S211: Based on the network status information, according to the network quality score S and the network stability score W of each projection device, the formula is:
[0115] Calculate the network status index N, where: and is the weight parameter, S is the network quality score, W is the network stability score, and N is the network status indicator;
[0116] S212: Based on the network status indicator N, by comparing the N values of the differentiated projection devices, marking the projection device with the smallest N value, and obtaining a low-end device identification result.
[0117] formula:
[0118]
[0119] Parameter details and how to obtain them:
[0120] S: Network quality score, calculated by the previous method.
[0121] W: Network stability score, calculated using the previous method.
[0122] and : The parameter is a weight coefficient used to balance the influence of S and W in the final network status indicator N. The weight is set by the network analyst based on the specific needs and performance goals of the network to ensure that N reflects the true portrait of the network status.
[0123] Calculation example:
[0124] The parameter values are set as follows:
[0125] : Represents a better network quality score.
[0126] : Represents a certain degree of network stability.
[0127] : Indicates that the network quality score has a higher influence in the network status indicators.
[0128] : Indicates the influence of network stability score in network status indicators.
[0129] Calculate the network status index N:
[0130] Calculated network status indicators A higher score indicates that the overall state of the network is evaluated as being better for the given parameters and weights.
[0131] See also Figure 5 , the steps for obtaining the synchronous adjustment results of the projection device are:
[0132] S311: based on the low-end device identification result, extract the current network status indicator N and network bandwidth B of the low-end device to obtain projection adjustment associated data;
[0133] S312: Adjust the associated data based on the projection, by formula:
[0134] Calculate the adjusted bitrate , and by the formula: Calculate the adjusted frame rate , where R is the basic bit rate, F is the basic frame rate, and B is the current network bandwidth. is the network bandwidth benchmark value, N is the current network status indicator, is the network status indicator benchmark value, is the adjusted bit rate, is the adjusted frame rate, and is the adjustment factor, and is the scaling factor;
[0135] S313: Based on the adjusted bit rate and adjusted frame rate , adjust the frame rate and bit rate of the projection video stream of the low-end device, and synchronously adjust the frame rate and bit rate of the video stream of the differentiated projection device to obtain the synchronization adjustment result of the projection device.
[0136] formula: and
[0137] Parameter details and how to obtain them:
[0138] R: Basic bitrate, usually set to the initial bitrate of the video stream, determined by the device's processing power and software settings.
[0139] F: Basic frame rate, set as the initial frame rate of the video stream, according to the video quality requirements and hardware capabilities.
[0140] B: Current network bandwidth, obtained through real-time network monitoring tools, indicating the data transmission rate that the current network can support.
[0141] : The network bandwidth baseline value, determined by the network's design or historical average performance, is used to compare the relative changes in current bandwidth.
[0142] N: Current network status indicator, calculated by the previous steps.
[0143] : The baseline value of the network status indicator is set according to the network design or historical data and is used to evaluate the deviation between the current network status and the expected status.
[0144] and : Adjustment factor used to enhance the impact of bandwidth changes on bitrate and frame rate. The coefficient reflects the flexibility of adjustment under different network conditions and can be determined based on actual observations of device performance and network quality.
[0145] and : Scaling factor, adjusts the sensitivity of network status indicator changes to bitrate and frame rate. The factor helps fine-tune the output to adapt to small changes in network status.
[0146] Calculation example:
[0147] Set the parameters as follows:
[0148] , , , , , , , , , .
[0149] Calculate the adjusted bitrate and frame rate :
[0150]
[0151] The calculation results show that the adjusted bit rate is , the frame rate is . Indicates that under the current network bandwidth and status, the output settings of the video stream are appropriately reduced relative to the baseline level to adapt to network conditions. This dynamic adjustment helps reduce the occurrence of buffering and interruptions, thereby improving the viewing experience of end users.
[0152] See also Figure 6 ,The method for calculating the deviation degree of network status indicators is:
[0153] S411: Based on the synchronization adjustment result of the projection device, current network status indicators of the differentiated projection device and the low-end device are collected to obtain deviation correlation data;
[0154] S412: Based on the deviation correlation data, through the formula:
[0155] Calculate the deviation degree D of the network status indicator, where is the adjustment index, It is the network status indicator of the differentiated projection device. is the network status indicator of the low-end device, and D is the deviation degree of the network status indicator.
[0156] formula:
[0157]
[0158] Parameter details and how to obtain them:
[0159] : The network status indicators of the differentiated projection devices are calculated by the previous method.
[0160] : Network status indicators of low-end devices, calculated using the previous method.
[0161] : Adjustment index for deviation calculation. It is a custom parameter used to adjust the sensitivity of the deviation degree and the expression of amplifying or reducing the deviation according to specific scenarios. It is set based on the needs of data analysis or performance optimization.
[0162] Calculation example:
[0163] Set the following parameter values:
[0164] : Network status indicators for differentiated devices.
[0165] : Network status indicators for low-end devices.
[0166] : Adjustment index used to enhance the expression of deviation.
[0167] Calculation process:
[0168] Calculate the degree of deviation of network status indicators:
[0169]
[0170] The calculated degree of deviation ,The results show the degree of deviation in network performance of differentiated projection devices relative to low-end devices, and the calculations show the specific differences in performance between different devices.
[0171] See also Figure 7 , the steps to obtain the synchronous projection code rate optimization results are:
[0172] S421: Based on the deviation degree D of the network status indicator, the formula is:
[0173] Calculate the bit rate compensation amount C, where is the bandwidth-to-bitrate conversion factor, is the nonlinear adjustment coefficient, is the proportional coefficient, D is the deviation degree of the network status indicator, and are the bandwidths of differentiated devices and low-end devices, respectively, and C is the bit rate compensation amount;
[0174] S422: Based on the bit rate compensation amount C, by formula:
[0175] Calculate the compensated video stream bit rate, adjust the video stream bit rate of the differentiated projection device, and obtain the synchronous projection bit rate optimization result, where: is the adjusted video stream bitrate. is the bit rate of the video stream after compensation.
[0176] formula:
[0177] and
[0178] Parameter details and how to obtain them:
[0179] : Bandwidth-to-bitrate conversion factor, used to convert the difference in bandwidth into the bitrate adjustment. This factor is set based on device performance and network optimization requirements to ensure that the bitrate adjustment is proportional to the actual difference in bandwidth.
[0180] : Nonlinear adjustment coefficient, used to control the influence of deviation D on rate compensation. By adding nonlinear factors, the rate adjustment caused by network performance differences can be adjusted more finely.
[0181] : Proportional coefficient, used to make adjustments based on the actual bandwidth unit and the expected bit rate unit to ensure the applicability and accuracy of the calculation results.
[0182] D: Deviation degree of network status indicator, calculated by the previous method.
[0183] and : They are the bandwidths of differentiated devices and low-end devices, respectively. They are acquired in real time through the network monitoring system and reflect the maximum data transmission rate that can be used by the device under the current network conditions.
[0184] : The bit rate of the adjusted video stream, calculated using the previous method.
[0185] Calculation example:
[0186] Set the parameter values as follows:
[0187] (Bandwidth Bit Rate Conversion Factor), (non-linear adjustment coefficient), (proportional coefficient), D=13.77 (deviation degree of network status indicator), (Differentiated Device Bandwidth), (low-end device bandwidth), (The bitrate of the video stream after adjustment).
[0188] Calculate the bit rate compensation C:
[0189]
[0190] calculate : The calculation results show that the bitrate compensation is 523kbps. This reflects the significant adjustment of the video stream bitrate due to the bandwidth difference to ensure that the video quality is maintained when the network performance has significant differences. The 1535.5kbps bandwidth will provide higher video quality, especially when network conditions allow for higher data transmission rates, ensuring that differentiated devices can effectively adapt to changes in the network environment and optimize the user's visual experience.
[0191] A picture frame rate synchronization control system for a multi-projection device, the picture frame rate synchronization control system for a multi-projection device is used to execute the picture frame rate synchronization control method for a multi-projection device, the system comprises:
[0192] The network quality assessment module calculates the network quality score based on the network data of the differentiated projection device, including network bandwidth, packet loss rate and delay, and obtains network quality information;
[0193] The network stability analysis module calculates the network stability score based on the network quality information and the fluctuation of the network bandwidth, packet loss rate and delay of the projection device to obtain the network status information;
[0194] The low-end device identification module calculates the network status index based on the network status information, identifies the projection device with the worst network status index, and obtains the low-end device identification result;
[0195] The projection synchronization adjustment module adjusts the frame rate and bit rate of the projection video stream of the low-end device based on the low-end device identification result, the network status indicator of the low-end device, and the device bandwidth size, and synchronously adjusts the video stream frame rate and bit rate of the differentiated projection device to obtain the projection device synchronization adjustment result;
[0196] The projection bit rate optimization module analyzes the deviation of network status indicators between differentiated projection devices and low-end devices based on the synchronous adjustment results of the projection devices, calculates the degree of deviation of network status indicators, and calculates the bit rate compensation amount of differentiated projection devices in combination with the bandwidth deviation. It adjusts the video stream bit rate of the differentiated projection devices to obtain the synchronous projection bit rate optimization results.
[0197] The above are only preferred embodiments of the present invention and are not intended to limit the present invention in other forms. Any technician familiar with the profession may use the technical contents disclosed above to change or modify them into equivalent embodiments with equivalent changes and apply them to other fields. However, any simple modification, equivalent change and modification made to the above embodiments based on the technical essence of the present invention without departing from the technical solution of the present invention still falls within the protection scope of the technical solution of the present invention.
Claims
1. A method for synchronously controlling the frame rate of a multi-projection device, characterized in that: The following steps are involved: Based on the network data of the differentiated projection devices, including network bandwidth, packet loss rate and delay, the network quality score is calculated, and according to the fluctuation of the network bandwidth, packet loss rate and delay of the projection devices, the network stability score is calculated to obtain the network status information; Based on the network status information, a network status index is calculated, and a projection device with the worst network status index is identified to obtain a low-end device identification result; The steps for obtaining the low-end device recognition result are as follows: Based on the network status information, the network quality score of each projection device is scored and network stability score , through the formula: Calculate current network status indicators ,in, and is the weight parameter, Rate the network quality, Score the network stability, It is the current network status indicator; Based on the current network status indicator , by comparing the different projection devices Value size, mark The projection device with the smallest value obtains the low-end device identification result; Based on the low-end device identification result, according to the network status indicator of the low-end device and the device bandwidth size, the frame rate and bit rate of the projection video stream of the low-end device are adjusted, and the frame rate and bit rate of the video stream of the differentiated projection device are synchronously adjusted to obtain the projection device synchronization adjustment result; The steps for obtaining the synchronization adjustment result of the projection device are as follows: Based on the low-end device identification result, extract the current network status indicator of the low-end device and network bandwidth , obtain projection adjustment associated data; Adjust the associated data based on the projection, by the formula: Calculate the adjusted bitrate , and by the formula: Calculate the adjusted frame rate ,in, is the basic bit rate, is the base frame rate, is the current network bandwidth, is the network bandwidth benchmark value, is the current network status indicator, is the network status indicator benchmark value, is the adjusted bit rate, is the adjusted frame rate, and is the adjustment factor, and is the scaling factor; Based on the adjusted bit rate and adjusted frame rate , adjust the frame rate and bit rate of the projection video stream of the low-end device, and synchronously adjust the frame rate and bit rate of the video stream of the differentiated projection device to obtain the synchronization adjustment result of the projection device; Based on the synchronous adjustment result of the projection device, the network status indicator deviation between the differentiated projection device and the low-end device is analyzed, the deviation degree of the network status indicator is calculated, and the bit rate compensation amount of the differentiated projection device is calculated according to the deviation degree of the network status indicator and the bandwidth deviation amount, and the video stream bit rate of the differentiated projection device is adjusted to obtain the synchronous projection bit rate optimization result; The method for calculating the deviation degree of the network status indicator is: Based on the synchronization adjustment result of the projection device, current network status indicators of the differentiated projection device and the low-end device are collected to obtain deviation correlation data; Based on the deviation correlation data, through the formula: Calculate the degree of deviation of network status indicators ,in is the adjustment index, It is the network status indicator of the differentiated projection device. It is a network status indicator for low-end devices. is the degree of deviation of the network status indicator; The steps for obtaining the synchronous projection code rate optimization result are: Based on the degree of deviation of the network status indicator , through the formula: Calculate the rate compensation ,in, is the bandwidth-to-bitrate conversion factor, is the nonlinear adjustment coefficient, is the proportionality coefficient, is the deviation degree of the network status indicator, and are the bandwidths of differentiated devices and low-end devices, is the bit rate compensation amount; Based on the rate compensation , calculate the compensated video stream bit rate, adjust the video stream bit rate of the differentiated projection device, and obtain the synchronous projection bit rate optimization result.
2. The method for synchronously controlling the frame rate of a multi-projection device according to claim 1, characterized in that: The method for calculating the network quality score is: Based on differentiated projection devices, collect network data of projection devices, including network bandwidth, packet loss rate and latency; Based on the network data, preprocessing the data, removing outliers and filling in data missing points to obtain preprocessed network data; Based on the preprocessed network data, the formula is: Calculating network quality score ,in, , and is the weight coefficient, , and Respectively represent the current network bandwidth, current network packet loss rate and current network delay data, Rate the network quality.
3. The method for synchronously controlling the frame rate of a multi-projection device according to claim 2, characterized in that: The steps for obtaining the network status information are as follows: Based on the differentiated projection device, the network bandwidth, packet loss rate and delay data within a period of time are collected. Each data is recorded in the form of time series to obtain time series data; Based on the time series data, calculate the standard deviation of bandwidth, packet loss rate and delay to obtain standard deviation information; Based on the standard deviation information, through the formula: Calculating the network stability score ,in, , and are the standard deviations of bandwidth, packet loss rate and delay, respectively. , and is the weight coefficient, Score network stability; Based on the network stability score , integrating the current network quality score , get network status information.
4. A picture frame rate synchronization control system for multi-projection equipment, characterized in that: According to the method for synchronously controlling picture frame rates of a multi-projection device according to any one of claims 1 to 3, the system comprises: The network quality assessment module calculates the network quality score based on the network data of the differentiated projection device, including network bandwidth, packet loss rate and delay, and obtains network quality information; The network stability analysis module calculates the network stability score based on the network quality information and the fluctuation of the network bandwidth, packet loss rate and delay of the projection device to obtain network status information; The low-end device identification module calculates the network status index based on the network status information, identifies the projection device with the worst network status index, and obtains the low-end device identification result; The projection synchronization adjustment module adjusts the frame rate and bit rate of the projection video stream of the low-end device based on the low-end device identification result, according to the network status indicator of the low-end device and the device bandwidth size, and synchronously adjusts the video stream frame rate and bit rate of the differentiated projection device to obtain the projection device synchronization adjustment result; The projection bit rate optimization module analyzes the network status indicator deviation between the differentiated projection device and the low-end device based on the synchronization adjustment result of the projection device, calculates the deviation degree of the network status indicator, calculates the bit rate compensation amount of the differentiated projection device in combination with the bandwidth deviation, adjusts the video stream bit rate of the differentiated projection device, and obtains the synchronization projection bit rate optimization result.
