Adaptive Wireless Screen Mirroring Transmission Method and System Based on Multi-Protocol Fusion

Abstract

The present invention provides an adaptive wireless screen mirroring transmission method and system based on multi - protocol fusion, which relates to the technical field of wireless screen mirroring transmission methods. Through the fusion of two - dimensional weights and forward - looking network prediction, the present invention realizes dynamic protocol optimization. First, a dynamic network prediction factor is generated based on the real - time bandwidth and the channel interference factors of candidate protocols. Then, the candidate protocol with the highest comprehensive score is selected as the current transmission protocol through a comprehensive scoring formula. The protocol with high compatibility is preferentially selected in combination with the protocol hot - switching conditions. At the same time, the protocol hot - switching also sets the limiting conditions for hot - switching to prevent frequent switching from affecting the screen mirroring stability. A protocol hot - switching rollback mechanism is also set to effectively suppress the invalid switching caused by network jitter. After determining the current transmission protocol, the redundancy ratio is adjusted based on the dynamic network prediction factor, and then the resolution and bit rate are adjusted based on the redundancy ratio to ensure the adaptability during the transmission of screen mirroring data when the bandwidth fluctuates abnormally.

Description

Technical Field

[0001] The present invention relates to the technical field of wireless screen mirroring transmission methods, and particularly to an adaptive wireless screen mirroring transmission method and system based on multi - protocol fusion. Background Art

[0002] With the application of wireless screen mirroring technology, traditional wireless screen mirroring transmission schemes face significant challenges in high - dynamic network environments. Traditional wireless screen mirroring transmission methods are difficult to solve the triangular contradiction among image quality, smoothness, and reliability in complex network environments. Existing methods mostly rely on fixed parameter configurations of a single protocol and lack the dynamic fusion ability of multi - protocol characteristics, resulting in difficulty in balancing image quality, latency, and stability in complex interference scenarios. When the network bandwidth fluctuates, traditional schemes usually adopt static bit - rate compression or fixed redundancy strategies, and cannot dynamically adjust the data redundancy ratio and bit - rate allocation according to the native latency characteristics of the protocol. This easily causes high - latency protocols to occupy excessive bandwidth without being able to improve the effective image quality, while low - latency protocols have reduced packet - loss resistance due to insufficient redundancy. In addition, existing technologies generally ignore the impact of protocol compatibility differences on channel utilization, resulting in low transmission efficiency in cross - device and cross - platform scenarios.

[0003] Therefore, it is necessary to provide an adaptive wireless screen mirroring transmission method and system based on multi - protocol fusion to solve the above - mentioned technical problems. Summary of the Invention

[0004] To solve the above - mentioned technical problems, the present invention provides an adaptive wireless screen mirroring transmission method and system based on multi - protocol fusion, achieving the beneficial effect of improving screen mirroring image quality, smoothness, and reliability in complex network environments.

[0005] The present invention provides an adaptive wireless screen mirroring transmission method, and the adaptive wireless screen mirroring transmission method includes the following steps:

[0006] S1: Based on the obtained channel interference index scores of candidate protocols and the bandwidth fluctuation data within a preset sliding time window, use the random forest optimization algorithm to generate dynamic network prediction factors for candidate protocols;

[0007] S2: Calculate the network weights of candidate protocols based on the obtained real - time bandwidth, protocol native latency scores, and protocol redundancy recovery ability scores, and calculate the content weights of candidate protocols based on the obtained screen mirroring content type parameters;

[0008] S3: Calculate the comprehensive scores of candidate protocols based on the network weights and content weights of candidate protocols, and select the candidate protocol with the highest comprehensive score as the current transmission protocol;

[0009] S4: Adjust the screen mirroring strategy based on the protocol native latency score, protocol redundancy recovery ability score, and dynamic network prediction factor of the current transmission protocol.

[0010] Preferably, in step S2, the obtaining of the network weight includes the following steps:

[0011] Calculate the ratio of the obtained real-time bandwidth to the maximum bandwidth to obtain the bandwidth utilization score;

[0012] In a local area network environment with zero packet loss, calculate the ratio of the difference between the preset maximum allowable latency threshold and the measured latency of the candidate protocol to the maximum allowable latency threshold to obtain the protocol native latency score;

[0013] Test the data recovery success rate of the candidate protocol by actively applying network interference with a preset packet loss rate, and obtain the protocol redundancy recovery ability score based on the ratio of the data recovery success rate to the preset recovery success rate standard threshold;

[0014] Sum up the bandwidth utilization score, protocol native latency score, and protocol redundancy recovery ability score by weighted summation with a preset weight coefficient to obtain the network weight of the candidate protocol.

[0015] Preferably, in step S2, the obtaining of the content weight includes the following steps:

[0016] Identify the text area in the screen mirroring image through optical character recognition method and calculate its pixel ratio in the total image, and obtain the text ratio score of the current screen mirroring content based on the preset ratio threshold division mapping rule;

[0017] Perform difference detection on consecutive frames of the screen mirroring content, mark and calculate the ratio of the dynamic change area to the total area of the image, and obtain the dynamic frame rate score of the current screen mirroring content based on the preset dynamic frame rate score division mapping rule;

[0018] Convert the current screen mirroring content from RGB to HSV and count the distribution of the hue channel, calculate the complexity entropy value according to the distribution of the hue channel, and use the ratio of the complexity entropy value to the theoretical maximum value of the entropy value as the color complexity score;

[0019] Sum up the text ratio score, dynamic frame rate score, and color complexity score by weighted summation with a preset weight coefficient to obtain the content weight.

[0020] Preferably, in step S3, the obtaining of the comprehensive score includes the following steps:

[0021] Based on the handshake test success rate between the candidate protocol and the protocol list of the terminal device receiving the current screen mirroring content, obtain the protocol compatibility score by mapping according to a preset ratio;

[0022] The channel interference index score is obtained by normalizing the weighted calculation through real-time measurement of signal strength, bit error rate, and adjacent channel interference strength;

[0023] Based on the network weight, channel interference index score, content weight, and protocol compatibility score, the comprehensive score of the candidate protocol is calculated through a preset comprehensive score calculation formula.

[0024] Preferably, step S3 includes protocol hot switching, and the triggering condition for the protocol hot switching is that the new candidate protocol remains N within a preset continuous number of comprehensive score rating periods, where the rating period is the sliding interval of each slide of a preset sliding time window, and The calculation formula of is:

[0025]

[0026]

[0027] where, is the dynamic protocol hot switching threshold, is the channel interference index score, is the comprehensive score difference, is the comprehensive score of the new candidate protocol, is the comprehensive score of the current candidate protocol.

[0028] Preferably, if the comprehensive score of the new protocol is lower than that of the original protocol within a preset continuous M number of rating periods after triggering the protocol hot switching, it will automatically roll back to the original protocol and freeze the switching operation for a preset N number of rating periods.

[0029] Preferably, in step S4, the dynamic network prediction factor includes predicted bandwidth fluctuation and predicted packet loss probability, and the screen mirroring strategy includes adjusting the redundancy ratio, and the adjustment formula is:

[0030]

[0031] where, is the redundancy ratio, is the predicted bandwidth fluctuation, is the predicted packet loss probability.

[0032] Preferably, the screen mirroring strategy further includes adjusting the resolution of the screen mirroring content after adjusting the redundancy ratio, and the adjustment formula is:

[0033]

[0034]

[0035] Among them, is the real-time bandwidth, the effective available bandwidth, is the redundancy ratio, the adjusted resolution, is the maximum resolution supported by the receiving end, is the coding efficiency factor, is the target frame rate, is the constant quality factor.

[0036] Preferably, the screen mirroring strategy further includes adjusting the bit rate of the screen mirroring content after adjusting the redundancy ratio, and the adjustment formula is:

[0037]

[0038] Among them, is the adjusted bit rate, the effective available bandwidth, is the protocol native delay score.

[0039] The present invention also provides an adaptive wireless screen mirroring transmission system based on multi-protocol fusion, which is applied to an adaptive wireless screen mirroring transmission method based on multi-protocol fusion. The adaptive wireless screen mirroring transmission system includes:

[0040] A dynamic network prediction factor generation module, configured to generate a dynamic network prediction factor of a candidate protocol by using a random forest optimization algorithm based on the obtained channel interference index score of the candidate protocol and the bandwidth fluctuation data within a preset sliding time window;

[0041] A protocol weight calculation module, configured to calculate the network weight of the candidate protocol based on the obtained real-time bandwidth, protocol native delay score and protocol redundancy recovery ability score, and calculate the content weight of the candidate protocol based on the obtained screen mirroring content type parameters;

[0042] A protocol selection decision module, configured to calculate the comprehensive score of the candidate protocol based on the network weight and content weight of the candidate protocol, and select the candidate protocol with the highest comprehensive score as the current transmission protocol;

[0043] A dynamic policy adaptation module, configured to adjust the screen mirroring strategy based on the protocol native delay score, protocol redundancy recovery ability score and dynamic network prediction factor of the current transmission protocol.

[0044] Compared with the related technologies, an adaptive wireless screen mirroring transmission method and system based on multi-protocol fusion provided by the present invention have the following beneficial effects:

[0045] Through multi-dimensional weight fusion of network status and content features and forward-looking network prediction, the present invention realizes dynamic protocol optimization, improves the screen mirroring success rate in a weak network environment. First, a dynamic network prediction factor is generated based on real-time bandwidth and channel interference factors of candidate protocols. Then, the real-time comprehensive capabilities of each candidate protocol are comprehensively evaluated through a comprehensive scoring formula, and the candidate protocol with the highest comprehensive score is selected as the current transmission protocol. High-compatibility protocols are preferentially selected in combination with protocol hot-switching conditions. At the same time, protocol hot-switching also sets limiting conditions for hot-switching to prevent frequent switching from affecting screen mirroring stability. A protocol hot-switching rollback mechanism is also set to ensure effective and timely rollback after a hot-switching error, effectively suppressing invalid switching caused by network jitter and improving system stability. After determining the current transmission protocol, the redundancy ratio is adjusted based on the dynamic network prediction factor, and then the resolution and bit rate are adjusted based on the redundancy ratio to achieve linkage adjustment, ensuring picture continuity, clarity, and adaptability during the screen mirroring process when the bandwidth fluctuates abnormally. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] Figure 1 is a flowchart of an adaptive wireless screen mirroring transmission method based on multi-protocol fusion of the present invention;

[0047] Figure 2 is a module structure diagram of an adaptive wireless screen mirroring transmission system based on multi-protocol fusion of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0048] The present invention will be further described in detail below with reference to the drawings and embodiments. It can be understood that the specific embodiments described herein are only for explaining the present invention, rather than limiting the present invention. Additionally, it should be noted that for the sake of description, only parts related to the present invention are shown in the drawings rather than all structures. Furthermore, the embodiments in the present invention and the features in the embodiments can be combined with each other without conflict.

[0049] It should also be noted that for the sake of description, only parts related to the present invention are shown in the drawings rather than all content. Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the operations (or steps) in the flowcharts are described as being processed sequentially, many of the operations can be implemented in parallel, concurrently, or simultaneously. In addition, the order of the operations can be rearranged. The process can be terminated when its operations are completed, but there can also be additional steps not included in the drawings. The process can correspond to a method, function, procedure, subroutine, subprogram, etc.

[0050] Embodiment 1

[0051] An adaptive wireless screen mirroring transmission method based on multi - protocol fusion. In the specific implementation process, as Figure 1 shown, it shows a flowchart of an adaptive wireless screen mirroring transmission method based on multi - protocol fusion, including:

[0052] Step S1: Based on the obtained channel interference index scores of candidate protocols and the bandwidth fluctuation data within a preset sliding time window, use the random forest optimization algorithm to generate dynamic network prediction factors for candidate protocols.

[0053] In the specific implementation process, within the preset sliding time window, collect historical bandwidth data and calculate the bandwidth mean and standard deviation within the preset sliding time window. At the same time, collect signal strength, bit error rate, and adjacent channel interference strength. After weighted summation and normalization, obtain the channel interference index score. Based on the channel interference index score, historical bandwidth data, and the bandwidth mean and standard deviation within the sliding time window, construct a feature vector. Input the feature vector into the pre - trained random forest algorithm model to generate dynamic network prediction factors.

[0054] Step S2: Calculate the network weights of candidate protocols based on the obtained real - time bandwidth, protocol native delay scores, and protocol redundancy recovery ability scores, and calculate the content weights of candidate protocols based on the obtained screen mirroring content type parameters.

[0055] In the specific implementation process, calculating network weights and content weights is used for the subsequent calculation of the comprehensive scores of candidate protocols. Network weights affect the bandwidth utilization rate, network stability, and data recovery ability in a weak network environment of candidate protocols. The calculation of network weights is based on the obtained real - time bandwidth, protocol native delay scores, and protocol redundancy recovery ability scores. Real - time bandwidth and protocol native delay scores ensure the transmission of high - quality content by calculating the real - time bandwidth utilization rate and protocol native delay scores. The protocol redundancy recovery ability score ensures data integrity in a weak network environment. Content weights focus on the impact of the quality of the screen mirroring content itself on screen mirroring transmission under candidate protocols, including text ratio scores, dynamic frame rate scores, and color complexity scores, reflecting the compatibility between candidate protocols and screen mirroring content.

[0056] Specifically, in step S2, the acquisition of network weights includes the following steps:

[0057] Calculate the ratio of the obtained real - time bandwidth to the maximum bandwidth to obtain the bandwidth utilization rate score;

[0058] In a local area network environment with zero packet loss, calculate the ratio of the difference between the preset maximum allowable delay threshold and the measured delay of the candidate protocol to the maximum allowable delay threshold to obtain the protocol native delay score;

[0059] Test the data recovery success rate of the candidate protocol by actively applying network interference with a preset packet loss rate, and obtain the protocol redundancy recovery ability score based on the ratio of the data recovery success rate to the preset recovery success rate standard threshold;

[0060] Perform a weighted sum of the bandwidth utilization score, the protocol native delay score, and the protocol redundancy recovery ability score using preset weight coefficients to obtain the network weight of the candidate protocol.

[0061] In the specific implementation process, obtain the available bandwidth data of the current link in real time through the system bottom layer interface, set the theoretical maximum bandwidth value according to the network type, and convert the ratio of the real-time bandwidth to the theoretical maximum bandwidth into the bandwidth utilization score; configure an independent test environment in the local area network to ensure that the network packet loss rate is close to zero packet loss, use the UDP protocol to send probe data packets of a preset fixed size, transmit them between the screen mirroring device and the receiving end at a fixed frequency, count the round-trip delay of a preset number threshold of transmissions, and take the median as the protocol native delay after excluding outliers. Take the ratio of the difference between the preset maximum allowable delay threshold and the protocol native delay to the preset maximum allowable delay threshold as the protocol native delay score; inject network interference with a preset packet loss rate for a preset number of seconds in the test link through a traffic controller to simulate a weak network scenario. The screen mirroring sender records the total number of sent data packets, and the screen mirroring receiver counts the number of successfully received packets. Calculate the ratio of the successfully received data packets to the total number of sent data packets as the protocol redundancy recovery ability score; finally, perform a weighted sum of the bandwidth utilization score, the protocol native delay score, and the protocol redundancy recovery ability score using preset weight coefficients to obtain the network weight of the candidate protocol. The calculation formula for the network weight is:

[0062]

[0063] wherein, is the network weight, is the bandwidth utilization score, is the weight of the bandwidth utilization score, is the protocol native delay score, is the weight of the protocol native delay score, is the protocol redundancy recovery ability score, is the weight of the protocol redundancy recovery ability score.

[0064] Specifically, in step S2, the acquisition of the content weight includes the following steps:

[0065] Identify the text area in the screen mirroring image through optical character recognition method and calculate its pixel ratio to the total image. Based on the preset ratio threshold division mapping rule, obtain the text ratio score of the current screen mirroring content;

[0066] Perform differential detection on consecutive frames of the screen-cast content, mark and calculate the proportion of the dynamically changing area in the total screen area, and obtain the dynamic frame rate score of the current screen-cast content based on the preset mapping rule for dynamic frame rate scoring;

[0067] Convert the current screen-cast content from RGB to HSV and count the distribution of the hue channel. Calculate the complexity entropy value according to the distribution of the hue channel, and use the ratio of the complexity entropy value to the theoretical maximum value of the entropy as the color complexity score;

[0068] Weighted sum the text proportion score, the dynamic frame rate score, and the color complexity score through preset weight coefficients to obtain the content weight.

[0069] In the specific implementation process, use an optical character recognition engine to perform full-frame scanning on the current screen-cast image, locate all regions containing text, and accurately frame the boundary coordinates of each text region through edge detection and contour analysis algorithms. Count the total number of pixels in all text regions and compare it with the total number of pixels in the screen to calculate the text proportion. Based on the preset proportion threshold division rule mapping, obtain the text proportion score of the current screen-cast content; Convert the current frame and the previous frame into grayscale images, calculate the brightness difference value pixel by pixel, and based on the preset dynamic change threshold, mark all pixels that meet the conditions as dynamic regions. Count the total number of pixels in the dynamic regions and calculate the proportion of its area in the total screen area. Based on the preset dynamic frame rate scoring rule mapping, obtain the dynamic frame rate score of the current screen-cast content; Convert the current frame from the RGB color model to the HSV model, extract the hue channel data, divide the hue values into 36 equal-width intervals, count the number of pixels in each interval, generate a hue distribution histogram, and calculate the Shannon entropy value based on the hue distribution histogram to quantify the color diversity. The more uniform the hue distribution, the higher the entropy value; the more concentrated the distribution, the lower the entropy value; Finally, weighted sum the text proportion score, the dynamic frame rate score, and the color complexity score through preset weight coefficients to obtain the content weight. The calculation formula for the content weight is:

[0070]

[0071] where, is the content weight, is the text proportion score of the current screen-cast content, is the weight of the text proportion score, is the dynamic frame rate score of the current screen-cast content, is the weight of the dynamic frame rate score, is the color complexity score of the current screen-cast content, is the weight of the color complexity score.

[0072] Step S3: Based on the network weight and content weight of the candidate protocols, calculate the comprehensive score of the candidate protocols, and select the candidate protocol with the highest comprehensive score as the current transmission protocol.

[0073] Specifically, in step S3, obtaining the comprehensive score includes the following steps:

[0074] Based on the handshake test success rate between the candidate protocol and the protocol list of the terminal device receiving the current screen projection content, obtain the protocol compatibility score according to the preset success rate scoring mapping rule;

[0075] By measuring the signal strength, bit error rate, and adjacent channel interference strength in real time, obtain the channel interference index score after weighted calculation and normalization;

[0076] Based on the network weight, channel interference index score, content weight, and protocol compatibility score, calculate the comprehensive score of the candidate protocol through the preset comprehensive score calculation formula.

[0077] In the specific implementation process, obtain the protocol list supported by the screen projection receiving device, initiate protocol handshake requests one by one, count the handshake success rate of each protocol, and obtain the protocol compatibility score according to the preset success rate scoring mapping rule; obtain the channel interference index score through weighted summation and normalization processing of the signal strength, bit error rate, and adjacent frequency interference strength, and based on the network weight, channel interference index score, content weight, and the obtained protocol compatibility score, obtain the comprehensive score of each candidate protocol through the comprehensive score calculation formula. The comprehensive score calculation formula is:

[0078]

[0079] Among them, is the comprehensive score, is the network weight, is the content weight, is the protocol compatibility score, is the channel interference index score, is the anti-interference factor, representing the network anti-interference ability. Sort the comprehensive scores of all candidate protocols in descending order, and select the protocol with the highest comprehensive score as the current transmission protocol.

[0080] Specifically, step S3 includes protocol hot swapping. The trigger condition for protocol hot swapping is that the new candidate protocol remains N within the scoring period of the preset consecutive comprehensive scores. Among them, the scoring period is the sliding interval of each sliding of the preset sliding time window, and The calculation formula of

[0081]

[0082]

[0083] Among them, is the dynamic protocol hot - switch threshold, is the channel interference index score, is the comprehensive score difference, is the comprehensive score of the new candidate protocol, is the comprehensive score of the current candidate protocol.

[0084] In the specific implementation process, step S3 includes the steps of protocol hot - switch. When the new candidate protocol maintains N within the preset continuous scoring cycles of the comprehensive score, it triggers the hot - switch of the protocol. is the dynamic protocol hot - switch threshold. The greater the interference, the higher the trigger threshold, avoiding mis - switching caused by score fluctuations under high interference. The system uses a fixed time interval as the scoring cycle, and the scoring cycle is specifically set to be the same as the sliding interval of each slide of the preset sliding time window in step S1, calculating the comprehensive score difference between the new candidate protocol and the current protocol. When it maintains N within the preset continuous scoring cycles of the comprehensive score, it triggers the hot - switch, ensuring that the protocol will not switch frequently and preventing it from affecting the connection of invalid screen mirroring.

[0085] Specifically, if the comprehensive score of the new protocol is lower than that of the original protocol within the preset continuous M scoring cycles after triggering the protocol hot - switch, it will automatically roll back to the original protocol and freeze the switching operation for the preset N scoring cycles.

[0086] In the specific implementation process, after the protocol is switched, continuously monitor the comprehensive score of the new protocol. If the comprehensive score of the new protocol is lower than that of the original protocol within M consecutive scoring cycles after the switch, it is determined that the switch fails, automatically switch back to the original protocol, and freeze the hot - switch function for N cycles to prevent frequent switching oscillations.

[0087] Step S4: Adjust the screen mirroring strategy based on the protocol native delay score, protocol redundancy recovery ability score, and dynamic network prediction factor of the current transmission protocol.

[0088] In the specific implementation process, after determining the current transmission protocol, adjust the specific parameters in the screen mirroring process based on the protocol native delay score, protocol redundancy recovery ability score, and dynamic network prediction factor of the current transmission protocol. First, adjust the redundancy ratio, and then, based on the adjusted redundancy ratio, adjust the resolution and bit rate of the screen - mirrored content to achieve a strategy closed - loop, ensuring maximum bandwidth utilization and network adaptation of the screen - mirrored content.

[0089] Specifically, in step S4, the dynamic network prediction factors include predicted bandwidth fluctuation and predicted packet loss probability, and the screen mirroring strategy includes adjusting the redundancy ratio. The adjustment formula is:

[0090]

[0091] Among them, is the redundancy ratio, is the predicted bandwidth fluctuation, is the predicted packet loss probability.

[0092] In the specific implementation, the predicted packet loss probability is divided by 10 to obtain the demand coefficient of packet loss for redundancy, and the absolute value of the predicted bandwidth fluctuation is divided by 100 to obtain the demand coefficient of bandwidth fluctuation for redundancy. After adding the two demand coefficients, the upper limit of the redundancy ratio is restricted to 30%. According to the calculated redundancy ratio, redundant error correction packets are inserted into the data stream. The redundant error correction packets adopt forward error correction coding to ensure that the screen mirroring receiving end can recover the lost packets through the redundant data.

[0093] Specifically, the screen mirroring strategy also includes adjusting the resolution of the screen mirroring content after adjusting the redundancy ratio. The adjustment formula is:

[0094]

[0095]

[0096] Among them, is the real-time bandwidth, is the effective available bandwidth, is the redundancy ratio, is the adjusted resolution, is the maximum resolution supported by the receiving end, is the coding efficiency factor, is the target frame rate, is the constant quality factor.

[0097] In the specific implementation process, the effective available bandwidth is obtained by deducting the bandwidth occupied by redundancy from the real-time bandwidth. The coding efficiency per unit bandwidth is determined according to the coding protocol type, and the target frame rate and the constant quality factor of the preset image quality parameters are preset based on the type of the screen mirroring content , the effective bandwidth, coding efficiency, target frame rate, and constant quality factor are substituted into the formula to calculate the theoretically supported adjusted resolution. By comparing with the maximum resolution supported by the screen mirroring receiving end, the smaller value of the two is selected as the final screen mirroring resolution. Finally, progressive resolution switching is adopted to avoid stuttering caused by sudden changes in the picture.

[0098] Specifically, the screen mirroring strategy also includes adjusting the bit rate of the screen mirroring content after adjusting the redundancy ratio. The adjustment formula is:

[0099]

[0100] Wherein, is the adjusted bit rate, the effective available bandwidth, is the native protocol delay score.

[0101] In the specific implementation process, the influence of the native protocol delay is deducted from the effective bandwidth to determine the adjusted bandwidth transmission bit rate. The higher the native protocol delay score, the greater the delay, and the bit rate needs to be reduced to relieve the transmission pressure. The sliding window mean filtering algorithm is used to smoothly control the change of the bit rate to avoid picture freezing or mosaic caused by sudden change of the bit rate.

[0102] The working principle of an adaptive wireless screen mirroring transmission method based on multi-protocol fusion provided by the present invention is as follows:

[0103] First, the random forest model is used to analyze the historical bandwidth fluctuation data and the real-time channel interference index to obtain the dynamic network prediction factors. The dynamic network prediction factors include the bandwidth fluctuation and packet loss probability within the future window, providing a forward-looking basis for policy adjustment. Then, based on the obtained real-time bandwidth, native protocol delay score, and protocol redundancy recovery ability score, the network weights of the candidate protocols are calculated, and based on the obtained screen mirroring content type parameters, the content weights of the candidate protocols are calculated, providing a basis for the subsequent comprehensive scoring calculation of the protocols. Next, based on the network weights and content weights of the candidate protocols, the comprehensive scores of the candidate protocols are calculated, which are used as the basis for protocol selection and hot switching during the screen mirroring connection process. Secondly, the redundancy ratio is calculated based on the prediction factors, and the weak network packet loss resistance ability is improved by injecting redundant error correction packets, while limiting the redundancy upper limit to prevent excessive bandwidth occupation. Finally, based on the obtained redundancy ratio, the specific resolution and bit rate of the screen mirroring content are adjusted to achieve the specific adaptive control of the screen mirroring transmission under multi-protocol fusion.

[0104] Embodiment 2

[0105] An adaptive wireless screen mirroring transmission system based on multi-protocol fusion is applied to an adaptive wireless screen mirroring transmission method based on multi-protocol fusion. In the specific implementation process, as Figure 2 shown, it shows the module structure of an adaptive wireless screen mirroring transmission system based on multi-protocol fusion, including:

[0106] A dynamic network prediction factor generation module 100, configured to generate dynamic network prediction factors of the candidate protocols by using the random forest optimization algorithm based on the obtained channel interference index scores of the candidate protocols and the bandwidth fluctuation data within a preset sliding time window;

[0107] The protocol weight calculation module 200 is used to calculate the network weight of candidate protocols based on the obtained real-time bandwidth, protocol native delay score, and protocol redundancy recovery ability score, and calculate the content weight of candidate protocols based on the obtained screen mirroring content type parameters;

[0108] The protocol selection decision module 300 is used to calculate the comprehensive score of candidate protocols based on the network weight and content weight of candidate protocols, and select the candidate protocol with the highest comprehensive score as the current transmission protocol;

[0109] The dynamic policy adaptation module 400 is used to adjust the screen mirroring policy based on the protocol native delay score, protocol redundancy recovery ability score, and dynamic network prediction factor of the current transmission protocol.

[0110] The working principle of an adaptive wireless screen mirroring transmission system based on multi-protocol fusion provided by the present invention is as follows:

[0111] The system of the present invention uses the dynamic network prediction factor generation module 100 to analyze the channel interference index and historical bandwidth fluctuation data of candidate protocols in real time, and uses the random forest optimization algorithm to generate forward-looking network prediction factors including predicted bandwidth fluctuation and predicted packet loss probability, providing a network state prediction for protocol decision-making; the protocol weight calculation module 200 calculates the network weight by combining the real-time bandwidth, protocol native delay score, and redundancy recovery ability score, and at the same time quantifies the content weight through text recognition by optical character recognition method, inter-frame dynamic region detection, and HSV color entropy analysis; the protocol selection decision module 300 fuses the network weight and content weight, introduces the channel interference index and protocol compatibility score, and dynamically selects the optimal protocol through the comprehensive score formula; the dynamic policy adaptation module 400 adjusts the redundancy ratio, resolution code rate based on the protocol characteristics and dynamic network prediction factors in a closed-loop manner, forming a linkage mechanism from prediction to decision-making and then to execution, realizing multi-protocol adaptive screen mirroring transmission with smoothness guaranteed in weak networks and image quality guaranteed in strong networks.

[0112] This application is described with reference to the flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or block in the flowcharts and / or block diagrams can be implemented by computer program instructions, and the combination of processes and / or blocks in the flowcharts and / or block diagrams can also be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices generate a device for realizing the functions specified in one process Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0113] Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program, and this program can be stored in a computer-readable storage medium. The storage medium includes read-only memory (ROM), random access memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), one-time programmable read-only memory (OTPROM), electrically-erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc memories, magnetic disk memories, tape memories, or any other medium that can be used to carry or store data and is computer-readable.

[0114] It should also be noted that the term "including", "comprising" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such a process, method, commodity or device. Without further limitation, an element defined by the statement "including one..." does not exclude the existence of another identical element in the process, method, commodity or device including the element.

Claims

1. An adaptive wireless screen mirroring transmission method based on multi - protocol fusion, characterized in that, The adaptive wireless screen mirroring transmission method includes the following steps: S1: Based on the channel interference index scores of the candidate protocols obtained and the bandwidth fluctuation data within a preset sliding time window, use the random forest optimization algorithm to generate the dynamic network prediction factors of the candidate protocols; S2: Calculate the network weights of the candidate protocols based on the obtained real-time bandwidth, protocol native delay scores, and protocol redundancy recovery ability scores, and calculate the content weights of the candidate protocols based on the obtained screen mirroring content type parameters; S3: Based on the network weights and content weights of the candidate protocols, calculate the comprehensive scores of the candidate protocols, and select the candidate protocol with the highest comprehensive score as the current transmission protocol; S4: Adjust the screen mirroring strategy based on the protocol native delay scores, protocol redundancy recovery ability scores, and dynamic network prediction factors of the current transmission protocol; The acquisition of the content weights includes the following steps: Identify the text area in the screen mirroring image through the optical character recognition method and calculate the pixel ratio of the text area to the total image area. Based on the preset ratio threshold division mapping rules, obtain the text ratio score of the current screen mirroring content; Perform difference detection on consecutive frames of the screen mirroring content, mark and calculate the proportion of the dynamic change area in the total image area. Based on the preset dynamic frame rate score division mapping rules, obtain the dynamic frame rate score of the current screen mirroring content; Convert the current screen mirroring content from RGB to HSV and count the distribution of the hue channel. Calculate the complexity entropy value according to the distribution of the hue channel, and use the ratio of the complexity entropy value to the theoretical maximum entropy value as the color complexity score; Perform weighted summation on the text ratio score, dynamic frame rate score, and color complexity score through preset weight coefficients to obtain the content weights.

2. The adaptive wireless screen mirroring transmission method based on multi - protocol fusion according to claim 1, wherein, In step S2, the acquisition of the network weights includes the following steps: Calculate the ratio of the obtained real-time bandwidth to the maximum bandwidth to obtain the bandwidth utilization score; In a local area network environment with zero packet loss, calculate the proportion of the difference between the preset maximum allowable delay threshold and the measured delay of the candidate protocol to the maximum allowable delay threshold to obtain the protocol native delay score; Test the data recovery success rate of the candidate protocol by actively applying network interference with a preset packet loss rate, and obtain the protocol redundancy recovery ability score based on the ratio of the data recovery success rate to the preset recovery success rate standard threshold; Perform weighted summation on the bandwidth utilization score, protocol native delay score, and protocol redundancy recovery ability score through preset weight coefficients to obtain the network weights of the candidate protocols.

3. An adaptive wireless screen mirroring transmission method based on multi-protocol fusion according to claim 2, wherein, In step S3, the acquisition of the comprehensive scores includes the following steps: Based on the handshake test success rate of the candidate protocol and the protocol list of the terminal device receiving the current screen mirroring content, obtain the protocol compatibility score by mapping according to a preset ratio; Through real-time measurement of signal strength, bit error rate, and adjacent channel interference strength, obtain the channel interference index score after weighted calculation and normalization; Based on the network weights, channel interference index scores, content weights, and protocol compatibility scores, calculate the comprehensive scores of the candidate protocols through a preset comprehensive score calculation formula.

4. A method for adaptive wireless screen mirroring transmission based on multi - protocol fusion according to claim 3, characterized in that, Step S3 includes protocol hot swapping, and the trigger condition for the protocol hot swapping is that the new candidate protocol remains within the preset continuous N comprehensive scoring cycle of wherein, the scoring cycle is the sliding interval of each time of the preset sliding time window, and The calculation formula of is: Among them, is the dynamic protocol hot - switching threshold, is the channel interference index score, is the comprehensive score difference, is the comprehensive score of the new candidate protocol, is the comprehensive score of the current candidate protocol.

5. The adaptive wireless screen mirroring transmission method based on multi - protocol fusion according to claim 4, wherein, After triggering the protocol hot swap, if the comprehensive score of the new protocol within M successive preset rating periods is lower than that of the original protocol, it will automatically roll back to the original protocol and freeze the preset N rating periods for the swap operation.

6. The adaptive wireless screen mirroring transmission method based on multi - protocol fusion according to claim 5, wherein, In step S4, the dynamic network prediction factors include predicted bandwidth fluctuation and predicted packet loss probability, and the screen mirroring strategy includes adjusting the redundancy ratio. The adjustment formula is: Among them, is the redundancy ratio, is the predicted bandwidth fluctuation, is the predicted packet loss probability.

7. A self-adaptive wireless screen mirroring transmission method based on multi-protocol fusion according to claim 6, characterized in that, The screen mirroring strategy further includes adjusting the resolution of the screen mirroring content after adjusting the redundancy ratio, and the adjustment formula is: Among them, is the real-time bandwidth, is the effective available bandwidth, is the redundancy ratio, is the adjusted resolution, is the maximum resolution supported by the screen mirroring receiver, is the coding efficiency factor, is the target frame rate, is the constant quality factor.

8. A method for adaptive wireless screen mirroring transmission based on multi - protocol fusion according to claim 7, characterized in that, The screen mirroring strategy further includes adjusting the bit rate of the screen mirroring content after adjusting the redundancy ratio, and the adjustment formula is: Among them, is the adjusted bit rate, the effective available bandwidth, is the protocol native latency score.

9. An adaptive wireless screen mirroring transmission system based on multi - protocol fusion, characterized in that, Applied to an adaptive wireless screen mirroring transmission method based on multi-protocol fusion according to any one of claims 1-8, the adaptive wireless screen mirroring transmission system includes: A dynamic network prediction factor generation module, configured to generate a dynamic network prediction factor of a candidate protocol by using a random forest optimization algorithm based on the obtained channel interference index score of the candidate protocol and the bandwidth fluctuation data within a preset sliding time window; A protocol weight calculation module, configured to calculate the network weight of the candidate protocol based on the obtained real-time bandwidth, protocol native delay score, and protocol redundancy recovery ability score, and calculate the content weight of the candidate protocol based on the obtained screen mirroring content type parameter; A protocol selection decision module, configured to calculate the comprehensive score of the candidate protocol based on the network weight and content weight of the candidate protocol, and select the candidate protocol with the highest comprehensive score as the current transmission protocol; A dynamic policy adaptation module, configured to adjust the screen mirroring strategy based on the protocol native delay score, protocol redundancy recovery ability score, and dynamic network prediction factor of the current transmission protocol.

Images