Adaptive wireless screen projection transmission method and system based on multi-protocol fusion

Abstract

The invention provides a self-adaptive wireless screen projection transmission method and system based on multi-protocol fusion, and relates to the technical field of wireless screen projection transmission methods.According to the self-adaptive wireless screen projection transmission method and system based on multi-protocol fusion, protocol dynamic preferential selection is achieved through two-dimension weight fusion and prospective network prediction; a dynamic network prediction factor is generated based on a real-time bandwidth and channel interference factors of candidate protocols, then, a candidate protocol with the highest comprehensive score is selected as a current transmission protocol through a comprehensive scoring formula, a high-compatibility protocol is preferentially selected in combination with a protocol hot switching condition, and meanwhile, a hot switching limiting condition is further set for protocol hot switching, so that the protocol hot switching efficiency is improved. A protocol hot switching rollback mechanism is further arranged, invalid switching caused by network jitter is effectively restrained, after a current transmission protocol is determined, the redundancy proportion is adjusted based on a dynamic network prediction factor, then the resolution ratio and the code rate are adjusted based on the redundancy proportion, and when bandwidth fluctuation is abnormal, the stability of screen projection is not influenced. And the suitability in the projection screen data transmission process is ensured.

Description

Technical Field

[0001] The present invention relates to the technical field of wireless screen mirroring transmission methods, and particularly to an adaptive wireless screen mirroring transmission method and system based on multi - protocol fusion. Background Art

[0002] With the application of wireless screen mirroring technology, traditional wireless screen mirroring transmission solutions face significant challenges in high - dynamic network environments. Traditional wireless screen mirroring transmission methods are difficult to solve the triangular contradiction of image quality, smoothness, and reliability in complex network environments. Existing methods mostly rely on fixed parameter configurations of a single protocol and lack the ability to dynamically fuse the characteristics of multiple protocols, resulting in difficulty in balancing image quality, latency, and stability in complex interference scenarios. When the network bandwidth fluctuates, traditional solutions usually adopt static bitrate compression or fixed redundancy strategies, and cannot dynamically adjust the data redundancy ratio and bitrate allocation according to the native latency characteristics of the protocol. This easily causes high - latency protocols to occupy excessive bandwidth without being able to improve the effective image quality, while low - latency protocols have reduced packet loss resistance due to insufficient redundancy. In addition, existing technologies generally ignore the impact of protocol compatibility differences on channel utilization, resulting in low transmission efficiency in cross - device and cross - platform scenarios.

[0003] Therefore, it is necessary to provide an adaptive wireless screen mirroring transmission method and system based on multi - protocol fusion to solve the above - mentioned technical problems. Summary of the Invention

[0004] To solve the above - mentioned technical problems, the present invention provides an adaptive wireless screen mirroring transmission method and system based on multi - protocol fusion, achieving the beneficial effect of improving screen mirroring image quality, smoothness, and reliability in complex network environments.

[0005] The present invention provides an adaptive wireless screen mirroring transmission method based on multi - protocol fusion. The adaptive wireless screen mirroring transmission method includes the following steps: S1: Based on the channel interference index scores of the candidate protocols obtained and the bandwidth fluctuation data within a preset sliding time window, use the random forest optimization algorithm to generate the dynamic network prediction factors of the candidate protocols; S2: Calculate the network weights of the candidate protocols based on the obtained real - time bandwidth, protocol native latency scores, and protocol redundancy recovery ability scores, and calculate the content weights of the candidate protocols based on the obtained screen mirroring content type parameters; S3: Calculate the comprehensive scores of the candidate protocols based on the network weights and content weights of the candidate protocols, and select the candidate protocol with the highest comprehensive score as the current transmission protocol; S4: Adjust the screen mirroring strategy based on the protocol native latency scores, protocol redundancy recovery ability scores, and dynamic network prediction factors of the current transmission protocol.

[0006] Preferably, in step S2, the obtaining of the network weight includes the following steps: Calculate the ratio of the obtained real-time bandwidth to the maximum bandwidth to obtain a bandwidth utilization score; In a local area network environment with zero packet loss, calculate the ratio of the difference between the preset maximum allowable delay threshold and the measured delay of the candidate protocol to the maximum allowable delay threshold to obtain a protocol native delay score; Test the data recovery success rate of the candidate protocol by actively applying network interference with a preset packet loss rate, and obtain a protocol redundancy recovery ability score based on the ratio of the data recovery success rate to the preset recovery success rate compliance threshold; Sum the bandwidth utilization score, the protocol native delay score, and the protocol redundancy recovery ability score through weighted summation with preset weight coefficients to obtain the network weight of the candidate protocol.

[0007] Preferably, in step S2, the obtaining of the content weight includes the following steps: Identify the text area in the screen mirroring image through optical character recognition method and calculate its pixel ratio to the total image, and obtain a text ratio score of the current screen mirroring content based on a preset ratio threshold division mapping rule; Perform difference detection on consecutive frames of the screen mirroring content, mark and calculate the ratio of the dynamic change area to the total area of the image, and obtain a dynamic frame rate score of the current screen mirroring content based on a preset dynamic frame rate score division mapping rule; Convert the current screen mirroring content from RGB to HSV and count the distribution of the hue channel, calculate the complexity entropy value according to the distribution of the hue channel, and use the ratio of the complexity entropy value to the theoretical maximum value of the entropy value as the color complexity score; Sum the text ratio score, the dynamic frame rate score, and the color complexity score through weighted summation with preset weight coefficients to obtain the content weight.

[0008] Preferably, in step S3, the obtaining of the comprehensive score includes the following steps: Based on the handshake test success rate between the candidate protocol and the protocol list of the terminal device receiving the current screen mirroring content, obtain a protocol compatibility score by mapping according to a preset ratio; Normalize the channel interference index score obtained by weighted calculation through real-time measurement of signal strength, bit error rate, and adjacent channel interference strength; Based on the network weight, the channel interference index score, the content weight, and the protocol compatibility score, calculate the comprehensive score of the candidate protocol through a preset comprehensive score calculation formula.

[0009] Preferably, step S3 includes protocol hot swapping, and the trigger condition for the protocol hot swapping is that the new candidate protocol remains N within a preset continuous , where the scoring period is the sliding interval of each slide of a preset sliding time window. and The calculation formula of is: Wherein, is the dynamic protocol hot - switching threshold, is the channel interference index score, is the comprehensive score difference, is the comprehensive score of the new candidate protocol, is the comprehensive score of the current candidate protocol.

[0010] Preferably, after triggering the protocol hot - switching, if the comprehensive score of the new protocol is lower than that of the original protocol within a continuously preset M scoring periods, it will automatically roll back to the original protocol and freeze the switching operation for a preset N scoring periods.

[0011] Preferably, in step S4, the dynamic network prediction factor includes the predicted bandwidth fluctuation and the predicted packet loss probability, and the screen mirroring strategy includes the adjustment of the redundancy ratio. The adjustment formula is: Wherein, is the redundancy ratio, is the predicted bandwidth fluctuation, is the predicted packet loss probability.

[0012] Preferably, the screen mirroring strategy further includes the adjustment of the resolution of the screen - mirrored content after adjusting the redundancy ratio. The adjustment formula is: Wherein, is the real - time bandwidth, is the effective available bandwidth, is the redundancy ratio, is the adjusted resolution, is the maximum resolution supported by the receiving end, is the coding efficiency factor, is the target frame rate, is the constant quality factor.

[0013] Preferably, the screen mirroring strategy further includes the adjustment of the bit rate of the screen - mirrored content after adjusting the redundancy ratio. The adjustment formula is: Wherein, is the adjusted bit rate, is the effective available bandwidth, It is the native delay score of the protocol.

[0014] The present invention also provides an adaptive wireless screen mirroring transmission system based on multi - protocol fusion, which is applied to an adaptive wireless screen mirroring transmission method based on multi - protocol fusion. The adaptive wireless screen mirroring transmission system includes: A dynamic network prediction factor generation module, which is used to generate a dynamic network prediction factor of a candidate protocol by using a random forest optimization algorithm based on the obtained channel interference index score of the candidate protocol and the bandwidth fluctuation data within a preset sliding time window; A protocol weight calculation module, which is used to calculate the network weight of the candidate protocol based on the obtained real - time bandwidth, the native delay score of the protocol, and the protocol redundancy recovery ability score, and calculate the content weight of the candidate protocol based on the obtained screen mirroring content type parameters; A protocol selection decision module, which is used to calculate the comprehensive score of the candidate protocol based on the network weight and the content weight of the candidate protocol, and select the candidate protocol with the highest comprehensive score as the current transmission protocol; A dynamic policy adaptation module, which is used to adjust the screen mirroring policy based on the native delay score of the current transmission protocol, the protocol redundancy recovery ability score, and the dynamic network prediction factor.

[0015] Compared with the related technologies, an adaptive wireless screen mirroring transmission method and system based on multi - protocol fusion provided by the present invention have the following beneficial effects: Through multi - dimensional weight fusion of network status and content features and forward - looking network prediction, the present invention realizes dynamic optimization of protocols, improves the success rate of screen mirroring in a weak network environment. First, a dynamic network prediction factor is generated based on the real - time bandwidth and the channel interference factors of the candidate protocol. Then, the real - time comprehensive capabilities of each candidate protocol are comprehensively evaluated through a comprehensive scoring formula, and the candidate protocol with the highest comprehensive score is selected as the current transmission protocol. Combining the protocol hot - switching conditions, a highly compatible protocol is preferentially selected. At the same time, the protocol hot - switching also sets limiting conditions for hot - switching to prevent frequent switching from affecting the screen mirroring stability. A protocol hot - switching rollback mechanism is also set to ensure that it can be effectively and timely rolled back after a hot - switching error, effectively suppressing invalid switching caused by network jitter and improving the system stability. After determining the current transmission protocol, the redundancy ratio is adjusted based on the dynamic network prediction factor, and then the resolution and bit rate are adjusted based on the redundancy ratio to achieve linkage adjustment, ensuring the continuity and clarity of the picture and the adaptability during the screen mirroring process when the bandwidth fluctuates abnormally. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 It is a flowchart of an adaptive wireless screen mirroring transmission method based on multi - protocol fusion of the present invention; Figure 2It is a module structure diagram of an adaptive wireless screen mirroring transmission system based on multi - protocol fusion of the present invention. Specific implementation manners

[0017] The present invention will be further described in detail below with reference to the drawings and embodiments. It can be understood that the specific embodiments described herein are only used to explain the present invention, rather than limiting the present invention. Additionally, it should be noted that for the sake of description, only parts related to the present invention rather than all structures are shown in the drawings. Furthermore, the embodiments in the present invention and the features in the embodiments can be combined with each other without conflict.

[0018] It should also be noted that for the sake of description, only parts related to the present invention rather than all content are shown in the drawings. Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe the operations (or steps) as being processed sequentially, many of the operations can be performed in parallel, concurrently, or simultaneously. In addition, the order of the operations can be rearranged. When the operations are completed, the process can be terminated, but there can also be additional steps not included in the drawings. The process can correspond to a method, function, procedure, sub - routine, sub - program, etc.

[0019] Embodiment 1 An adaptive wireless screen mirroring transmission method based on multi - protocol fusion. In the specific implementation process, as Figure 1 shown, it shows a flowchart of an adaptive wireless screen mirroring transmission method based on multi - protocol fusion, including: Step S1: Based on the channel interference index score of the candidate protocol obtained and the bandwidth fluctuation data within a preset sliding time window, use the random forest optimization algorithm to generate a dynamic network prediction factor for the candidate protocol.

[0020] In the specific implementation process, within the preset sliding time window, historical bandwidth data is collected and the bandwidth mean and standard deviation within the preset sliding time window are calculated. At the same time, signal strength, bit error rate, and adjacent channel interference strength are collected. After weighted summation and normalization processing, the channel interference index score is obtained. A feature vector is constructed based on the channel interference index score, historical bandwidth data, and the bandwidth mean and standard deviation within the sliding time window, and the feature vector is input into a pre - trained random forest algorithm model to generate a dynamic network prediction factor.

[0021] Step S2: Calculate the network weight of the candidate protocol based on the obtained real - time bandwidth, protocol native delay score, and protocol redundancy recovery ability score, and calculate the content weight of the candidate protocol based on the obtained screen mirroring content type parameter.

[0022] In the specific implementation process, the network weight and the content weight are calculated for the comprehensive scoring calculation of the subsequent candidate protocols. The network weight affects the bandwidth utilization rate, network stability, and data recovery ability in a weak network environment of the candidate protocol. The calculation of the network weight is based on the obtained real-time bandwidth, the native protocol delay score, and the protocol redundancy recovery ability score. The real-time bandwidth and the native protocol delay score ensure the transmission of high-quality content by calculating the real-time bandwidth utilization rate and the native protocol delay score. The protocol redundancy recovery ability score ensures data integrity in a weak network environment. The content weight focuses on the impact of the quality of the screen-casting content itself on the screen-casting transmission under the candidate protocol, including the text ratio score, the dynamic frame rate score, and the color complexity score, reflecting the compatibility between the candidate protocol and the screen-casting content.

[0023] Specifically, in step S2, the obtaining of the network weight includes the following steps: Calculate the ratio of the obtained real-time bandwidth to the maximum bandwidth to obtain the bandwidth utilization rate score; In a local area network environment with zero packet loss, calculate the ratio of the difference between the preset maximum allowable delay threshold and the measured delay of the candidate protocol to the maximum allowable delay threshold to obtain the native protocol delay score; Test the data recovery success rate of the candidate protocol by actively applying network interference with a preset packet loss rate, and obtain the protocol redundancy recovery ability score based on the ratio of the data recovery success rate to the preset recovery success rate standard threshold; Sum the bandwidth utilization rate score, the native protocol delay score, and the protocol redundancy recovery ability score through a preset weight coefficient to obtain the network weight of the candidate protocol.

[0024] In the specific implementation process, the available bandwidth data of the current link is obtained in real time through the system bottom-layer interface, the theoretical maximum bandwidth value is set according to the network type, and the ratio of the real-time bandwidth to the theoretical maximum bandwidth is converted into the bandwidth utilization rate score; an independent test environment is configured in the local area network to ensure that the network packet loss rate is close to zero packet loss. Use the UDP protocol to send probe data packets of a preset fixed size, transmit them between the screen-casting device and the receiving end at a fixed frequency, count the round-trip delay of the transmission for a preset number of threshold times, and take the median after excluding outliers as the native protocol delay. Take the ratio of the difference between the preset maximum allowable delay threshold and the native protocol delay to the preset maximum allowable delay threshold as the native protocol delay score; simulate a weak network scenario by injecting a preset packet loss rate into the test link through a traffic controller for a preset number of seconds. The screen-casting sender records the total number of sent data packets, and the screen-casting receiver counts the number of successfully received packets. Calculate the ratio of the successfully received data packets to the total number of sent data packets as the protocol redundancy recovery ability score; finally, sum the bandwidth utilization rate score, the native protocol delay score, and the protocol redundancy recovery ability score through a preset weight coefficient to obtain the network weight of the candidate protocol. The calculation formula of the network weight is: Among them, is the network weight, is the bandwidth utilization score, is the bandwidth utilization score weight, is the protocol native delay score, is the protocol native delay score weight, is the protocol redundancy recovery ability score, is the protocol redundancy recovery ability score weight.

[0025] Specifically, in step S2, the acquisition of the content weight includes the following steps: Identify the text area in the screen mirroring image through the optical character recognition method and calculate the pixel ratio it occupies in the total image. Based on the preset ratio threshold division mapping rule, obtain the text ratio score of the current screen mirroring content; Perform difference detection on consecutive frames of the screen mirroring content, mark and calculate the proportion of the dynamic change area in the total image area. Based on the preset dynamic frame rate score division mapping rule, obtain the dynamic frame rate score of the current screen mirroring content; Convert the current screen mirroring content from RGB to HSV and count the distribution of the hue channel. Calculate the complexity entropy value according to the distribution of the hue channel, and use the ratio of the complexity entropy value to the theoretical maximum value of the entropy value as the color complexity score; Perform weighted summation on the text ratio score, dynamic frame rate score, and color complexity score through the preset weight coefficients to obtain the content weight.

[0026] In the specific implementation process, an optical character recognition engine is used to perform a full-frame scan on the current screen mirroring image, locate all regions containing text, precisely frame the boundary coordinates of each text region through edge detection and contour analysis algorithms, count the total number of pixels in all text regions, compare it with the total number of pixels in the image, calculate the text proportion, and map and obtain the text proportion score of the current screen mirroring content based on the preset proportion threshold division rule; convert the current frame and the previous frame of images into grayscale images, calculate the brightness difference value pixel by pixel, mark all pixels that meet the conditions as dynamic regions based on the preset dynamic change threshold, count the total number of pixels in the dynamic regions, calculate the proportion of it in the total area of the image, and map and obtain the dynamic frame rate score of the current screen mirroring content based on the preset dynamic frame rate score division rule; convert the current frame from the RGB color model to the HSV model, extract the hue channel data, divide the hue values into 36 equal-width intervals, count the number of pixels in each interval, generate a hue distribution histogram, and calculate the Shannon entropy value based on the hue distribution histogram to quantify the color diversity. The more uniform the hue distribution, the higher the entropy value; the more concentrated the distribution, the lower the entropy value; finally, the text proportion score, the dynamic frame rate score, and the color complexity score are weighted and summed through the preset weight coefficients to obtain the content weight. The calculation formula for the content weight is: Wherein, is the content weight, is the text proportion score of the current screen mirroring content, is the weight of the text proportion score, is the dynamic frame rate score of the current screen mirroring content, is the weight of the dynamic frame rate score, is the color complexity score of the current screen mirroring content, is the weight of the color complexity score.

[0027] Step S3: Based on the network weight and the content weight of the candidate protocol, calculate the comprehensive score of the candidate protocol, and select the candidate protocol with the highest comprehensive score as the current transmission protocol.

[0028] Specifically, in step S3, the obtaining of the comprehensive score includes the following steps: Based on the handshake test success rate between the candidate protocol and the protocol list of the terminal device receiving the current screen mirroring content, obtain the protocol compatibility score according to the preset success rate score mapping rule; Through real-time measurement of the signal strength, bit error rate, and adjacent channel interference strength, obtain the channel interference index score after weighted calculation and normalization; Based on the network weight, the channel interference index score, the content weight, and the protocol compatibility score, calculate the comprehensive score of the candidate protocol through the preset comprehensive score calculation formula.

[0029] In the specific implementation process, obtain the list of protocols supported by the screen mirroring receiver device, initiate protocol handshake requests one by one, count the success rate of each protocol handshake, and obtain the protocol compatibility score according to the preset success rate scoring mapping rule; obtain the channel interference index score through weighted summation and normalization of the signal strength, bit error rate, and adjacent frequency interference strength, and based on the network weight, channel interference index score, content weight, and obtained protocol compatibility score, obtain the comprehensive score of each candidate protocol through the comprehensive score calculation formula. The calculation formula for the comprehensive score is: Among them, is the comprehensive score, is the network weight, is the content weight, is the protocol compatibility score, is the channel interference index score, is the anti-interference factor, representing the network anti-interference ability. Sort the comprehensive scores of all candidate protocols in descending order, and select the protocol with the highest comprehensive score as the current transmission protocol.

[0030] Specifically, step S3 includes protocol hot swapping. The trigger condition for protocol hot swapping is that the new candidate protocol remains N within the preset continuous scoring periods of the comprehensive score, where the scoring period is the sliding interval of each preset sliding time window, and The calculation formula for is: Among them, is the dynamic protocol hot swapping threshold, is the channel interference index score, is the comprehensive score difference, is the comprehensive score of the new candidate protocol, is the comprehensive score of the current candidate protocol.

[0031] In the specific implementation process, step S3 includes the step of protocol hot swapping. When the new candidate protocol remains N within the preset continuous scoring periods of the comprehensive score, it triggers the hot swapping of the protocol, is the dynamic protocol hot swapping threshold. The greater the interference, the higher the threshold for triggering the switch, avoiding mis-switching caused by score fluctuations under high interference. The system uses a fixed time interval as the scoring period, and the scoring period is specifically set to be the same as the sliding interval of each preset sliding time window in step S1, and calculates the comprehensive score difference between the new candidate protocol and the current protocol within the preset continuousN within the scoring period of a comprehensive score to trigger the hot switch, ensuring that the protocol will not be switched frequently and preventing the connection of an invalid screen mirroring from being affected.

[0032] Specifically, after triggering the protocol hot switch, if the comprehensive score of the new protocol is lower than that of the original protocol within a continuously preset M number of scoring periods, it will automatically roll back to the original protocol and freeze the switching operation for a preset N number of scoring periods.

[0033] In the specific implementation process, after the protocol is switched, continuously monitor the comprehensive score of the new protocol. If the comprehensive score of the new protocol is lower than that of the original protocol within M consecutive scoring periods after the switch, it is determined that the switch fails, automatically switch back to the original protocol, and freeze the hot switch function for N periods to prevent frequent switching oscillations.

[0034] Step S4: Adjust the screen mirroring strategy based on the protocol native delay score, protocol redundancy recovery ability score, and dynamic network prediction factor of the current transmission protocol.

[0035] In the specific implementation process, after determining the current transmission protocol, adjust the specific parameters in the screen mirroring process based on the protocol native delay score, protocol redundancy recovery ability score, and dynamic network prediction factor of the current transmission protocol. First, adjust the redundancy ratio, and then, based on the adjusted redundancy ratio, adjust the resolution and bit rate of the screen mirroring content to achieve a strategy closed-loop, ensuring the maximum bandwidth utilization and the network adaptation of the screen mirroring content.

[0036] Specifically, in step S4, the dynamic network prediction factor includes the predicted bandwidth fluctuation and the predicted packet loss probability, and the screen mirroring strategy includes the adjustment of the redundancy ratio. The adjustment formula is: where is the redundancy ratio, is the predicted bandwidth fluctuation, is the predicted packet loss probability.

[0037] In the specific implementation manner, divide the predicted packet loss probability by 10 to obtain the redundancy demand coefficient for packet loss, divide the absolute value of the predicted bandwidth fluctuation by 100 to obtain the redundancy demand coefficient for bandwidth fluctuation. After adding the two demand coefficients, limit the upper limit of the redundancy ratio to 30%. According to the calculated redundancy ratio, insert redundant error correction packets into the data stream. The redundant error correction packets use forward error correction coding to ensure that the screen mirroring receiving end can recover the lost packets through the redundant data.

[0038] Specifically, the screen mirroring strategy also includes the adjustment of the resolution of the screen mirroring content after the adjustment of the redundancy ratio. The adjustment formula is: Among them, is the real-time bandwidth, the effective available bandwidth, is the redundancy ratio, the adjusted resolution, is the maximum resolution supported by the receiving end, is the coding efficiency factor, is the target frame rate, is the constant quality factor.

[0039] In the specific implementation process, the redundant occupied bandwidth is deducted from the real-time bandwidth to obtain the effective available bandwidth. The coding efficiency per unit bandwidth is determined according to the type of coding protocol, and the target frame rate is preset based on the type of screen mirroring content, and the constant quality factor of the preset picture quality parameters , substitute the effective bandwidth, coding efficiency, target frame rate, and constant quality factor into the formula, calculate the theoretically supported adjusted resolution, compare it with the maximum resolution supported by the screen mirroring receiving end, and select the smaller value of the two as the final screen mirroring resolution. Finally, adopt progressive resolution switching to avoid stuttering caused by sudden changes in the picture.

[0040] Specifically, the screen mirroring strategy also includes adjusting the bit rate of the screen mirroring content after adjusting the redundancy ratio. The adjustment formula is: Among them, is the adjusted bit rate, the effective available bandwidth, is the protocol native delay score.

[0041] In the specific implementation process, the influence of the protocol native delay is deducted from the effective bandwidth to determine the adjusted bandwidth transmission bit rate. The higher the protocol native delay score, the greater the delay, and the bit rate needs to be reduced to relieve the transmission pressure. The sliding window mean filtering algorithm is used to smoothly control the change of the bit rate to avoid stuttering or mosaic caused by sudden changes in the bit rate.

[0042] The working principle of an adaptive wireless screen mirroring transmission method based on multi-protocol fusion provided by the present invention is as follows: First, analyze the historical bandwidth fluctuation data and real-time channel interference index using a random forest model to obtain dynamic network prediction factors. The dynamic network prediction factors include bandwidth fluctuation and packet loss probability within a future window, providing a forward-looking basis for policy adjustment. Then, calculate the network weights of candidate protocols based on the obtained real-time bandwidth, protocol native delay score, and protocol redundancy recovery ability score, and calculate the content weights of candidate protocols based on the obtained screen mirroring content type parameters, providing a basis for the subsequent calculation of the comprehensive score of the protocol. Next, calculate the comprehensive score of the candidate protocol based on the network weight and content weight of the candidate protocol, which is used as the basis for protocol selection and hot switching during the screen mirroring connection process. Secondly, calculate the redundancy ratio based on the prediction factors, improve the packet loss resistance ability of weak networks by injecting redundant error correction packets, and at the same time limit the redundancy upper limit to prevent excessive bandwidth occupation. Finally, adjust the specific resolution and bit rate of the screen mirroring content based on the obtained redundancy ratio to achieve specific adaptive control of screen mirroring transmission under multi-protocol fusion.

[0043] Embodiment 2 An adaptive wireless screen mirroring transmission system based on multi-protocol fusion is applied to an adaptive wireless screen mirroring transmission method based on multi-protocol fusion. In the specific implementation process, as Figure 2 shown, it shows the module structure of an adaptive wireless screen mirroring transmission system based on multi-protocol fusion, including: A dynamic network prediction factor generation module 100, which is used to generate the dynamic network prediction factors of candidate protocols based on the obtained channel interference index score of candidate protocols and the bandwidth fluctuation data within a preset sliding time window, using a random forest optimization algorithm; A protocol weight calculation module 200, which is used to calculate the network weights of candidate protocols based on the obtained real-time bandwidth, protocol native delay score, and protocol redundancy recovery ability score, and calculate the content weights of candidate protocols based on the obtained screen mirroring content type parameters; A protocol selection decision module 300, which is used to calculate the comprehensive score of candidate protocols based on the network weight and content weight of candidate protocols, and select the candidate protocol with the highest comprehensive score as the current transmission protocol; A dynamic policy adaptation module 400, which is used to adjust the screen mirroring policy based on the protocol native delay score, protocol redundancy recovery ability score, and dynamic network prediction factors of the current transmission protocol.

[0044] The working principle of an adaptive wireless screen mirroring transmission system based on multi-protocol fusion provided by the present invention is as follows: The system of the present invention generates a prospective network prediction factor including predicted bandwidth fluctuation and predicted packet loss probability by using a random forest optimization algorithm through the dynamic network prediction factor generation module 100 to analyze the channel interference index and historical bandwidth fluctuation data of candidate protocols in real time, providing a network status pre-judgment for protocol decision-making; the protocol weight calculation module 200 calculates the network weight by combining the real-time bandwidth, the native delay score of the protocol, and the redundancy recovery ability score, and at the same time performs text recognition, inter-frame dynamic region detection, and HSV color entropy analysis through an optical character recognition method to quantify the content weight; the protocol selection decision module 300 fuses the network weight and the content weight, introduces the channel interference index and the protocol compatibility score, and dynamically selects the optimal protocol through a comprehensive scoring formula; the dynamic policy adaptation module 400 forms a linkage mechanism from prediction to decision-making to execution based on the protocol characteristics and the dynamic network prediction factor, adjusting the redundancy ratio and resolution bit rate in a closed loop, and realizing multi-protocol adaptive screen mirroring transmission with smoothness guaranteed in weak networks and picture quality guaranteed in strong networks.

[0045] This application is described with reference to the flowcharts and / or block diagrams of methods, apparatuses (systems), and computer program products according to embodiments of the present application. It should be understood that each flow and / or block in the flowchart and / or block diagram can be implemented by computer program instructions, and the combination of flows and / or blocks in the flowchart and / or block diagram can also be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices generate a device for realizing the functions specified in one Figure 1 flow or multiple flows and / or blocks Figure 1 or multiple blocks.

[0046] Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium. The storage medium includes read-only memory (ROM), random access memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), one-time programmable read-only memory (OTPROM), electrically-erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc memories, magnetic disc memories, tape memories, or any other medium that can be used to carry or store data and is computer-readable.

[0047] It should also be noted that the term "including", "comprising" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed, or further includes elements inherent in such a process, method, commodity or device. Without further limitation, an element defined by the statement "including one..." does not exclude the existence of another identical element in the process, method, commodity or device including the element.

Claims

1. An adaptive wireless screen mirroring transmission method based on multi - protocol fusion, characterized in that The adaptive wireless screen mirroring transmission method includes the following steps: S1: Based on the channel interference index scores of the candidate protocols obtained and the bandwidth fluctuation data within a preset sliding time window, use the random forest optimization algorithm to generate the dynamic network prediction factors of the candidate protocols; S2: Calculate the network weights of the candidate protocols based on the obtained real-time bandwidth, protocol native delay scores, and protocol redundancy recovery ability scores, and calculate the content weights of the candidate protocols based on the obtained screen mirroring content type parameters; S3: Based on the network weights and content weights of the candidate protocols, calculate the comprehensive scores of the candidate protocols, and select the candidate protocol with the highest comprehensive score as the current transmission protocol; S4: Adjust the screen mirroring strategy based on the protocol native delay scores, protocol redundancy recovery ability scores, and dynamic network prediction factors of the current transmission protocol.

2. The adaptive wireless screen mirroring transmission method based on multi - protocol fusion according to claim 1, wherein, In step S2, the obtaining of the network weights includes the following steps: Calculate the ratio of the obtained real-time bandwidth to the maximum bandwidth to obtain the bandwidth utilization score; In a local area network environment with zero packet loss, calculate the ratio of the difference between the preset maximum allowable delay threshold and the measured delay of the candidate protocol to the maximum allowable delay threshold to obtain the protocol native delay score; Test the data recovery success rate of the candidate protocol by actively applying network interference with a preset packet loss rate, and obtain the protocol redundancy recovery ability score based on the ratio of the data recovery success rate to the preset recovery success rate standard threshold; Perform weighted summation on the bandwidth utilization score, protocol native delay score, and protocol redundancy recovery ability score through preset weight coefficients to obtain the network weights of the candidate protocols.

3. An adaptive wireless screen mirroring transmission method based on multi - protocol fusion according to claim 2, characterized in that, In step S2, the obtaining of the content weights includes the following steps: Identify the text area in the screen mirroring image through the optical character recognition method and calculate its pixel ratio to the total image, and obtain the text ratio score of the current screen mirroring content based on the preset ratio threshold division mapping rule; Perform difference detection on consecutive frames of the screen mirroring content, mark and calculate the ratio of the dynamic change area to the total area of the image, and obtain the dynamic frame rate score of the current screen mirroring content based on the preset dynamic frame rate score division mapping rule; Convert the current screen mirroring content from RGB to HSV and count the distribution of the hue channel, calculate the complexity entropy value according to the distribution of the hue channel, and use the ratio of the complexity entropy value to the theoretical maximum value of the entropy value as the color complexity score; Perform weighted summation on the text ratio score, dynamic frame rate score, and color complexity score through preset weight coefficients to obtain the content weights.

4. The adaptive wireless screen mirroring transmission method based on multi - protocol fusion according to claim 3, wherein, In step S3, the obtaining of the comprehensive scores includes the following steps: Based on the handshake test success rate between the candidate protocol and the protocol list of the terminal device receiving the current screen mirroring content, obtain the protocol compatibility score by mapping according to a preset ratio; Normalize the channel interference index score obtained by weighted calculation through real-time measurement of signal strength, bit error rate, and adjacent channel interference strength; Based on the network weights, channel interference index scores, content weights, and protocol compatibility scores, calculate the comprehensive scores of the candidate protocols through a preset comprehensive score calculation formula.

5. A method for adaptive wireless screen mirroring transmission based on multi - protocol fusion according to claim 4, characterized in that, Step S3 includes protocol hot swapping, and the trigger condition for the protocol hot swapping is that the new candidate protocol remains N within the scoring period of a preset consecutive comprehensive scores, where the scoring period is the sliding interval of each slide of a preset sliding time window, and The calculation formula of is: Among them, is the dynamic protocol hot-switching threshold, is the channel interference index score, is the comprehensive score difference, is the comprehensive score of the new candidate protocol, is the comprehensive score of the current candidate protocol.

6. The adaptive wireless screen mirroring transmission method based on multi - protocol fusion according to claim 5, wherein, After triggering the protocol hot swap, if the comprehensive score of the new protocol is lower than that of the original protocol within M consecutive preset scoring cycles, it will automatically roll back to the original protocol and freeze the preset N scoring cycles of the switching operation.

7. An adaptive wireless screen mirroring transmission method based on multi - protocol fusion according to claim 6, characterized in that, In step S4, the dynamic network prediction factors include predicted bandwidth fluctuation and predicted packet loss probability, and the screen mirroring strategy includes adjusting the redundancy ratio, and the adjustment formula is: wherein, is the redundancy ratio, is the predicted bandwidth fluctuation, is the predicted packet loss probability.

8. An adaptive wireless screen mirroring transmission method based on multi - protocol fusion according to claim 7, characterized in that, The screen mirroring strategy further includes adjusting the resolution of the screen mirroring content after adjusting the redundancy ratio, and the adjustment formula is: wherein, is the real-time bandwidth, is the effective available bandwidth, is the redundancy ratio, is the adjusted resolution, is the maximum resolution supported by the receiving end, is the coding efficiency factor, is the target frame rate, is the constant quality factor.

9. The adaptive wireless screen mirroring transmission method based on multi - protocol fusion according to claim 8, characterized in that, The screen mirroring strategy further includes adjusting the bit rate of the screen mirroring content after adjusting the redundancy ratio, and the adjustment formula is: Among them, is the adjusted bit rate, the effective available bandwidth, is the protocol native latency score.

10. An adaptive wireless screen mirroring transmission system based on multi - protocol fusion, characterized in that, Applied to an adaptive wireless screen mirroring transmission method based on multi-protocol fusion according to any one of claims 1-9, the adaptive wireless screen mirroring transmission system includes: A dynamic network prediction factor generation module, configured to generate a dynamic network prediction factor of a candidate protocol by using a random forest optimization algorithm based on the obtained channel interference index score of the candidate protocol and the bandwidth fluctuation data within a preset sliding time window; A protocol weight calculation module, configured to calculate the network weight of a candidate protocol based on the obtained real-time bandwidth, protocol native delay score, and protocol redundancy recovery ability score, and calculate the content weight of the candidate protocol based on the obtained screen mirroring content type parameter; A protocol selection decision module, configured to calculate the comprehensive score of a candidate protocol based on the network weight and content weight of the candidate protocol, and select the candidate protocol with the highest comprehensive score as the current transmission protocol; A dynamic strategy adaptation module, configured to adjust the screen mirroring strategy based on the protocol native delay score, protocol redundancy recovery ability score, and dynamic network prediction factor of the current transmission protocol.

Images