Source-Sink Screen Streaming for Adaptive Input and Video Bit Rates
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing quantity and size of user input data in human interface devices (HIDs) due to larger video images lead to latency issues and impaired usability, especially in poor network conditions.
Innovation Solution
Adaptive adjustment of user input data transmission based on network conditions, where the sink device determines the network quality and adjusts the transmission amount of user input data, and the source device adjusts the video image bit rate accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the transmission amount of user input data is increased to improve input responsiveness, then the usability is improved, but the network throughput is consumed faster and latency increases in poor network conditions
Solution Approach 1:
The patent implements dynamic adjustment of user input data transmission parameters based on real-time network conditions. The sink device monitors network throughput and adaptively changes the transmission amount of user input data, switching between different transmission modes (e.g., from transmitting all input data to transmitting only changed data or summary information) to optimize the balance between responsiveness and network utilization.
Solution Approach 2:
The system changes transmission parameters such as data sampling rate, compression level, and transmission frequency based on network conditions. When network throughput is good, the system transmits more detailed user input data; when network throughput is poor, it reduces transmission amount or uses more aggressive compression, thereby adapting to varying network capacities while maintaining acceptable usability.
2Productivity
If the bit rate of video image is reduced to improve network efficiency, then the network throughput is preserved, but the image quality deteriorates
Solution Approach 1:
The source device dynamically adjusts video encoding parameters including bit rate, resolution, and frame rate based on current network conditions. When network throughput is sufficient, higher quality video is transmitted; when network throughput decreases, the system automatically reduces video quality parameters to maintain smooth transmission and avoid buffering, thereby preserving overall system productivity.
3Measurement precision
If the quantity of user input data is increased to capture more detailed input information, then the input precision is improved, but the processing latency increases
Solution Approach 1:
The system extracts and transmits only the most relevant and changed user input data elements rather than transmitting complete input data sets. By identifying and transmitting only essential input information (such as changed coordinates, pressure values, or touch states), the system maintains input precision for critical data while reducing overall transmission volume and processing latency.
Solution Approach 2:
The patent implements selective transmission where only a portion of user input data that has changed or is most relevant is transmitted in each update cycle. This partial transmission approach maintains sufficient input precision for effective control while significantly reducing the total data volume and associated processing latency compared to transmitting all possible input parameters continuously.
Data Source
AI summary
A source device includes a wireless communication module, a memory, and a processor. The processor is configured to transmit screen image data, generated by the source device to be displayed on a sink device, to the sink device through the wireless communication module. The processor is also configured to determine whether a target application configured to change a transmission amount of user input data generated in a screen image that is based on the screen image data, by an input device connected to the sink device is being executed while the screen image is being displayed on the sink device. The processor is further configured to adjust a transmission bit rate of the screen image data by changing a transfer profile for transmitting the screen image data, based on a determination that the target application is being executed.