Partial Frame Sampling for Low-Latency Video Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video streaming approaches result in high peak bandwidth consumption due to transmitting entire video frames, which can saturate network bandwidth, especially in real-time applications like game streaming, preventing effective latency reduction.
Innovation Solution
Capturing and encoding partial frames at a higher rate than the frame rate, using spatial and temporal sampling patterns, to reduce data transmission while maintaining video quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If entire video frames are transmitted at the video stream frame rate, then video resolution and quality are maintained, but peak network bandwidth consumption becomes saturated
Solution Approach 1:
The patent divides each video frame into multiple partial frames by capturing only a subset of pixels or regions at higher frame rates. This segmentation allows the system to transmit less data per transmission event while maintaining the ability to reconstruct the full frame, thereby reducing peak bandwidth consumption without sacrificing video quality.
Solution Approach 2:
The patent applies partial action by capturing and transmitting only portions of video frames rather than complete frames. By sampling partial frames at rates higher than the video stream frame rate, the system transmits sufficient information to reconstruct quality video while reducing the total data量 transmitted, thus lowering bandwidth requirements.
2Reliability
If entire video frames are transmitted before the next frame, then video quality is maintained, but network latency increases
Solution Approach 1:
The patent implements preliminary action by capturing partial frames at higher frame rates than the video stream frame rate. This allows the system to prepare and transmit video data more frequently, reducing the waiting time between frame transmissions and thereby lowering latency while maintaining quality through the accumulation of partial frame data.
Solution Approach 2:
The patent maintains continuity of useful action by continuously capturing and transmitting partial frames at high frame rates rather than waiting for complete frames. This continuous transmission approach keeps the network pipeline fuller and reduces idle time, thereby reducing overall latency while the receiver reconstructs complete frames from the continuous stream of partial data.
3Reliability
If partial frames are captured at higher frame rates, then network bandwidth utilization is reduced, but video resolution may be compromised
Solution Approach 1:
The patent segments video frames into multiple partial frames that can be captured at higher frame rates. By dividing the frame into smaller spatial or temporal segments, the system can transmit these segments more frequently at reduced data sizes, lowering bandwidth requirements while the receiver reassembles them to maintain full resolution.
Solution Approach 2:
The patent introduces a new dimension to frame transmission by capturing partial frames at higher frame rates than the video stream frame rate. This temporal dimension allows the system to transmit less data more frequently, and the receiver uses this high-rate partial data to reconstruct full-resolution frames, thereby reducing bandwidth while maintaining resolution.
Data Source
AI summary
In various examples, systems and methods are disclosed relating to high resolution and low latency video streaming are disclosed. A system can capture, from data generated by an application, a plurality of partial frames according to a sampling rate. The system can generate a plurality of packet groups, where each group includes one or more packets storing a respective partial frame of the plurality of partial frames and respective location metadata for the partial frame. The system can transmit the plurality of packet groups to a receiver system accessing the application, where each group is transmitted at a respective time.