Temporally Interlaced Video Encoding for Adaptive Bitrate Playback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
User devices often select video fragments with bit rates that are too high for their network capacity, leading to poor playback experiences, and traditional video processing methods fail to dynamically adjust bit rates based on network conditions.
Innovation Solution
Encoding video content into temporally interlaced blocks allows for dynamic selection of bit rates by terminating connections and decoding partially received blocks, enabling playback at reduced quality until full quality is achieved.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If video content is encoded at high bit rate for optimal quality, then video quality is improved, but network bandwidth consumption increases and playback fails on networks with limited capacity
Solution Approach 1:
The video content is divided into multiple independently decodable segments or blocks. Each segment contains sufficient information to reconstruct a portion of the video at acceptable quality. This segmentation allows the system to transmit only the necessary number of segments based on network conditions, preventing bandwidth waste while maintaining playback capability.
Solution Approach 2:
The encoding structure is modified to create temporally interlaced blocks where the organization of video data allows flexible truncation. By changing how video frames are structured and interleaved in the bitstream, the system enables dynamic adjustment of the effective bit rate by simply cutting off the transmission at different points, without requiring re-encoding at multiple bit rates.
2Reliability
If video content is transmitted complete before playback starts, then playback reliability is improved, but network latency increases and buffering time is extended
Solution Approach 1:
The video content is pre-structured into independently decodable segments during encoding, but the actual transmission and playback start occur progressively as data arrives. This preliminary structuring enables the player to begin decoding and displaying video immediately upon receiving the first complete segment, without waiting for the entire video to be transmitted.
Solution Approach 2:
The system transitions from static complete-file transmission to dynamic progressive transmission where the amount of data transmitted adapts to real-time network conditions. The playback can start early with lower quality if needed, or continue receiving more data to improve quality, making the transmission process flexible and adaptive rather than fixed.
3Adaptability or versatility
If multiple bit rate versions of video are stored for adaptive streaming, then adaptability to network conditions is improved, but storage requirements and computational complexity increase
Solution Approach 1:
A single encoded video file with temporally interlaced block structure serves multiple functions: it can be truncated at different points to provide different effective bit rates, it enables progressive playback to start early, and it maintains compatibility with standard decoders. This universal structure replaces the need for multiple separately encoded bit rate versions.
Solution Approach 2:
The system allows discarding of later segments in the bitstream when network conditions are poor or time is limited, while still maintaining the ability to recover and transmit additional segments later if network conditions improve. This selective discarding and potential recovery eliminates the need to pre-store multiple complete versions at different qualities.
Data Source
AI summary
Systems and methods are described for processing video content. Content may be encoded/transcoded for delivery to a computing device that requested the content. The content may be encoded as temporally interlaced blocks, which interlaces frames over time. Because the frames are temporally interlaced, the computing device may be able to decode and play back a full-length or complete video at a reduced quality even if every temporally interlaced block was not received by the computing device, such as when network bandwidth is low or the network connection is disrupted. Receiving only a portion of the temporally interlaced blocks may be still be sufficient to display a full-length video at a reduced quality (e.g., at a reduced bit rate).