Lossless Inter-Frame Transcoding for Video Error Resilience
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video compression techniques lack effective error resilience for offline compressed video data during transmission, particularly in environments with high packet loss and varying channel conditions, where conventional methods struggle to maintain high-quality video services.
Innovation Solution
The implementation of a lossless inter-frame transcoding (LIFT) technique that converts conventional coded video data blocks into transcoded blocks, incorporating both coefficient and prediction data, allowing for robust decoding even when prediction blocks are unavailable due to packet loss, and a video server using offline transcoding and online composing to adaptively adjust the ratio of transcoded blocks based on packet loss rates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional video compression techniques are used for offline compressed video data, then compression efficiency is improved, but error resilience during transmission deteriorates
Solution Approach 1:
The patent segments the video data into blocks and applies different coding strategies to different blocks. Some blocks are coded as intra-blocks (I-blocks) for robustness, while others are coded as inter-blocks (P-blocks or B-blocks) for efficiency. This segmentation allows the system to optimize both compression efficiency and error resilience by distributing the trade-off across different blocks.
Solution Approach 2:
The patent applies local quality by treating different blocks differently based on their importance and the transmission conditions. Important blocks (such as I-blocks) are coded with higher robustness, while less critical blocks can use more efficient inter-block coding. This allows the system to maintain high compression efficiency overall while ensuring robustness where it is most needed.
2Reliability
If error resilience techniques are applied to improve robustness during transmission, then reliability is improved, but device complexity increases
Solution Approach 1:
The patent performs preliminary action by pre-coding certain blocks as I-blocks with robustness built-in before transmission. This preliminary robustness encoding allows the system to handle transmission errors without requiring complex real-time error correction mechanisms, thereby improving reliability while controlling complexity.
Solution Approach 2:
The patent introduces an intermediary approach by using a hybrid coding structure where I-blocks and P-blocks work together. The I-blocks serve as intermediaries that can be decoded independently, providing a safety net for transmission errors while the P-blocks provide efficient compression. This intermediary structure simplifies the overall error handling compared to purely robust coding approaches.
3Reliability
If offline transcoding is used to convert conventional coded blocks to transcoded blocks, then error resilience is improved, but processing time increases
Solution Approach 1:
The patent applies partial action by transcoding only a portion of the video data (specifically, converting P-blocks and B-blocks to their transcoded versions while leaving I-blocks as-is). This partial transcoding approach provides error resilience for the most error-prone blocks without the processing overhead of transcoding the entire video stream, thus balancing reliability improvement with time loss.
Data Source
AI summary
Described herein is a novel transcoding technique called lossless inter frame transcoding (LIFT) for improving the error resilience of video streaming. According to various embodiments, conventional coded blocks are selectively transcoded into new transcoded blocks. At the decoder, the transcoded blocks can be transcoded back to the conventional coded blocks when prediction is available and can also be robustly decoded independently when prediction is unavailable. According to another embodiment, an offline transcoding and online composing technique is provided for generating a composite frame using the transcoded and conventional coded blocks and adjusting the ratio of the transcoded blocks, thereby achieving error robustness scalability.