Sub-band Video Coding for Packet Loss Resilience
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Packet-based communication systems, particularly those transmitting time-sensitive data like video, are susceptible to degradation due to packet loss, which significantly compromises user perceptual quality and experience, as existing technologies lack effective means to handle such losses and ensure high user perceptual quality.
Innovation Solution
The implementation of sub-band video coding architecture, which involves subsampling video frames into sub-frames, applying filters to reduce pixel correlation, and using adaptive processing to generate a reconstructed frame that can be efficiently encoded and transmitted, thereby minimizing the impact of packet loss on video quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If video is transmitted using packet-based communication systems, then transmission efficiency and bandwidth utilization are improved, but packet loss occurs which significantly degrades user perceptual quality
Solution Approach 1:
The video frame is divided into multiple sub-frames, where each sub-frame can be independently encoded and transmitted as separate packets. This segmentation allows the system to tolerate packet loss better, as loss of one sub-frame packet does not completely corrupt the entire frame, thereby maintaining user perceptual quality while preserving transmission efficiency through parallel packet processing
Solution Approach 2:
Error concealment and reconstruction operations are performed in advance during the encoding phase, preparing alternative representations of video data that can be used if packet loss occurs during transmission. This preliminary preparation ensures that when packets are lost, the receiver can immediately switch to using the pre-prepared error-concealed data without significant quality degradation
2Reliability
If traditional error protection methods are used at the network layer, then packet loss is reduced, but system complexity and processing overhead increase
Solution Approach 1:
The patent introduces an intermediary error concealment mechanism at the video coding layer that acts as a buffer between the unreliable packet transmission and the final video reconstruction. This intermediary layer performs localized error recovery and interpolation operations, reducing the burden on network-layer error protection and simplifying the overall system architecture by distributing error handling responsibilities across multiple layers
3Productivity
If video frames are heavily compressed to reduce bandwidth, then transmission efficiency is improved, but error resilience and quality under packet loss deteriorate
Solution Approach 1:
Different portions of the video frame (sub-frames) are encoded with different levels of compression and error protection based on their local importance and characteristics. Critical regions are encoded with higher quality and redundancy, while less critical regions use higher compression. This local quality differentiation allows the system to achieve good overall bandwidth utilization while maintaining error resilience in important areas even under packet loss conditions
Data Source
AI summary
Sub-band video coding architecture for packet based transmission. Video processing includes converting of a frame or picture of a video signal into a number of respective sub-bands or sub-frames (e.g., such that each respective one is a respective subsampled version of an original frame or picture) and subsequent assembly thereof into a reconstructed frame or picture. The reconstructed frame or picture then undergoes video encoding to generate an output bitstream that may subsequently undergo appropriate processing (e.g., packetization, continuous time signal generation, etc.) to generate a signal for transmission via one or more communication the links. Characteristics associated with each respective sub-band or sub-frame may be similar (e.g., similar characteristics) or different (e.g., two or more sub-bands or sub-frames have different characteristics, such as different respective number of pixels, aspect ratios, etc.). Respective sub-frames may undergo video encoding and transmission.