Redundant Video Encoding for Error Resilience
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video communication technologies, such as H.264/AVC and MPEG-4 AVC, face challenges in providing scalable image resolution and error resilience, with the redundant picture feature in H.264 not being widely adopted due to increased implementation complexity and limitations in error correction.
Innovation Solution
The technique involves transforming an original high-resolution video frame into a low-resolution image and multiple enhancement data sets, which are encoded and transmitted as bitstreams, utilizing sub-band coding and multiple description coding, and leveraging the redundant picture tool to enable scalable and error-resilient video transmission compatible with existing standards like ITU-T H.264.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If redundant coded pictures are added to provide error resilience, then transmission reliability is improved, but device complexity increases
Solution Approach 1:
The video frame is divided into multiple slices, with at least one slice being a redundant slice that can be decoded independently. This segmentation allows the redundant information to be distributed across different parts of the bitstream, providing error resilience without requiring the entire frame to be retransmitted upon error occurrence.
Solution Approach 2:
The patent creates redundant copies of video data by encoding at least one slice as a redundant slice that contains sufficient information for independent decoding. These redundant copies serve as fallback options when primary decoding fails due to transmission errors, improving reliability without requiring full frame redundancy.
2Manufacturing precision
If scalable video coding tools are implemented to provide higher resolution, then image quality is improved, but implementation complexity increases
Solution Approach 1:
The video data is segmented into base layer and enhancement layer slices. The base layer provides basic video quality, while enhancement layers provide additional resolution. This segmentation allows decoders with different capabilities to process only the necessary layers, reducing implementation complexity while maintaining the option for high quality.
Solution Approach 2:
Different slices within the same frame can have different quality levels. Critical regions can be allocated higher quality slices with more data, while less critical regions use lower quality redundant slices. This local quality approach optimizes overall image quality while managing complexity through selective resource allocation.
3Reliability
If multiple description coding is used to enable error correction, then error resilience is improved, but encoding complexity increases
Solution Approach 1:
The video frame is divided into multiple slices that can be independently decoded, with at least one slice being a redundant slice containing sufficient information for independent decoding. This segmentation enables multiple description coding where different slices serve as different descriptions, providing error resilience without requiring complex joint encoding of entire frames.
Solution Approach 2:
The redundant slices are designed to serve multiple functions: they act as error correction data when primary slices fail, provide lower quality fallback content, and can be used for progressive refinement. This multi-functionality reduces encoding complexity by using a single redundant encoding pass rather than separate error correction codes.
Data Source
AI summary
A method and apparatus for encoding and decoding video performs transformation of at least a portion of a high-resolution video frame into a low resolution image and a plurality of enhancement data sets, encodes the low resolution image as a primary coded picture in a bitstream format and encodes each of the plurality of enhancement data sets as a different redundant coded picture in the bitstream format. For decoding, a decoded low resolution image and a plurality of decoded enhancement data sets are generated and an inverse transform is performed to construct a decoded high-resolution image. The primary coded picture and a redundant coded picture may be formatted according to the ITU-T H.264 Advanced Coding specification. The transform may be a polyphase or a sub-band transform.