Inter-Layer Racing Video Decoder for Scalable Streams
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video decoders require large storage capacity and bandwidth for buffering and accessing external memory when decoding scalable video streams, particularly in H.264/SVC, due to the need for complete decoding of base layer frames before enhancement layers can be decoded.
Innovation Solution
The proposed inter-layer racing scheme allows the enhancement layer to be decoded before the base layer is fully decoded, using either a base layer racing mode or an enhancement layer racing mode, which reduces the storage capacity and bandwidth requirements by buffering only partial decoding results and enabling early start of enhancement layer decoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the base layer frame is fully decoded before decoding the enhancement layer frame, then the decoding accuracy is improved, but the storage capacity and bandwidth requirements increase
Solution Approach 1:
The patent applies preliminary action by starting to decode the enhancement layer frame before the base layer frame is fully decoded. The enhancement layer decoding is initiated in advance, using progressively available base layer data as it becomes decoded, rather than waiting for complete base layer decoding. This allows the system to begin processing enhancement layer data earlier in the decoding pipeline.
Solution Approach 2:
The patent segments the decoding process into overlapping stages where the base layer and enhancement layer are decoded in an interleaved manner. Instead of completing one layer entirely before starting the other, the decoding is divided into manageable segments that can be processed concurrently, with the enhancement layer decoding proceeding in segments as base layer data becomes available.
2Measurement precision
If the base layer frame is fully decoded before decoding the enhancement layer frame, then the decoding accuracy is improved, but the bandwidth for accessing external memory increases
Solution Approach 1:
The patent applies preliminary action by starting to decode the enhancement layer frame before the base layer frame is fully decoded. The enhancement layer decoding is initiated in advance, using progressively available base layer data as it becomes decoded, rather than waiting for complete base layer decoding. This allows the system to begin processing enhancement layer data earlier in the decoding pipeline.
Solution Approach 2:
The patent ensures continuity of useful action by maintaining an overlapping decoding window where both base layer and enhancement layer decoding proceed continuously rather than sequentially. The enhancement layer decoding continues uninterrupted as base layer data becomes available, maximizing the utilization of decoding resources and minimizing idle time.
3Quantity of substance
If the enhancement layer is decoded before the base layer is fully decoded, then the storage capacity and bandwidth requirements are reduced, but the decoding complexity increases
Solution Approach 1:
The patent applies dynamics by implementing a flexible, adaptive decoding window that dynamically adjusts its position and size based on the decoding progress. The enhancement layer decoding window moves forward as base layer data becomes available, creating a dynamic rather than static decoding process. This allows the system to adapt to varying data availability without requiring complex buffering mechanisms.
Solution Approach 2:
The patent segments the decoding process into overlapping stages where the base layer and enhancement layer are decoded in an interleaved manner. Instead of completing one layer entirely before starting the other, the decoding is divided into manageable segments that can be processed concurrently, with the enhancement layer decoding proceeding in segments as base layer data becomes available.
4Quantity of substance
If the enhancement layer is decoded before the base layer is fully decoded, then the hardware costs and power consumption are reduced, but the decoding process becomes more complex
Solution Approach 1:
The patent applies dynamics by implementing a flexible, adaptive decoding window that dynamically adjusts its position and size based on the decoding progress. The enhancement layer decoding window moves forward as base layer data becomes available, creating a dynamic rather than static decoding process. This allows the system to adapt to varying data availability without requiring complex buffering mechanisms.
Solution Approach 2:
The patent applies preliminary action by starting to decode the enhancement layer frame before the base layer frame is fully decoded. The enhancement layer decoding is initiated in advance, using progressively available base layer data as it becomes decoded, rather than waiting for complete base layer decoding. This allows the system to begin processing enhancement layer data earlier in the decoding pipeline.
Data Source
AI summary
One exemplary method for decoding a scalable video stream, including a base layer frame and at least an enhancement layer frame corresponding to the base layer frame, has the following steps: decoding the base layer frame; and before the base layer frame is fully decoded, decoding the enhancement layer frame. Another exemplary method for decoding a scalable video stream, including a base layer frame and at least an enhancement layer frame corresponding to the base layer frame, has the following steps: decoding the enhancement layer frame, and decoding the base layer frame; wherein a start point of decoding the enhancement layer frame is earlier than a start point of decoding the base layer frame.