Scalable Video Coding Using Non-Scalable Decoders
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing spatial scalable video coding methods do not effectively allow the reuse of non-scalable video decoders, limiting the easy upgrade from non-scalable to scalable video transmission systems and requiring significant modifications to existing hardware.
Innovation Solution
A method for encoding and decoding video frames into scalable bit-streams using a base layer and enhancement layer, where the base layer is downsampled and then upsampled to create a residual frame, which is divided into sub-frames and encoded separately, allowing for the use of non-scalable encoders and decoders by reusing existing video encoding and decoding algorithms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If spatial scalable video coding is implemented using existing non-scalable encoders and decoders, then system upgrade ease and hardware compatibility are improved, but coding efficiency and resolution scalability are worsened
Solution Approach 1:
The patent divides the residual frame into multiple residual sub-frames (first residual sub-frame, second residual sub-frame, etc.) after subtracting the up-scaled base layer from the original frame. Each sub-frame is encoded separately into the enhancement layer bit-stream, allowing non-scalable decoders to process them independently while maintaining scalability. This segmentation enables reuse of existing hardware without requiring complete system redesign.
Solution Approach 2:
The patent introduces a resolution dimension by downscaling the original frame to a lower resolution base layer, then upscaling it back to generate residuals at the original resolution. This dimensional transformation allows the system to maintain compatibility with non-scalable decoders while achieving scalable video coding functionality, resolving the contradiction between hardware compatibility and coding efficiency.
2Device complexity
If non-scalable decoders are reused for scalable video coding, then device complexity and hardware modification requirements are reduced, but video quality and resolution accuracy are worsened
Solution Approach 1:
The patent performs preliminary downscaling of the original frame to create a base layer at lower resolution before the actual encoding process. This preliminary action enables non-scalable decoders to process the base layer without requiring resolution accuracy at the original level, while the enhancement layer compensates for any quality loss through residual sub-frame encoding. The preliminary resolution reduction allows hardware reuse while maintaining final output quality.
3Adaptability or versatility
If video frames are downsampled and upsampled to create residuals for encoding, then compatibility with non-scalable decoders is improved, but processing time and computational complexity are increased
Solution Approach 1:
The patent applies partial action by only downscaling and upscaling the portions of the frame that are necessary for creating the enhancement layer residuals, rather than processing the entire frame at full resolution throughout the process. The base layer is encoded at reduced resolution, and only the residual differences are processed at full resolution for the enhancement layer, reducing overall processing time while maintaining decoder compatibility.
Data Source
AI summary
This invention discloses an encoding apparatus and a decoding apparatus for scalable video coding such that a non-scalable video decoder is usable for decoding a scalable video bit-stream comprising a base layer bit-stream and an enhancement layer bit-stream. In one embodiment, a source video frame is downscaled to give a downscaled video frame, which is then encoded into the base layer bit-stream. The difference between the source video frame and an up-scaled video frame reconstructed from the downscaled video frame in the base layer bit-stream yields a residual frame. The residual frame is partitioned into a number of residual sub-frames each having a resolution that is the downscaled video frame's resolution. The residual sub-frames are encoded into the enhancement layer bit-stream. Thereby, a non-scalable encoder is usable to encode both the downscaled video frame and the residual sub-frames, allowing both bit-streams to be decodable by employing only one non-scalable decoder.