Layer-based video decoding for text legibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video codecs face a tradeoff between legibility and compression ratio when encoding video signals, particularly with detailed content like text, as aggressive quantization degrades legibility while less aggressive quantization compromises compression efficiency.
Innovation Solution
The technique involves generating multiple lossily-compressed residual layers and prediction information, along with masks, to reconstruct video signals, allowing for more aggressive compression while preserving image quality by directing the reconstruction process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If the encoder quantizes the DCT coefficients aggressively to reduce data size, then compression ratio is improved, but legibility of reconstructed text deteriorates
Solution Approach 1:
The patent segments the video signal into multiple layers with different compression characteristics. The first layer is compressed with higher compression ratio while the second layer is compressed with lower compression ratio, allowing different parts of the signal to be treated differently based on their importance for legibility
Solution Approach 2:
The patent applies different compression qualities to different layers of the video signal. The second layer, which contains critical information for legibility, is compressed with less aggressive quantization to preserve text quality, while the first layer uses more aggressive compression
2Manufacturing precision
If the encoder quantizes the DCT coefficients less aggressively to preserve legibility, then legibility is improved, but compression ratio deteriorates
Solution Approach 1:
The video signal is divided into multiple layers, allowing critical legibility information to be separated from other video data. This enables selective application of compression strength to different segments
Solution Approach 2:
The patent changes the quantization parameter for different layers. The second layer uses a less aggressive quantization parameter to preserve legibility, while the first layer uses a more aggressive parameter for better compression
3Device complexity
If conventional codecs compress video blocks uniformly, then device complexity is reduced, but image quality deteriorates due to edge artifacts
Solution Approach 1:
The patent segments the video blocks into multiple layers, allowing different compression strategies to be applied to different segments. This reduces edge artifacts by isolating high-frequency content in separate layers that can be processed differently
Solution Approach 2:
The patent adds a layer dimension to the compression process, transforming the traditional single-layer approach into a multi-layer structure. This enables more sophisticated quality control without significantly increasing device complexity
Data Source
AI summary
A technique for decoding video signals includes receiving, by electronic decoding circuitry, a set of video data representing a two-dimensional array of pixels of a video signal. The set of video data includes (i) multiple residual layers, each residual layer providing an incomplete, lossily-compressed representation of the two-dimensional array of pixels (ii) multiple sets of prediction information, one for each of the residual layers, and (iii) a set of masks for directing reconstruction of the two-dimensional array of pixels. The method further includes generating multiple decompressed layers based on the residual layers and on the sets of prediction information for the respective residual layers and combining the decompressed layers, as directed by the set of masks, to generate a complete reconstruction of the two-dimensional array of pixels of the video signal.