Super-Resolution Video Decoder Using Compressive Sampling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional super-resolution video processing methods are complex and inefficient, particularly in the pixel domain, when decoding compressed video data to achieve higher resolutions.
Innovation Solution
A method and apparatus for super-resolution video coding using compressive measurements, where a decoder receives encoded video data, determines a higher display resolution, and reconstructs the video data using a reduction matrix based on discrete cosine transforms and identity matrices to enlarge the original resolution, allowing for sharper and clearer video playback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If conventional two-step processing (decompress then process in pixel domain) is used, then super-resolution can be achieved, but processing complexity increases significantly
Solution Approach 1:
The patent merges the decompression and super-resolution processing into a single integrated step. Instead of first decompressing video data and then processing it in the pixel domain, the system directly processes compressed video data through a reduction matrix that combines both decompression and super-resolution operations, thereby reducing processing complexity while maintaining super-resolution quality
Solution Approach 2:
The patent introduces a reduction matrix as an intermediary component that facilitates the transformation from compressed low-resolution data to super-resolved high-resolution data. This reduction matrix, derived from discrete cosine transforms and identity matrices, serves as a mediator that enables direct super-resolution from compressed data without requiring separate decompression and processing steps
2Manufacturing precision
If video data is decompressed first then processed for super-resolution, then resolution enhancement is achieved, but time consumption increases
Solution Approach 1:
The patent performs preliminary actions by pre-calculating and storing reduction matrices before actual video processing. These reduction matrices, derived from discrete cosine transforms of identity matrices, are prepared in advance and can be directly applied during video decoding, eliminating the need for time-consuming real-time decompression and processing operations
3Manufacturing precision
If conventional pixel-domain processing is used, then super-resolution is achieved, but computational resources required increase
Solution Approach 1:
The patent replaces complex mechanical pixel-domain processing operations with a more efficient mathematical approach using reduction matrices based on discrete cosine transforms. This substitution of computational methods reduces the computational resources required while maintaining super-resolution capability, as the matrix-based approach is more computationally efficient than traditional iterative pixel-processing methods
Data Source
AI summary
Embodiments relate to a method and apparatus for super resolution video coding using compressive measurements. The method includes receiving, by a decoder, a set of measurements, where the set of measurements represents encoded video data having original video data with an original display resolution. The method further includes determining, by the decoder, a display resolution, where the display resolution is higher than the original display resolution, and determining a reduction matrix based on at least a number of pixels for the determined display resolution, where the reduction matrix includes a pattern of values. The method further includes reconstructing, by the decoder, the video data or a portion of the video data using the determined reduction matrix and the received set of measurements such that the original display resolution is enlarged to the determined display resolution.