Compressive Video Coding for Arbitrary Resolution Reconstruction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional video coding methods, such as MPEG2, lack scalability with transmission channel capacity and decoder resolution, leading to inefficiencies in video transmission across devices with varying capabilities.
Innovation Solution
The method employs compressive measurements for arbitrary resolution video coding, allowing video data to be encoded once and decoded at different resolutions and complexities without requiring additional bit rate or bandwidth, using expansion matrices and discrete cosine transform coefficients to reconstruct video data based on received measurements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional video coding (MPEG2) is used with fixed bit rate, then the encoded video stream can be transmitted at a stable rate, but it becomes unusable in channels with lower bit rate and suboptimal in channels with higher bit rate
Solution Approach 1:
The video signal is segmented into compressive measurements that can be independently decoded at different resolutions. The encoder divides the video data into measurement sets that can be selectively reconstructed at various quality levels, allowing the same encoded stream to adapt to different channel capacities without requiring multiple separate streams.
Solution Approach 2:
The system changes the reconstruction parameters (resolution, quality) based on channel capacity rather than changing the encoded stream itself. The decoder adjusts reconstruction parameters such as the number of measurements used and the expansion matrix selection to match available bandwidth, enabling seamless adaptation from low to high bit rate channels.
2Device complexity
If MPEG2 video is encoded at a fixed resolution, then the encoding process is simplified, but the video cannot be decoded at different resolutions without requiring multiple encoded streams
Solution Approach 1:
The compressive measurement encoding scheme provides universal compatibility across multiple decoder resolutions. A single encoded stream containing compressive measurements can be reconstructed at any resolution from low to high, making the encoding system multi-functional and eliminating the need for separate encoding pipelines for different resolutions.
Solution Approach 2:
The encoder performs preliminary compression of the video signal into a compact measurement representation that inherently contains information for multiple resolutions. By pre-processing the video into compressive measurements rather than fixed-resolution blocks, the system enables flexible reconstruction without requiring multiple pre-encoded streams.
3Productivity
If hierarchical modulation is used to carry lower and higher layer video streams, then bandwidth efficiency is improved, but the system still requires multiple layered streams rather than arbitrary resolution decoding
Solution Approach 1:
The system replaces static hierarchical layers with dynamic resolution selection. Instead of fixed lower and higher layers, the decoder can dynamically reconstruct at any resolution level by adjusting the reconstruction parameters and selecting appropriate expansion matrices, providing continuous rather than discrete resolution scalability.
Solution Approach 2:
The compressive measurement encoding creates a compressed representation that can be copied and transmitted efficiently, then reconstructed at various resolutions. The measurement set acts as a universal copy that contains sufficient information for arbitrary resolution reconstruction, improving bandwidth efficiency while maintaining full resolution flexibility.
Data Source
AI summary
The present invention relates to method and apparatus for arbitrary resolution video coding using compressive measurements. The method includes receiving at least one measurement of a set of measurements that was generated at an encoder. The set of measurements represents encoded video data. The method further includes determining a display resolution, where the display resolution is the same or different than an original display resolution. The method further includes determining an expansion matrix based on at least a number of pixels for the determined display resolution, and reconstructing the video data using the determined expansion matrix such that the original display resolution is resized to the determined display resolution if the determined display resolution is different than the original display resolution. The expansion matrix includes a pattern of values.