Compressive Sampling Video Coding for Arbitrary Resolution Decoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional video coding methods, such as MPEG2, lack scalability with transmission channel capacity and decoder resolution, leading to inefficiencies in video transmission and decoding across devices with varying capabilities.
Innovation Solution
The method employs compressive sampling for arbitrary resolution video coding, using an expansion matrix to reconstruct video data at different display resolutions and complexities without requiring additional bit rate or bandwidth, by determining the display resolution based on the destination device's requirements and the number of received measurements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional video coding (MPEG2) is used, then video can be transmitted at a fixed bit rate, but it cannot be scaled to different channel capacities or decoder resolutions
Solution Approach 1:
The video signal is segmented into compressive measurements that can be independently decoded at different resolutions. The measurement matrix is divided into sub-matrices corresponding to different resolution levels, allowing the decoder to reconstruct video at multiple resolutions from a single encoded stream without requiring multiple separate streams.
Solution Approach 2:
The patent transforms the video representation from spatial domain to measurement domain using compressive sampling. By encoding in the measurement domain rather than traditional spatial or frequency domains, the system enables arbitrary resolution reconstruction through matrix operations, adding a new dimensional approach to video coding that naturally supports scalability.
2Productivity
If hierarchical modulation is used to carry lower and higher layer video streams, then bandwidth efficiency improves, but the cliff effect in video transmission persists
Solution Approach 1:
The system dynamically adapts the decoding resolution based on the number of received measurements and channel conditions. The decoder can flexibly reconstruct video at any resolution level from the compressive measurements, providing continuous quality adaptation rather than discrete hierarchical layers, thereby eliminating the cliff effect while maintaining bandwidth efficiency.
Solution Approach 2:
The patent changes the fundamental parameter of video representation from fixed-resolution pixel data to compressive measurements. This parameter change enables the system to adjust output resolution continuously based on received measurement count and channel quality, transforming the static hierarchical structure into a dynamic, continuous adaptation system that avoids the cliff effect.
3Adaptability or versatility
If MPEG2 video is decoded at one fixed resolution, then decoding complexity is fixed, but multiple encoded streams are needed for different resolution decoders
Solution Approach 1:
The compressive measurement encoding provides universal support for multiple decoder resolutions through a single encoded stream. The measurement matrix structure enables any decoder resolution to be reconstructed from the same measurements, making the encoding system multi-functional and eliminating the need for separate streams for different resolutions.
Solution Approach 2:
The patent creates virtual copies of the video signal at different resolutions through mathematical reconstruction from compressive measurements, rather than creating multiple physical encoded streams. Each decoder resolution effectively gets its own reconstructed version from the shared measurement set, reducing the quantity of encoded data while maintaining support for multiple resolutions.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present invention relates to method and apparatus for arbitrary resolution video coding using compressive measurements. The method includes receiving at least one measurement of a set of measurements that was generated at an encoder (202). The set of measurements represents encoded video data. The method further includes determining a display resolution, where the display resolution is the same or different than an original display resolution. The method further includes determining an expansion matrix based on at least a number of pixels for the determined display resolution, and reconstructing the video data using the determined expansion matrix such that the original display resolution is resized to the determined display resolution if the determined display resolution is different than the original display resolution. The expansion matrix includes a pattern of values.