Video Encoding via Transform Domain Non-Lateral Motion Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video encoding techniques face challenges in reducing data transmission while maintaining high video quality, particularly in efficiently compressing video streams using motion estimation, as existing methods lack low complexity solutions that deliver high quality in the frequency domain.
Innovation Solution
The method involves transforming video frames into a frequency domain representation, selecting a reference portion based on transform domain coefficients, and predicting non-lateral motion or scaling/rotation of image portions to encode video data efficiently, reducing the need for extensive computational overhead.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If motion estimation and compensation based on regular block based partitions is used, then compression efficiency is improved, but computational complexity increases
Solution Approach 1:
The video frame is divided into multiple blocks of different sizes (e.g., 16x16, 8x8, 4x4 pixels) rather than using a single uniform block size. This segmentation allows the encoder to adaptively select the appropriate block size for different regions of the image, improving compression efficiency in areas with simple motion while reducing computational complexity in areas with complex motion patterns.
Solution Approach 2:
Different block sizes and motion estimation techniques are applied to different regions of the video frame based on local characteristics. Regions with smooth motion use larger blocks for efficient compression, while regions with complex motion patterns use smaller blocks to maintain quality, thereby optimizing the trade-off between compression efficiency and computational complexity locally.
2Quantity of substance
If inter frame prediction is used to compress video data, then data transmission volume is reduced, but dependency on previous frames increases leading to error propagation
Solution Approach 1:
The patent combines intra-frame prediction and inter-frame prediction techniques into a unified hybrid prediction framework. For each block, the encoder evaluates both intra-frame (spatial) and inter-frame (temporal) prediction options and selects the one that provides better compression while managing dependency. This merging allows the system to reduce data transmission volume through inter-frame prediction while limiting error propagation by falling back to intra-frame prediction when reference frames are unavailable or corrupted.
3Productivity
If transform domain processing is applied to video blocks, then compression performance is improved, but computational overhead increases
Solution Approach 1:
Transform domain processing (e.g., DCT - Discrete Cosine Transform) is applied selectively to only those blocks that benefit from it, rather than to all blocks uniformly. The encoder evaluates each block's characteristics and applies transform processing only when it provides significant compression performance improvement, thereby reducing overall computational overhead while maintaining high compression performance where needed.
Data Source
AI summary
A method of compressing a video signal. The method comprises: for each of a plurality of image portions, transforming from a spatial domain representation into a transform domain representation; and for each of a plurality of target image portions to be encoded, determining a respective reference portion, determining a prediction of the target image portion based on the reference portion, and encoding the target image portion based on the prediction. The prediction comprises predicting a non-lateral motion of the target image portion relative to the reference portion based on processing of their transform domain coefficients. The encoding comprises generating an encoded bitstream comprising information about the non-lateral motion for use by a decoder.