Motion Vector Estimation Using Full-Resolution Residuals
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video transcoding methods are inefficient due to high processing power and time delays caused by complex rate-distortion optimization in modern video encoding standards, especially when downsampling videos for smaller screens or devices, as they require full decoding and re-encoding processes.
Innovation Solution
The proposed method involves using full-resolution video data to improve motion estimation and encoding efficiency by downsampling transform domain residuals and employing modified motion estimation and encoding processes, including weighted averaging of motion vectors and quad-tree based partition refinement, to select optimal motion vectors and coding modes for downsampled videos.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If full rate-distortion optimization is used in video transcoding, then encoding quality is improved, but processing time and computational complexity increase significantly
Solution Approach 1:
The patent performs preliminary actions by decoding the full-resolution video and extracting motion vectors and residuals before downsampling. This preliminary extraction of motion information allows the transcoder to reuse existing motion vectors from the high-resolution video, avoiding the need to perform complete rate-distortion optimization on the downsampled video, thus reducing processing time while maintaining encoding quality
Solution Approach 2:
The patent extracts only the essential motion information (motion vectors and residuals) from the full-resolution decoded video, separating this useful data from the complete video stream. By taking out only the necessary motion parameters rather than reprocessing the entire video, the system achieves fast transcoding without sacrificing encoding quality
2Manufacturing precision
If full rate-distortion optimization is used in video transcoding, then encoding quality is improved, but computational complexity increases
Solution Approach 1:
The patent extracts only the essential motion information (motion vectors and residuals) from the full-resolution decoded video, separating this useful data from the complete video stream. By taking out only the necessary motion parameters rather than reprocessing the entire video, the system achieves fast transcoding without sacrificing encoding quality
Solution Approach 2:
The patent copies motion vectors and residual data from the full-resolution decoded video and reuses them in the downsampled video encoding process. This copying of motion information allows the transcoder to avoid performing complete rate-distortion optimization, significantly reducing computational complexity while maintaining encoding quality through the reused motion parameters
3Manufacturing precision
If full-resolution video is decoded and re-encoded for downsampling, then output quality is maintained, but processing overhead increases
Solution Approach 1:
The patent performs preliminary decoding of the full-resolution video to extract motion vectors and residuals before the downsampling operation. This preliminary action captures essential motion information that can be reused during the encoding of the downsampled video, maintaining output quality while reducing the overhead of complete re-encoding
Solution Approach 2:
The patent copies motion vectors and residual data from the full-resolution decoded video and reuses them in the downsampled video encoding process. This copying of motion information allows the transcoder to avoid performing complete rate-distortion optimization, significantly reducing processing overhead while maintaining encoding quality through the reused motion parameters
Data Source
AI summary
A transcoder and method of transcoding in which inter-prediction frames of a downsampled video are encoded using downsampled full-resolution residuals in the rate-distortion analysis used to locate a motion vector for a given partition in the downsampled video.