Video Decoder Motion Vector Interpolation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video data resolution conversion techniques face issues with low accuracy and high processing load due to inappropriate motion vectors and increased bit rates, particularly when estimating high-resolution images from interlaced or low-resolution data.
Innovation Solution
An encoder and decoder system that uses additional motion information from low-resolution video data to interpolate high-resolution images, reducing the need for real-time motion estimation and eliminating pixel value codes in the bit stream, thereby lowering processing load and bit rate.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If motion vectors are estimated by a decoder in real-time, then the accuracy of motion representation is improved, but the processing load of the decoder increases drastically
Solution Approach 1:
Motion vectors are pre-calculated and stored in additional information during encoding, eliminating the need for real-time motion estimation at the decoder. The decoder simply retrieves pre-computed motion vectors from the additional information, significantly reducing processing load while maintaining accurate motion representation.
2Manufacturing precision
If pixel values of first video data are coded in addition to low-resolution stream data, then image quality is improved, but the bit rate increases
Solution Approach 1:
Only essential additional information (motion vectors and interpolation parameters) is extracted and transmitted, while the full pixel data of the first video data is not coded. This selective extraction approach maintains image quality by providing necessary motion compensation data without the overhead of transmitting complete high-resolution pixel values, thus controlling bit rate.
3Manufacturing precision
If filters are used to estimate high-resolution pixels from low-resolution images, then image resolution is improved, but the accuracy of high-resolution image decreases when motion vectors are inappropriate
Solution Approach 1:
Motion vectors serve as an intermediary that bridges low-resolution stream data and high-resolution output. By using accurate motion vectors from additional information to guide the interpolation process, the filter can correctly estimate high-resolution pixels even during motion, preventing the degradation of image accuracy that occurs with inappropriate motion vectors.
Data Source
AI summary
A decoder according to the present invention includes: an obtainment unit which obtains additional information that includes a motion vector indicating a motion of an image in the first video data, and stream data that is coded data of the second video data which has the same content as the first video data and which has the lower resolution than the resolution of the first video data; a decoding unit which decodes the stream data into images of the second video data; and a conversion unit which converts the decoded images of the second video data into third video data having the same resolution as the first video data, through interpolation using the additional information.