Motion vector processing-based frame rate up-conversion method and device

Abstract

The embodiment of the invention discloses a motion vector processing-based frame rate up-conversion method and a motion vector processing-based frame rate up-conversion device. The method comprises the following steps of: performing scene detection on an input original video sequence to judge whether a scene is changed or not currently; if a scene change is detected, processing the original video sequence in an interpolation way to obtain processed data; if the scene change is not detected, processing the original video sequence in an extrapolation way to obtain processed data; calculating the processed data by using symmetrical motion estimation to obtain an initial motion vector field; performing motion vector processing on a motion vector of the initial motion vector field to obtain a new motion vector field; and performing adaptive motion compensation processing on a motion vector of the new motion vector field to obtain a frame to be interpolated. By the method and the device according to the embodiment of the invention, calculation complexity and motion estimation complexity can be lowered, the quality of an interpolated frame can be improved, and the requirements of real-time application can be met.

Description

technical field [0001] The invention relates to the technical field of video processing, in particular to a frame rate up-conversion method based on motion vector processing and a device thereof. Background technique [0002] The large-scale application of digital video and multimedia information has brought about the diversity of display formats. Therefore, the conversion between these formats is very important. Frame rate up-conversion, also known as frame rate up-conversion (FRUC), is a technology that can convert a low frame rate video sequence into a high frame rate video sequence. The frame rate increase has a wide range of applications, such as making the motion of video content look more continuous and natural. The frame rate increase is mainly used to realize the conversion between two different frame rate video scanning formats. An application of FRUC is High Definition Television (HDTV). The resolution of HDTV can reach up to 1920*1080, and the frame rate can ...

AI Technical Summary

Problems solved by technology

[0004] However, when the video sequence moves violently or there is a scene switch, the correlation between adjacent frames decreases, and this interpolation method will fail.

At the same time, since MCFI is a block-based algorithm, when a segmented block is at the edge of the object and contains several moving objects, the motion vector of the block is inaccurate, resulting in blurred edges of the interpolated image

Moreover, no matching pixel can be found for the pixel points in the occluded area and the exposed area, so the motion vector obtained by motion estimation is incorrect. In such an area, the MCFI method will interpolate an error block, which will cause a square effect

The use of MCFI will increase the computational complexity and the complexity of motion estimation, and reduce the quality of high-interpolation frames, which is not suitable for real-time applications

Images