Video frame rate improvement method and device

Abstract

The invention applies to the technical field of video processing and provides a video frame rate improvement method and device. The method comprises the steps of carrying out motion estimation on twoadjacent frames, thereby obtaining a motion vector of each pixel; segmenting a previous frame of image; clustering the motion vectors of all pixels, thereby obtaining a plurality of clustering centers; dividing the segmented areas into a plurality of areas according to the clustering centers, wherein the divided areas of which preset parameters are smaller than a first threshold are background areas, the divided areas of which the preset parameters are greater than or equal to the first threshold are motion areas, if the same object comprises the motion areas and the background areas and the preset parameters of the motion areas are smaller than a second threshold, the same object is a background object, otherwise, the same object is a motion object; finishing segmenting a foreground and abackground; carrying out image compensation; and inserting frames. According to a motion estimation algorithm based on sparse optical flow in the invention, on the basis of image segmentation, motionvector clustering is carried out on the pixels in the areas, the motion vectors of the foreground and the background are estimated, the motion compensation is realized, and the motion estimation accuracy of a nonrigid motion objet is improved.

Description

technical field [0001] The invention belongs to the technical field of video processing, and in particular relates to a video frame rate improving method and device. Background technique [0002] Video frame rate enhancement (Frame Rate Up Conversion, FRUC), using the algorithm of inter-frame image motion compensation, increases the number of video images played per second, making the playback effect smoother. The main technology of FRUC involves motion estimation and compensation between adjacent frames, and image interpolation. First, by comparing the difference between the two frames before and after the frame to be inserted, find the background pixel and the changed pixel. Since the background pixel has not changed, it can be directly used to insert the frame. The changed pixel includes motion and brightness changes, etc., and a certain motion estimation method can be used. Find the function expression of the changed pixel, and then calculate the position or RGB color i...

AI Technical Summary

Problems solved by technology

[0004] The purpose of the embodiments of the present invention is to provide a method and device for increasing the video frame rate, aiming to solve the problem of inaccurate motion estimation of non-rigid moving objects in the current video frame rate improvement

Images