Video super-resolution method based on key frame and non-local constraints

Abstract

The invention discloses a video super resolution method based on keyframes and non-local restriction. The video super resolution method mainly solves the problem that super resolution is highly dependent on matching criteria. The video super resolution method is implemented in the following steps: (1) a video X is input; (2) a frame of low-resolution image in the video X is amplified in a bicubic interpolation mode to obtain an amplified image, and a high-resolution image closest to the amplified image is subjected to high-pass filtering to obtain a low-frequency component and a high-frequency component; (3) image blocks are extracted from the amplified image and the low-frequency component respectively, and low-frequency image blocks are subjected to K clustering; (4) amplified image blocks are compared with a clustering center to find out the most similar clusters, and similar low-frequency image blocks are found out from the most similar clusters; (5) corresponding high-frequency image blocks are found out according to the similar low-frequency image blocks, and then the high-frequency image blocks are subjected to non-local weighting to obtain a reconstructed high-resolution image; (6) the steps (2), (3), (4) and (5) are executed repeatedly for each frame of low-resolution image in the video to obtain a high-resolution video. The video super resolution method based on the keyframes and non-local restriction can be applied to enhancement or restoration of videos.

Description

technical field

[0001] The invention belongs to the technical field of video image processing, in particular to a method for super-resolution of low-resolution video, which can be used to enhance or restore video images. Background technique

[0002] Video super-resolution technology is a discipline that improves video clarity and suppresses noise through various technical means in order to obtain more accurate video information. It is an important and challenging research content in video image processing. For the video super-resolution problem, researchers have proposed many methods.

[0003] In 2008, Brandie et al. proposed an effective video super-resolution method. When transmitting compressed video, several frames of original uncompressed images are transmitted as key frames, and these key frames are used as a database, because there is a difference with non-key frames. great similarity. Therefore, when non-key frames are paired in these key frames, the pairing erro...

Examples

Embodiment Construction

[0036] refer to figure 1 , the implementation steps of the present invention are as follows:

[0037] Step 1, input video X, and extract each frame of image in it.

[0038] Input video X, which includes high-resolution images and low-resolution images, and the image distribution relationship is: the first and last two frames are high-resolution images, starting from the first frame of high-resolution images, every eight frames of low-resolution images are A frame of high-resolution images until the end frame;

[0039] Extract each frame of video X to get high-resolution image frame X h ,h=1,...,M, and the low-resolution image frame X t ,t=1,...,N, and define these high-resolution images as key frames, and define these low-resolution images as non-key frames, where M is the number of frames of high-resolution images in the video, and N is the low-resolution images in the video. The number of frames of the resolution image.

[0040] Step 2, using the subdivisional relations...

technical field

[0001] The invention belongs to the technical field of video image processing, in particular to a method for super-resolution of low-resolution video, which can be used to enhance or restore video images. Background technique

[0002] Video super-resolution technology is a discipline that improves video clarity and suppresses noise through various technical means in order to obtain more accurate video information. It is an important and challenging research content in video image processing. For the video super-resolution problem, researchers have proposed many methods.

[0003] In 2008, Brandie et al. proposed an effective video super-resolution method. When transmitting compressed video, several frames of original uncompressed images are transmitted as key frames, and these key frames are used as a database, because there is a difference with non-key frames. great similarity. Therefore, when non-key frames are paired in these key frames, the pairing erro...

Examples

Embodiment Construction

[0036] refer to figure 1 , the implementation steps of the present invention are as follows:

[0037] Step 1, input video X, and extract each frame of image in it.

[0038] Input video X, which includes high-resolution images and low-resolution images, and the image distribution relationship is: the first and last two frames are high-resolution images, starting from the first frame of high-resolution images, every eight frames of low-resolution images are A frame of high-resolution images until the end frame;

[0039] Extract each frame of video X to get high-resolution image frame X h ,h=1,...,M, and the low-resolution image frame X t ,t=1,...,N, and define these high-resolution images as key frames, and define these low-resolution images as non-key frames, where M is the number of frames of high-resolution images in the video, and N is the low-resolution images in the video. The number of frames of the resolution image.

[0040] Step 2, using the subdivisional relations...

Images