Video super-resolution method based on key frame and non-local constraints

A non-local, super-resolution technology, applied in image analysis, image data processing, instruments, etc., can solve the problems of limited high-frequency information, high requirements, and degraded visual quality, and achieve sharpened image edges and multiple image details. Effect

Active Publication Date: 2016-05-25
XIDIAN UNIV
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Compared with Brandi's direct motion compensation, the effect is better, and the addition of high-frequency information is also more accurate, but in motion compensation, the requirements for matching criteria are very high, and the added high-frequency information is limited, resulting in a decrease in the quality of visual effects

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video super-resolution method based on key frame and non-local constraints
  • Video super-resolution method based on key frame and non-local constraints
  • Video super-resolution method based on key frame and non-local constraints

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] refer to figure 1 , the implementation steps of the present invention are as follows:

[0037] Step 1, input video X, and extract each frame of image in it.

[0038] Input video X, which includes high-resolution images and low-resolution images, and the image distribution relationship is: the first and last two frames are high-resolution images, starting from the first frame of high-resolution images, every eight frames of low-resolution images are A frame of high-resolution images until the end frame;

[0039] Extract each frame of video X to get high-resolution image frame X h ,h=1,...,M, and the low-resolution image frame X t ,t=1,...,N, and define these high-resolution images as key frames, and define these low-resolution images as non-key frames, where M is the number of frames of high-resolution images in the video, and N is the low-resolution images in the video. The number of frames of the resolution image.

[0040] Step 2, using the subdivisional relations...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a video super resolution method based on keyframes and non-local restriction. The video super resolution method mainly solves the problem that super resolution is highly dependent on matching criteria. The video super resolution method is implemented in the following steps: (1) a video X is input; (2) a frame of low-resolution image in the video X is amplified in a bicubic interpolation mode to obtain an amplified image, and a high-resolution image closest to the amplified image is subjected to high-pass filtering to obtain a low-frequency component and a high-frequency component; (3) image blocks are extracted from the amplified image and the low-frequency component respectively, and low-frequency image blocks are subjected to K clustering; (4) amplified image blocks are compared with a clustering center to find out the most similar clusters, and similar low-frequency image blocks are found out from the most similar clusters; (5) corresponding high-frequency image blocks are found out according to the similar low-frequency image blocks, and then the high-frequency image blocks are subjected to non-local weighting to obtain a reconstructed high-resolution image; (6) the steps (2), (3), (4) and (5) are executed repeatedly for each frame of low-resolution image in the video to obtain a high-resolution video. The video super resolution method based on the keyframes and non-local restriction can be applied to enhancement or restoration of videos.

Description

technical field [0001] The invention belongs to the technical field of video image processing, in particular to a method for super-resolution of low-resolution video, which can be used to enhance or restore video images. Background technique [0002] Video super-resolution technology is a discipline that improves video clarity and suppresses noise through various technical means in order to obtain more accurate video information. It is an important and challenging research content in video image processing. For the video super-resolution problem, researchers have proposed many methods. [0003] In 2008, Brandie et al. proposed an effective video super-resolution method. When transmitting compressed video, several frames of original uncompressed images are transmitted as key frames, and these key frames are used as a database, because there is a difference with non-key frames. great similarity. Therefore, when non-key frames are paired in these key frames, the pairing erro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06T5/00G06T5/50G06T7/00
Inventor 王爽焦李成张阳马文萍马晶晶杨淑媛侯彪
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap