Supercharge Your Innovation With Domain-Expert AI Agents!

A video encoding and decoding method and device based on image super-resolution

A super-resolution, video coding technology, used in image communication, digital video signal modification, electrical components, etc., can solve the blurring of edges, restrict the efficiency of sub-pixel motion compensation, and it is difficult to restore high-frequency detail information of high-resolution images, etc. problem, to avoid blurred edges, improve accuracy, and improve coding efficiency

Active Publication Date: 2019-02-26
PEKING UNIV SHENZHEN GRADUATE SCHOOL
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The advantage of the linear interpolation method is that it is simple, but the disadvantage is that it is difficult to restore the high-frequency detail information of the high-resolution image, and at the same time blur the edge, thus restricting the efficiency of sub-pixel motion compensation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A video encoding and decoding method and device based on image super-resolution
  • A video encoding and decoding method and device based on image super-resolution
  • A video encoding and decoding method and device based on image super-resolution

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0023] Please refer to figure 1 , figure 1 It is a flowchart of an image super-resolution-based video encoding method in an embodiment. Such as figure 1 As shown, this embodiment provides a video coding method based on image super-resolution, which may include the following steps:

[0024] 101. Using a pre-trained texture dictionary library to perform super-resolution interpolation processing on video images.

[0025] After super-resolution interpolation processing, the reference image is obtained. The texture dictionary library includes: one or more sets of dictionary bases, the dictionary bases are: a mapping group consisting of high-resolution image blocks of training images and low-resolution image blocks corresponding to the high-resolution image blocks, The super-resolution interpolation processing includes: image enlargement and image detail information restoration.

[0026] 102. Perform motion estimation and motion compensation on the reference image for each imag...

Embodiment approach

[0034] S1. Select a plurality of high-resolution local image blocks from a training image set including several training images, wherein a high-resolution local image block is composed of at least two pixels on the image where it is located. The training image is down-sampled to obtain low-resolution local image blocks corresponding to each local image block.

[0035] S2. Extracting local features of high-resolution local image blocks to obtain high-resolution dictionary samples Dh(y), and extracting local features of low-resolution local image blocks corresponding to each of the local image blocks to obtain Low-resolution dictionary samples Dl(y), mapping and combining the high-resolution dictionary samples and the low-resolution dictionary samples to obtain a set of dictionary base samples, the local features include LBS and SES.

[0036] S3. Perform training on the multiple sets of dictionary base samples to obtain a texture dictionary library.

[0037] The process and princ...

Embodiment 2

[0062] Please refer to image 3 , image 3 It is a flowchart of an implementation manner of step 101 in the first embodiment. In this embodiment, each dictionary base in the texture dictionary is classified according to the local features of the high-resolution image blocks of each training image and the local features of the low-resolution image blocks corresponding to the high-resolution image blocks, the Local features include local binary structure and sharp edge structure.

[0063] The video encoding method based on image super-resolution provided in this embodiment uses a pre-trained texture dictionary library to perform super-resolution interpolation processing on video images, which may specifically include the following steps:

[0064] 101a. Extract local features of each image block on the video image.

[0065] 101b. Match the local features of each image block in the video image with the local features of each dictionary base in the texture dictionary library, an...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a video coding and decoding method and device based on the image super-resolution. According to the method, before a video image to be coded or decoded is predicted, the super-resolution interpolation processing is carried out on the video image to be coded or decoded, amplifying and detailed information recovering can be carried out on the video image to be coded or decoded, and therefore when the video image to be coded or decoded is predicted to obtain a prediction block, compared with a method for predicting the video image through the linear interpolation in the prior art, the original image can be restored more effectively, the problem that the edge of a prediction block is blurry in the prior art is avoided, and the prediction accuracy of the video image is enhanced, and accordingly the coding efficiency of the video image is improved.

Description

technical field [0001] The present invention relates to the technical field of image super-resolution, in particular to a video encoding and decoding method and device based on image super-resolution. Background technique [0002] The traditional coding method is to use the information redundancy of the image to be encoded and the video itself to compress the video image. With the continuous improvement of encoding technology, the redundancy of video encoding is continuously reduced. Correlation is fully exploited. Predicting the image and video information to be encoded with the help of information other than the image and video to be encoded, thereby reducing the amount of information of the image and video to be encoded, is a new direction to greatly improve the efficiency of image and video compression. [0003] In the prior art, in order to improve the efficiency of inter-frame prediction of video images, sub-pixel motion compensation technology is generally adopted. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N19/53
Inventor 王荣刚赵洋王振宇高文王文敏董胜富黄铁军马思伟
Owner PEKING UNIV SHENZHEN GRADUATE SCHOOL
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More