Video coding post filtering method based on convolutional neural network

A convolutional neural network and post-filtering technology, applied in the field of computer vision and video coding, can solve problems such as loss of details, video blocky edges, blurring, etc., to achieve the effect of suppressing distortion

Active Publication Date: 2017-09-22
SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV +1
View PDF6 Cites 45 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although some algorithms have been adopted in the current video coding standards to reduce the block effect and improve the subjective quality,

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video coding post filtering method based on convolutional neural network
  • Video coding post filtering method based on convolutional neural network
  • Video coding post filtering method based on convolutional neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.

[0020] The present invention utilizes the powerful nonlinear fitting ability of the convolutional neural network, combines the characteristics of video coding, fully analyzes the causes of distortion in the process of video coding and compression, and proposes a video encoding method based on the convolutional neural network and related to quantization parameters and frame types. The encoding post-filtering method establishes the mapping between lossy video frames and lossless video frames, and trains to obtain different quantization parameters (QP for short) and convolutional neural network models under different frame types, which are used for post-filtering in the encoder The link performs filtering processing on frames with different quantization parameters and frame types, which can effectively suppress distortion.

[0021] In the hybrid v...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a video coding post filtering method based on a convolutional neural network. The method comprises a convolutional neural network model training step and a filtering step, the training step comprises: setting a quantization parameter of video compression to 20 to 51, and performing coding compression on the original video to obtain a compressed video; performing frame extraction on all videos to obtain a plurality of frame pairs of compressed video frames and original video frames; dividing the extracted frame pairs into a plurality of groups according to the frame types and different quantization parameters; establishing a convolutional neural network framework and initializing the network parameters, and training the neural network by using the divided groups to obtain a plurality of convolutional neural network models corresponding to different quantization parameters and frame types. The filtering step comprises: executing the foregoing coding compression and frame extraction on the to-be-processed original video to obtain to-be-processed frame pairs, and selecting the corresponding convolutional neural network models according to the quantization parameters and the frame types of the to-be-processed frame pairs to perform filtering processing.

Description

technical field [0001] The invention relates to the fields of computer vision and video coding, in particular to a convolutional neural network-based post-filtering method for video coding. Background technique [0002] With the development of science and technology and the abundance of various video display devices, video has increasingly become an indispensable part of people's lives and plays a very important role in various fields. The past few decades have witnessed the tremendous development of video resolution and display device screens, and ultra-high-resolution video will generate a huge amount of data, which will impose a great burden on network bandwidth. Therefore, high-efficiency video encoding and transmission technologies are required to ensure the user experience of watching videos, and at the same time reduce the amount of video data as much as possible to reduce the burden on network bandwidth. For this reason, researchers have been studying efficient vide...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N19/117H04N19/85H04N19/124G06N3/08
Inventor 张永兵林荣群王兴政王好谦戴琼海
Owner SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products