Unlock instant, AI-driven research and patent intelligence for your innovation.

Method and apparatus of neural network based processing in video coding

A technology of video decoding and video coding, which is applied in the general field of video coding and decoding, and can solve the problems of increased computational complexity of DNN

Active Publication Date: 2018-04-17
MEDIATEK INC
View PDF9 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the computational complexity of DNNs increases dramatically with the number of nodes associated with a large number of layers

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and apparatus of neural network based processing in video coding
  • Method and apparatus of neural network based processing in video coding
  • Method and apparatus of neural network based processing in video coding

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The following description is of the best contemplated mode of carrying out the invention. This description is made to illustrate the general principles of the invention and should not be considered limiting. The scope of the invention should be determined with reference to the appended claims.

[0028] Among different image restoration or processing methods, methods based on neural networks, especially Deep Neural Networks (DNN), have proven promising in recent years. It has been applied in image denoising, image super-resolution, and various other complex image processing tasks. In various studies, DNNs have been shown to have better performance than traditional image processing methods. Therefore, in the present invention, DNN is used as a picture restoration method in video codec to improve subjective quality or codec efficiency.

[0029] According to the present invention, DNN is used as a picture restoration technology in a video codec system. The present inven...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A method and apparatus of video coding incorporating Deep Neural Network are disclosed. A target signal is processed using DNN (Deep Neural Network), where the target signal provided to DNN input corresponds to the reconstructed residual, output from the prediction process, the reconstruction process, one or more filtering processes, or a combination of them. The output data from DNN output is provided for the encoding process or the decoding process. The DNN can be used to restore pixel values of the target signal or to predict a sign of one or more residual pixels between the target signal and an original signal. An absolute value of one or more residual pixels can be signalled in the video bitstream and used with the sign to reduce residual error of the target signal.

Description

[0001] priority statement [0002] This application claims priority to US Provisional Patent Application No. 62 / 214,121, filed September 3, 2015, which is hereby incorporated by reference in its entirety. technical field [0003] The present invention relates to the general field of video codecs. In particular, it relates to applying a Deep Neural Network (DNN) to a target signal in a video codec system, where the target signal provided to the input of the DNN corresponds to the reconstruction residual, from the prediction process, the reconstruction process, the at least The output of a filtering process, or any combination of them. Background technique [0004] A neural network, also known as an "artificial" neural network (ANN), is an information processing system that shares certain performance characteristics with biological neural networks. A neural network system consists of many simple and highly interconnected processing elements to process information through th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04N19/117
CPCH04N19/82H04N19/86G06N3/084G06N3/088H04N19/46H04N19/174H04N19/176H04N19/186H04N19/172H04N19/70G06N3/047G06N3/044H04N19/117H04N19/436G06N3/08G06T5/00H04N19/182H04N19/50H04N19/91G06N3/04
Inventor 黄毓文孙域晨庄子德林建良陈庆晔
Owner MEDIATEK INC