Intelligent inter-viewpoint coding method

A coding method and an inter-view technology, applied in the field of 3D video coding, can solve the problems of large amount of 3D video data, lack of intelligent inter-view coding methods, and poor applicability, so as to reduce bit overhead, improve coding efficiency, and reduce residual errors Effect

Active Publication Date: 2019-12-10
TIANJIN UNIV
View PDF3 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] The large amount of 3D video data brings unprecedented difficulties and challenges to video storage and transmission
[0007] The existing algorithms for modeling parallax relations, such as stretching and cutting the reference image, can effectively improve the accuracy of prediction, but the applicability is poor, and the effect is not good for videos with complex textures and rich movements; currently there is no Coding Method Between Intelligent Viewpoints

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intelligent inter-viewpoint coding method
  • Intelligent inter-viewpoint coding method
  • Intelligent inter-viewpoint coding method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] In order to make the purpose, technical solution and advantages of the present invention clearer, the implementation manners of the present invention will be further described in detail below.

[0030] The embodiment of the present invention proposes an intelligent inter-view encoding method, which fuses the predicted block obtained by the NBDV (Neighboring Block Disparity Vector) mode and the predicted block obtained by the DCP (Conventional Disparity Compensated Prediction) mode during the encoding process, and Using the learning characteristics of the convolutional neural network to generate more accurate prediction blocks, the specific implementation steps are as follows:

[0031] 1. Obtain training data

[0032] NBDV-based prediction and DCP are two different inter-view prediction coding modes in 3D video coding. However, some blocks to be coded do not have NBDV vectors, so in the process of obtaining training data, it is necessary to obtain the prediction blocks o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an intelligent inter-viewpoint coding method. The method comprises the following steps: respectively obtaining a first prediction block obtained based on an adjacent block parallax vector mode and a second prediction block obtained based on a traditional parallax compensation prediction mode; constructing a residual learning convolutional neural network structure with a variable convolution kernel size; taking a result obtained by cascading the brightness component channels of the two prediction blocks as the input of a convolutional neural network, wherein the output of the network is an enhanced prediction block of the original image block; training four different network models according to the four different quantization parameters; extracting brightness components of the first prediction block and the second prediction block respectively, performing channel cascading, and calling a corresponding network model for a result after cascading according to the size of the current coding block and the quantization parameter value; and finally, calculating the rate distortion cost of the enhanced prediction block, comparing the rate distortion cost with the optimal mode cost of the current coding block; if the rate distortion cost is less than the optimal mode cost, selecting the method as the optimal coding mode, coding the corresponding mark, and transmitting the coded mark to a decoding end.

Description

technical field [0001] The invention relates to the field of 3D video coding, in particular to a coding method between intelligent viewpoints. Background technique [0002] The large amount of 3D video data brings unprecedented difficulties and challenges to video storage and transmission. Therefore, how to realize efficient 3D video coding has important theoretical research significance and practical application value. Currently, 3D-HEVC (3D High Efficiency Video Coding) developed by JCT-VC, an international video coding standard organization jointly established by MPEG (Motion Picture Experts Group) and VCEG (Video Coding Experts Group), is the latest 3D video coding standard. 3D-HEVC introduces new prediction technology and coding tools for non-independent viewpoint and depth video, adds technologies suitable for multi-view video coding and depth video coding, and improves coding efficiency. However, there is still a lot of room for improvement in inter-view prediction ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N19/597H04N13/161H04N13/128
CPCH04N19/597H04N13/128H04N13/161
Inventor 雷建军张宗千侯春萍张凯明刘晓寰石雅南
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap