Multi-viewpoint video encoding and viewpoint synthesis predication method based on least square

A technology for viewpoint synthesis prediction and multi-view video, which is applied in the fields of digital video signal modification, image communication, stereo system, etc.

Active Publication Date: 2015-03-25
中电科安科技股份有限公司
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, existing VSP techniques only use information between adjacent viewpoints to synthesize virtual viewpoints. Due to the inaccuracy of depth information, the heterogeneity of different cameras, and the non-Lambertian reflection of objects, the quality and predictive ability of virtual viewpoints cannot be improved. is limited
Therefore, the existing VSP technology is difficult to greatly reduce the bit rate, and in the VSP technology, the virtual viewpoint is not used for display, but only for prediction

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-viewpoint video encoding and viewpoint synthesis predication method based on least square
  • Multi-viewpoint video encoding and viewpoint synthesis predication method based on least square
  • Multi-viewpoint video encoding and viewpoint synthesis predication method based on least square

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0040] The technical solution of the present invention can be carried out by the following steps. For the convenience of implementation and reference, the technical solutions of the invention are described in detail with reference to the accompanying drawings and embodiments. The embodiment of the present invention provides a multi-view video coding method based on least squares synthesis and prediction. The MVC reference software JMVC6.0 is used as the encoder, and the multi-view standard test sequences "ballet" and "breakdancers" with a resolution of 1024×768 are selected The 0th, 1st, and 2nd viewpoints of ” are used to test this algorithm, the GOP (group of pictures) is set to 8, and the QP (quantization step size) is 22, 27, 32, and 37, respectively, to encode the 3rd frame in the 2nd viewpoint. As an example, the steps of encoding the frame to be encoded in the current view are described. For the flowchart, see figure 1 :

[0041] Step 1, find the current pixel of the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a multi-viewpoint video encoding and viewpoint synthesis predication method based on least square. The multi-viewpoint video coding and viewpoint synthesis predication method comprises the following steps of: firstly, finding out a corresponding pixel of a current pixel point of a virtual viewpoint frame in a reference viewpoint frame through three-dimensional conversion; then, taking the obtained corresponding pixel in the reference viewpoint frame as a predicated pixel of a current pixel of the virtual viewpoint frame; then, utilizing a previously decoded frame and a virtual viewpoint frame thereof to be trained by least square to obtain a predicated coefficient; then, carrying out linear estimation on a pixel value of the predicated pixel according to the obtained predicated coefficient to obtain the pixel value of the current pixel, and carrying out the same operation on each pixel to finally obtain the virtual viewpoint frame; and finally, adding the generated virtual viewpoint frame into a reference frame list and encoding a frame to be encoded of a current viewpoint by an encoder according to the reference frame list. According to the multi-viewpoint video coding and viewpoint synthesis predication method disclosed by the invention, the quality of a synthesized viewpoint is enhanced by utilizing information in the viewpoints and among the viewpoints at the same time; and the multi-viewpoint video encoding efficiency based on viewpoint synthesis predication is improved.

Description

technical field [0001] The present invention relates to a multi-view video coding viewpoint synthesis prediction method, in particular to a multi-view video coding viewpoint synthesis prediction method based on least squares. Background technique [0002] The first-generation 3D display terminal is based on the left and right format, and it only provides two video streams for the left and right eyes. This means that based on this stereoscopic terminal, the viewer is required to wear special glasses to sit and watch in a relatively narrow range. Although current stereoscopic display systems can provide high-quality 3D video, these limitations in viewing affect the comfort and naturalness of viewing. Recently, advances in depth map research have led to the development of a new type of 3D display terminal, namely free-view TV. [0003] Free-view TV displays different stereoscopic video streams in different directions, it can provide users with free-view selection of scenes, a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04N13/00H04N19/597H04N19/105H04N19/192
Inventor 胡瑞敏胡金晖段漭龚燕王中元
Owner 中电科安科技股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products