Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A fully automatic 2D to 3D conversion method and device based on fusion depth cues

A depth clue, fully automatic technology, applied in the field of image and multimedia signal processing, can solve the problems of inaccurate extraction of depth information and uncomfortable three-dimensional experience

Inactive Publication Date: 2016-08-24
SHANDONG UNIV
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] Aiming at the shortcomings of the current fully automatic 2D to 3D system, such as inaccurate extraction of depth information and uncomfortable stereoscopic experience, the present invention proposes a fully automatic 2D to 3D conversion method and device that integrates two depth clues of motion parallax and Cr chroma component

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A fully automatic 2D to 3D conversion method and device based on fusion depth cues
  • A fully automatic 2D to 3D conversion method and device based on fusion depth cues
  • A fully automatic 2D to 3D conversion method and device based on fusion depth cues

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] The specific process of the fully automatic two-dimensional to three-dimensional method proposed by the present invention is as follows: figure 1 As shown, firstly, the optical flow method is used to perform motion estimation on the nth and n+1th frames, and the Euclidean distance is calculated for the obtained motion vector to obtain a depth map based on motion parallax. At the same time, the Cr chrominance component is extracted from the nth frame image to obtain a depth map based on color difference. Then, the two depth maps are fused according to the set weights to obtain a fused depth map. Finally, the two-dimensional original image and the depth map of the nth frame are used to perform stereo synthesis according to the DIBR technology, and finally the left and right eye stereoscopic views are obtained.

[0023] The depth extraction method adopted in the present invention is a depth extraction method that combines motion parallax and chrominance components. In ord...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Aiming at the shortcomings of the current automatic 2D to 3D system, such as inaccurate extraction of depth information and uncomfortable stereoscopic experience, the present invention proposes a fully automatic 2D to 3D conversion method and device that integrates motion parallax and color depth cues. The present invention combines motion parallax and color depth cues in an appropriate manner as the basis for extracting depth information, fully utilizes the advantages of the two depth cues, and makes the extracted depth map applicable to more scene conditions and more accurate. The user can extract the depth map of the two-dimensional picture sequence or video through simple parameter settings, and can synthesize three-dimensional stereoscopic video, which has practical application value in the field of three-dimensional video generation.

Description

technical field [0001] The invention relates to a fully automatic two-dimensional to three-dimensional video conversion technology, which belongs to the technical field of image and multimedia signal processing. Background technique [0002] With the development of 3D display technology and the popularization of 3D display devices, the problem of shortage of 3D video content has emerged. Shooting 3D content using the existing 3D shooting system cannot be popularized quickly due to the need to consume a lot of manpower and material resources. In recent years, 2D to 3D technology has gradually emerged and become a research hotspot. By converting the existing massive 2D video content into 3D content, it can effectively solve the problem of shortage of 3D video content and promote the further development of 3D technology. [0003] The existing 2D to 3D technology is divided into the following three categories according to the degree of manual participation: manual, semi-automat...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N15/00
Inventor 刘琚曹广昊
Owner SHANDONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products