2D to 3D Video Conversion via Zero-Parallax Plane Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for converting 2D videos to 3D suffer from poor depth and pop-out effects, especially in consumer applications, and lack automated control for modifying the zero-parallax plane and exaggerating depth for enhanced special effects.

Innovation Solution

A method and system that allow users to interactively control and enhance 3D-image rendering by manipulating depth maps and zero-parallax plane positions, using graphical user interfaces and processing power from CPUs, GPUs, or dedicated hardware to generate high-quality 3D frames in real-time or offline.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If manual roto-scoping is used to generate depth maps, then 3D image quality is improved, but production time and cost increase significantly

Engineering Contradiction:
Improve3D image qualityVSAvoidproduction time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent replaces the manual mechanical process of roto-scoping with an automated computational system that uses image processing algorithms and depth estimation techniques to automatically generate depth maps from 2D images, eliminating the need for manual artist intervention while maintaining acceptable 3D quality

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service 2D to 3D conversion by providing automated tools that allow users to convert their own 2D content to 3D without requiring professional artists, using algorithms that automatically analyze 2D images and generate corresponding depth information and stereo pairs

Inventive Principle:
Principle #25Self-service

2Productivity

If automated 2D to 3D conversion is used in consumer applications, then productivity is improved, but 3D image quality deteriorates

Engineering Contradiction:
Improveconversion speedVSAvoiddepth quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent implements dynamic control of the zero-parallax plane position and depth exaggeration parameters that can be adjusted in real-time based on user preferences and application requirements, allowing the system to adaptively optimize both speed and quality for different scenarios

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes key parameters including zero-parallax plane position, depth map scaling factors, and offset adjustments to enhance pop-out effects and depth perception, transforming the output to achieve better visual quality without sacrificing automated conversion speed

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If complex mathematical analysis is used to generate depth maps, then 3D image quality is improved, but computational complexity and hardware requirements increase

Engineering Contradiction:
Improve3D image qualityVSAvoidcomputational complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the depth generation process into distinct stages: initial depth map generation using simplified algorithms, followed by selective enhancement of specific regions or objects using depth exaggeration techniques, allowing quality improvement without applying complex analysis to the entire image

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10250864B2Method and apparatus for generating enhanced 3D-effects for real-time and offline applications
Publication Date: 2019.04.02 VEFXI CORPORATION
  • US10250864B2 patent drawing
  • US10250864B2 patent drawing
  • US10250864B2 patent drawing

AI summary

A method for adjusting and generating enhanced 3D-effects for 2D to 3D image and video conversion applications includes controlling a depth location of a zero parallax plane within a depth field of an image scene to adjust parallax of objects in the image scene, controlling a depth volume of objects in the image scene to one of either exaggerate or reduce 3D-effect of the image scene, controlling a depth location of a segmentation plane within the depth field of the image scene, dividing the objects in the image scene into a foreground group and a background group, selectively increasing or decreasing depth volume of objects in the foreground group, selectively increasing or decreasing depth separation of objects in the foreground group relative to the objects in the background group, and generating an updated depth map file for a 2D-image.