Neural Network 2D to 3D Video Conversion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for converting two-dimensional video content into three-dimensional content are labor-intensive and result in sub-optimal quality, limiting the immersive experience for viewers, as they rely on manual creation of depth maps and complex mathematical models.

Innovation Solution

A neural network-based system that processes two-dimensional video content to generate three-dimensional content by analyzing motion vectors, image characteristics, and texture, allowing for automated conversion and improved depth estimation, mimicking human processing to create high-quality depth maps and render 3D images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If conventional manual methods are used to convert 2D content to 3D content, then the conversion process can be performed, but the process is labor-intensive and produces sub-optimal quality

Engineering Contradiction:
Improvedepth map qualityVSAvoidconversion time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent replaces manual mechanical depth mapping processes with an automated neural network system. The neural network automatically analyzes 2D video content and generates depth maps without human intervention, eliminating the labor-intensive nature of conventional methods while maintaining or improving depth map quality through learned patterns from training data.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The neural network system is self-training and self-improving. It automatically learns from training datasets to refine its depth estimation algorithms, enabling the system to continuously improve its own performance without external intervention. This self-service capability allows the system to achieve high-quality depth maps autonomously.

Inventive Principle:
Principle #25Self-service

2Productivity

If automated conversion methods are used, then the conversion process is faster, but the quality and accuracy of depth estimation deteriorates

Engineering Contradiction:
Improveconversion speedVSAvoiddepth estimation accuracy
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The system performs preliminary training actions by pre-training the neural network on extensive datasets before actual 2D-to-3D conversion. This pre-training phase enables the network to learn complex depth estimation patterns in advance, so that during actual conversion operations, high-quality depth maps can be generated automatically without sacrificing accuracy for speed.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If complex mathematical models are used for depth mapping, then the theoretical accuracy may be improved, but the system complexity and computational requirements increase

Engineering Contradiction:
Improvedepth measurement accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent substitutes complex mathematical modeling with a neural network-based approach. Instead of using intricate mathematical formulas and manual depth mapping techniques, the system employs a trained neural network that automatically learns depth estimation patterns from data, simplifying the system architecture while maintaining or improving measurement precision through pattern recognition.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10277877B23D system including a neural network
Publication Date: 2019.04.30 VEFXI CORPORATION
  • US10277877B2 patent drawing
  • US10277877B2 patent drawing
  • US10277877B2 patent drawing

AI summary

A three dimensional system that includes a neural network.