Autostereoscopic Video Frame Warping for Parallax Error Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D movie technologies face challenges in efficiently modifying stereoscopic properties of video content, such as interocular distance and local depth composition, without requiring perfect depth information or introducing parallax errors, especially when adapting content for different viewing platforms like cinemas, TVs, or mobile devices, and in real-time environments like live broadcasts.

Innovation Solution

A computer-implemented method and system that analyzes multiscopic video frames to determine image characteristics, generates a mapping function, and creates a third image based on this function, allowing for stereoscopic editing that modifies perceived depth and parallax without dense source stereoscopic information, using non-linear warp functions and disparity mapping operators to adjust disparities and preserve artistic intent and viewer comfort.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If dense source stereoscopic information is used to modify stereoscopic properties, then manufacturing precision is improved, but device complexity increases and productivity decreases

Engineering Contradiction:
Improvestereoscopic property modification accuracyVSAvoidcontent adaptation efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent extracts only the essential stereoscopic properties (disparity information) from the source video content, rather than requiring complete dense depth maps. This extraction approach obtains sufficient information for stereoscopic editing while significantly reducing computational complexity and processing time, thereby resolving the contradiction between precision and productivity.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system performs preliminary analysis of the source video to identify and extract key disparity characteristics before the actual stereoscopic editing process. This preliminary action prepares necessary information in advance, enabling faster and more efficient content adaptation without sacrificing modification accuracy.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If dense source stereoscopic information is used to modify stereoscopic properties, then manufacturing precision is improved, but device complexity increases

Engineering Contradiction:
Improvestereoscopic property modification accuracyVSAvoidprocessing system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the essential stereoscopic properties (disparity information) from the source video content, rather than requiring complete dense depth maps. This extraction approach obtains sufficient information for stereoscopic editing while significantly reducing computational complexity and processing time, thereby resolving the contradiction between precision and productivity.

Inventive Principle:
Principle #2Taking out (Extraction)

3Reliability

If parallax errors are corrected in real-time, then reliability is improved, but productivity decreases

Engineering Contradiction:
Improveparallax error correction accuracyVSAvoidlive broadcast processing speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent replaces complex mechanical-style processing (frame-by-frame dense depth analysis) with a more efficient computational approach that uses extracted disparity information and mapping functions. This substitution enables real-time parallax correction in live broadcasts by significantly reducing processing requirements while maintaining correction accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs preliminary analysis of the source video to identify and extract key disparity characteristics before the actual stereoscopic editing process. This preliminary action prepares necessary information in advance, enabling faster and more efficient content adaptation without sacrificing modification accuracy.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9445072B2Synthesizing views based on image domain warping
Publication Date: 2016.09.13 DISNEY ENTERPRISES INC
  • US9445072B2 patent drawing
  • US9445072B2 patent drawing
  • US9445072B2 patent drawing

AI summary

Techniques are disclosed for generating autostereoscopic video content. A multiscopic video frame is received that includes a first image and a second image. The first and second images are analyzed to determine a set of image characteristics. A mapping function is determined based on the set of image characteristics. At least a third image is generated based on the mapping function and added to the multiscopic video frame.