Stereoscopic Image Interpolation for Juddering Reduction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Temporal sequential displaying of stereoscopic images leads to display defects due to synchronized capture of left and right images, resulting in juddering when objects are in motion.

Innovation Solution

A method for video processing that involves motion compensated temporal interpolation to generate additional images, estimating motion vectors for each pixel, and displaying these interpolated images sequentially to reduce temporal deviations and improve stereoscopic image rendering.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If temporal sequential displaying is used to display stereoscopic images, then the 3D rendering effect is improved, but display defects such as juddering occur when objects are in motion

Engineering Contradiction:

Improvestereoscopic rendering qualityVSAvoiddisplay defects

Core Design Contradiction:

ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent applies preliminary action by generating additional interpolated images between the originally captured left and right images. Motion compensation is performed in advance to predict the positions of moving objects in these intermediate frames, ensuring that when the images are displayed sequentially, the moving objects maintain consistent positions across frames, thereby preventing juddering and other display defects while preserving the stereoscopic effect

Inventive Principle:

Principle #10Preliminary action

2Ease of manufacture

If left and right images are captured in synchronized way, then the capture process is simplified, but temporal deviations cause juddering in moving objects during display

Engineering Contradiction:

Improveimage capture processVSAvoidposition consistency of moving objects

Core Design Contradiction:

Ease of manufactureVSStability of the object's composition

Solution Approach 1:

The patent applies parameter changes by introducing temporal interpolation parameters and motion compensation parameters. Instead of directly using the synchronized captured images, the system calculates motion vectors and generates intermediate images with adjusted temporal parameters. This transforms the static synchronized capture into a dynamic process that compensates for motion, maintaining position consistency while keeping the original synchronized capture approach

Inventive Principle:

Principle #35Parameter changes

Solution Approach 2:

The patent introduces an intermediary processing step between image capture and display. Motion compensation and temporal interpolation act as mediators that take the synchronized captured images as input and produce corrected images as output. This intermediary process resolves the temporal deviation issue without requiring changes to the original synchronized capture method, thereby maintaining both ease of capture and stability of moving objects

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS9402086B2Method for processing stereoscopic images and corresponding device

Publication Date: 2016.07.26 INTERDIGITAL MADISON PATENT HLDG

AI summary

The invention relates to a method for video processing of at least one image of a video sequence, said video sequence comprising a plurality of image pairs, each image pair comprising a first image and a second image said first and second images being intended to form a stereoscopic image. In order to reduce display defects, the method comprises a step of generation of at least a third image by motion compensated temporal interpolation from at least two of said second images.