Single Lens Camera Monocular Sequence Stereo Pair Generation

Solution Overview

Problem

Traditional methods for generating stereoscopic images require capturing and storing two offset images, which increases storage requirements and processing complexity, limiting efficiency in mobile and wearable devices.

Innovation Solution

A method for generating synthetic stereoscopic pairs using a single lens camera by capturing a monocular image sequence along a camera translation, interpolating virtual images, and rotating frames to create a surround view that provides a three-dimensional perception without storing actual 3D models.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If two offset images are captured to generate stereoscopic images, then depth perception is improved, but storage requirements and processing complexity increase

Engineering Contradiction:

Improvedepth perceptionVSAvoidstorage requirements

Core Design Contradiction:

Measurement precisionVSQuantity of substance

Solution Approach 1:

The system performs preliminary action by capturing a monocular image sequence along a camera translation path before stereoscopic rendering is needed. These captured images serve as preprocessed data that can be used to generate multiple stereoscopic pairs through subsequent interpolation and rendering operations, reducing the need to store multiple complete stereo pairs

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The invention creates synthetic copies of stereoscopic image pairs through computational rendering from a single monocular sequence. Instead of capturing and storing multiple actual stereo pairs, the system generates synthetic left and right eye views through image processing, interpolation, and rendering techniques, significantly reducing storage requirements while maintaining depth perception quality

Inventive Principle:

Principle #26Copying

2Measurement precision

If two offset images are captured to generate stereoscopic images, then depth perception is improved, but device complexity increases

Engineering Contradiction:

Improvedepth perceptionVSAvoidprocessing complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The system achieves multi-functionality by using a single monocular camera to perform the work that would traditionally require a stereoscopic camera system. The captured monocular sequence is then processed to generate multiple stereoscopic pairs for different viewpoints, making the single camera system as versatile as a multi-camera system while reducing hardware complexity

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The invention replaces the mechanical system of multiple physical cameras with a computational system. Instead of using multiple cameras to capture offset images simultaneously, the system uses a single camera to capture a sequence along a translation path, then uses image processing, interpolation, and rendering algorithms to synthesize the stereoscopic effect, substituting mechanical complexity with computational processing

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Quantity of substance

If a monocular image sequence is used to generate stereo pairs, then storage requirements are reduced, but image processing complexity increases

Engineering Contradiction:

Improvestorage requirementsVSAvoidimage processing complexity

Core Design Contradiction:

Quantity of substanceVSDevice complexity

Solution Approach 1:

The system performs preliminary action by capturing a monocular image sequence along a camera translation path before stereoscopic rendering is needed. These captured images serve as preprocessed data that can be used to generate multiple stereoscopic pairs through subsequent interpolation and rendering operations, reducing the need to store multiple complete stereo pairs

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The invention creates synthetic copies of stereoscopic image pairs through computational rendering from a single monocular sequence. Instead of capturing and storing multiple actual stereo pairs, the system generates synthetic left and right eye views through image processing, interpolation, and rendering techniques, significantly reducing storage requirements while maintaining depth perception quality

Inventive Principle:

Principle #26Copying

Data Source

PatentUS10650574B2Generating stereoscopic pairs of images from a single lens camera

Publication Date: 2020.05.12 FUSION INC

AI summary

Various embodiments of the present disclosure relate generally to systems and processes for generating stereo pairs for virtual reality. According to particular embodiments, a method comprises obtaining a monocular sequence of images using the single lens camera during a capture mode. The sequence of images is captured along a camera translation. Each image in the sequence of images contains at least a portion of overlapping subject matter, which includes an object. The method further comprises generating stereo pairs, for one or more points along the camera translation, for virtual reality using the sequence of images. Generating the stereo pairs may include: selecting frames for each stereo pair based on a spatial baseline; interpolating virtual images in between captured images in the sequence of images; correcting selected frames by rotating the images; and rendering the selected frames by assigning each image in the selected frames to left and right eyes.