Single Camera Stereoscopic Imaging via Reflective Optics

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Augmented reality (AR) and virtual reality (VR) devices face challenges in achieving accurate stereoscopic image capture and depth estimation with multiple cameras, which is impractical for compact and low-cost implementations due to size and cost constraints.

Innovation Solution

A single camera embedded in a mobile device, such as a smartphone, is used in conjunction with optical arrangements to capture stereoscopic imagery for a wide field of view, utilizing beam splitter elements and reflective optics to simulate a stereoscopic effect, enabling depth estimation and object tracking.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple cameras are used for stereoscopic image capture, then depth estimation and object detection accuracy is improved, but device size and cost increase

Engineering Contradiction:

Improvedepth estimation accuracyVSAvoiddevice size

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses a single camera to capture monocular images, then creates a stereoscopic effect through computational methods including generating synthetic disparity maps and depth information. This copying approach simulates binocular vision without requiring a second physical camera, thereby maintaining depth estimation capability while avoiding the size and cost penalties of multiple cameras

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical solution of using multiple physical cameras with a computational approach. By using image processing algorithms, neural networks, and synthetic depth map generation, the system substitutes hardware complexity with software-based stereoscopic image capture and depth estimation methods

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If multiple cameras are used for stereoscopic image capture, then depth estimation and object detection accuracy is improved, but device cost increases

Engineering Contradiction:

Improvedepth estimation accuracyVSAvoiddevice cost

Core Design Contradiction:

Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent creates synthetic stereoscopic images and depth information from single-camera captures using computational methods. This copying technique generates the appearance and functional equivalent of multi-camera stereo pairs through image processing and neural network inference, eliminating the need to manufacture and assemble multiple camera modules

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The patent substitutes expensive multi-camera hardware with more affordable single-camera hardware combined with computational processing. The cost reduction is achieved by replacing mechanical/optical complexity with software-based depth estimation and stereoscopic image generation algorithms

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Device complexity

If a single camera is used, then device size and cost are reduced, but stereoscopic image capture capability is compromised

Engineering Contradiction:

Improvedevice sizeVSAvoidstereoscopic image capture accuracy

Core Design Contradiction:

Device complexityVSMeasurement precision

Solution Approach 1:

The patent replaces the optical/mechanical stereoscopic capture system with a computational one. By using neural networks to infer depth from monocular images and generate synthetic disparity maps, the system achieves stereoscopic functionality through software rather than hardware, maintaining accuracy while reducing device size

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates synthetic stereoscopic image pairs and depth information by processing single-camera images through computational algorithms. This copying process generates the functional equivalent of true stereoscopic data, allowing accurate depth estimation and object detection despite using only one physical camera

Inventive Principle:

Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution allows for compact and cost-effective AR/VR devices to achieve accurate stereoscopic image capture and depth estimation, enhancing the immersive experience with a wide field of view while reducing hardware requirements.

Implementation Method 1

an optical arrangement that includes a beam splitter element and a reflective element

Methodology Applied

Scientific EffectLight reflection and beam splitting: Reflection

Implementation Method 2

an optical arrangement that includes a beam splitter element and a reflective element

Methodology Applied

Scientific EffectLight reflection: Reflection

Data Source

PatentUS11178380B2Converting a monocular camera into a binocular stereo camera

Publication Date: 2021.11.16 DISNEY ENTERPRISES INC

AI summary

Embodiments include an apparatus comprising a mobile computing device comprising a camera, and a mount removably attached with the mobile computing device to arrange the camera in a first position. The mount comprises a first surface, and two reflective elements spaced apart from each other and having a predefined disposition relative to the first position. The two reflective elements comprise respective convex surfaces extending from the first surface, the respective convex surfaces providing respective optical paths between an object and the camera.