3D Reconstruction Using Virtual Baseline via Mirror Reflection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D reconstruction methods using a single camera result in non-scale accurate models, and while stereo camera systems improve depth estimation, their baseline is often insufficient for precise measurements, making them unsuitable for applications requiring strict camera calibration.

Innovation Solution

A method involving a multi-camera system where one camera captures an image of an object directly and the other captures the object's reflection in a mirror, effectively increasing the virtual baseline between cameras, allowing for more accurate depth measurements and improved 3D model generation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single camera is used for 3D reconstruction, then the device complexity is reduced, but the measurement precision and scale accuracy deteriorate

Engineering Contradiction:
Improvecamera system complexityVSAvoiddepth measurement precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

A mirror is introduced as an intermediary element to redirect light paths, enabling the second camera to capture images from a virtual position that would otherwise require physical placement at a larger baseline distance. This allows achieving a larger effective baseline without proportionally increasing device complexity

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system transitions from a single-plane camera arrangement to a multi-dimensional configuration by using a mirror to create a virtual camera position in three-dimensional space. This effectively increases the baseline distance without simply moving cameras apart in the same plane

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If a stereo camera system is used to improve depth estimation, then the measurement precision improves, but the baseline remains insufficient for accurate depth measurements

Engineering Contradiction:
Improvedepth estimation precisionVSAvoidcamera baseline
Core Design Contradiction:
Measurement precisionVSLength of stationary object

Solution Approach 1:

The mirror acts as an intermediary that extends the optical path length between cameras. By reflecting light between cameras, the system achieves an effective baseline larger than the physical distance between camera positions, solving the insufficient baseline problem

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If the baseline between cameras is increased to improve depth measurement accuracy, then the measurement precision improves, but the device complexity and spatial requirements increase

Engineering Contradiction:
Improvedepth measurement accuracyVSAvoidcamera system configuration
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The mirror serves as a compact intermediary that enables large effective baseline distances within a small physical footprint. This resolves the contradiction by achieving large baseline measurements without proportionally increasing device complexity or spatial requirements

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances the accuracy of 3D model construction by increasing the virtual baseline between cameras, leading to more precise depth calculations and improved scale accuracy in 3D reconstruction, overcoming the limitations of single-camera systems and standard stereo systems.

Implementation Method 1

obtaining a second image of the object captured by a second camera facing a second direction, wherein the second camera captures the second image of the object as a reflection in a mirror

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentUS10319141B2Method and system for vision based 3D reconstruction and object tracking
Publication Date: 2019.06.11 APPLE INC
  • US10319141B2 patent drawing
  • US10319141B2 patent drawing
  • US10319141B2 patent drawing

AI summary

Three dimensional model construction includes obtaining a first image of an object captured by a first camera facing a first direction, obtaining a second image of the object captured by a second camera facing a second direction, wherein the second camera captures the second image of the object as a reflection in a mirror, determining a virtual baseline distance between the first camera and a device including the second camera based on a location of the first camera, a known spatial relationship between the first camera and the device, and a reflected distance of the second camera, and generating at least a partial 3D model of the first object using the first image, the second image, and the virtual baseline distance.