Single Camera Multi-Lens 3D Motion Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current motion-capture systems require multiple cameras to track 3D motion, which increases cost and imposes size constraints, particularly in space-constrained environments like mobile devices.

Innovation Solution

A single camera with multiple lenses positioned above an image sensor, where the sensor is divided into regions to capture optically independent images from each lens, effectively acting as multiple cameras to create a 3D reconstruction without the need for multiple camera setups.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple cameras are used to capture 3D motion, then measurement precision is improved, but device complexity and volume increase

Engineering Contradiction:
Improve3D motion tracking accuracyVSAvoidnumber of cameras
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple camera functions into a single camera by integrating multiple lenses that focus light from different angles onto different regions of a single image sensor. This merging approach maintains the ability to capture multiple viewpoints simultaneously while reducing the system from multiple separate camera units to one integrated camera, thereby decreasing device complexity and volume while preserving 3D motion tracking accuracy.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The image sensor is divided into multiple distinct regions, each responsible for capturing images from a specific lens and viewing angle. This segmentation allows the single sensor to process multiple perspectives independently, enabling 3D reconstruction capabilities that would traditionally require multiple separate cameras, thus resolving the contradiction between measurement precision and device complexity.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If multiple cameras are used for 3D reconstruction, then measurement precision is improved, but volume occupied increases

Engineering Contradiction:
Improve3D image capture accuracyVSAvoidspace required for camera system
Core Design Contradiction:
Measurement precisionVSVolume of moving object

Solution Approach 1:

The patent merges the functionality of multiple cameras into a single camera unit with multiple lenses and a divided image sensor. This consolidation dramatically reduces the volume occupied by the camera system while maintaining the capability to capture 3D motion and create accurate reconstructions, directly addressing the contradiction between measurement precision and volume requirements.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

Instead of adding more camera units in physical space, the patent adds multiple lenses and divides the sensor into multiple regions, effectively adding the dimensional capacity to capture multiple viewpoints within a single camera's optical path. This allows 3D reconstruction capability without increasing the physical volume occupied by the camera system.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If multiple cameras are employed, then 3D motion tracking is achieved, but cost increases

Engineering Contradiction:
Improve3D motion capture capabilityVSAvoidsystem cost
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent merges multiple camera functions into a single camera unit with multiple lenses and a divided image sensor. This consolidation reduces the number of separate camera components that need to be manufactured, assembled, and calibrated, thereby lowering overall system cost while maintaining 3D motion tracking capability through the integrated multi-lens design.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This configuration allows for economical and effective 3D motion tracking using a single camera, reducing the volume required for multiple cameras and enhancing the accuracy of 3D image capture in motion-capture systems.

Implementation Method 1

a plurality of lenses that focus light transmitted from an object onto a plurality of different pixel regions of the image sensor

Methodology Applied
Scientific EffectLight focusing: Lens

Implementation Method 2

an image sensor including an array of light-sensing pixels

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS10531069B2Three-dimensional image sensors
Publication Date: 2020.01.07 SIM IP HXR LLC
  • US10531069B2 patent drawing
  • US10531069B2 patent drawing

AI summary

A single image sensor including an array of uniformly and continuously spaced light-sensing pixels in conjunction with a plurality of lenses that focus light reflected from an object onto a plurality of different pixel regions of the image sensor, each lens focusing light on a different one of the pixel regions enables a controller, including a processor and an object detection module, coupled to the single image to analyze the pixel regions, to generate a three-dimensional (3D) image of the object through a plurality of images obtained with the image sensor, generate a depth map that calculates depth values for pixels of at least the object, detect 3D motion of the object using the depth values, create a 3D model of the object based on the 3D image, and track 3D motion of the object based on the 3D model.