3D Motion Sensor Using Overlapping Exposure Patterns

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing three-dimensional motion estimation techniques face challenges in accurately obtaining both distance and motion information about a subject using a single image sensor, as optical flow constraint equations are undetermined without additional constraints and suffer from decreased accuracy when combined with floodlight-type distance information methods, and additional wiring in time-correlation image sensors reduces aperture and sensitivity.

Innovation Solution

A three-dimensional motion obtaining apparatus and method that employs a light source, a charge amount obtaining circuit with pixels, and a processor to estimate distance and optical flow using overlapping exposure patterns and light emission patterns, allowing for high-accuracy distance and motion information acquisition with a single image sensor.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If distance information and motion information are obtained using separate sensors, then measurement reliability is improved, but device complexity increases

Engineering Contradiction:
Improvemeasurement reliabilityVSAvoiddevice complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent combines distance measurement and motion detection functions into a single image sensor by implementing multiple exposure patterns (first exposure pattern for distance, second exposure pattern for motion) within the same sensor array. This merging eliminates the need for separate sensors while maintaining measurement reliability through synchronized data acquisition from a unified detection platform.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The image sensor is designed to perform multiple functions simultaneously: it captures distance information through first exposure patterns and motion information through second exposure patterns. This multi-functional design allows a single sensor system to replace what would traditionally require separate specialized sensors, reducing overall system complexity while maintaining measurement accuracy.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If distance and motion data are integrated from different sensors, then measurement precision is improved, but temporal synchronization becomes difficult

Engineering Contradiction:
Improvemeasurement precisionVSAvoidtemporal synchronization
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent implements preliminary action by capturing both distance and motion information simultaneously through overlapping exposure patterns before any temporal misalignment can occur. The first exposure pattern and second exposure pattern are executed in a coordinated manner within the same time window, ensuring that both measurements reference the same temporal moment and eliminating synchronization delays.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The overlapping exposure patterns enable continuous acquisition of both distance and motion data without interruption or sequential delay. By maintaining continuous operation of both measurement functions simultaneously through the same sensor, the system eliminates temporal gaps and ensures uninterrupted synchronized data streams for both parameters.

Inventive Principle:
Principle #20Continuity of useful action

3Device complexity

If one image sensor is used for both distance and motion information, then device complexity is reduced, but measurement precision deteriorates

Engineering Contradiction:
Improvedevice complexityVSAvoidmeasurement precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent segments the measurement process into distinct exposure patterns within the single sensor: the first exposure pattern is optimized for distance measurement while the second exposure pattern is optimized for motion detection. This segmentation allows each measurement function to operate with its own optimized parameters and processing pipeline, maintaining high measurement precision despite using a single sensor hardware platform.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically switches between different exposure patterns (first for distance, second for motion) within the same sensor, allowing optimal measurement conditions to be applied for each function. This dynamic adaptation enables the single sensor to achieve measurement precision comparable to specialized sensors by adjusting its operational mode according to the measurement requirement.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate and simultaneous acquisition of distance and motion information with reduced information processing load, eliminating the need for separate sensors and minimizing errors from temporal mismatches in data integration.

Implementation Method 1

a charge amount obtaining circuit that includes pixels and obtains, for each of the pixels, a first charge amount under a first exposure pattern and a second charge amount under a second exposure pattern

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS10708511B2Three-dimensional motion obtaining apparatus and three-dimensional motion obtaining method
Publication Date: 2020.07.07 PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
  • US10708511B2 patent drawing
  • US10708511B2 patent drawing
  • US10708511B2 patent drawing

AI summary

A three-dimensional motion obtaining apparatus includes: a light source; a charge amount obtaining circuit that includes pixels and obtains, for each of the pixels, a first charge amount under a first exposure pattern and a second charge amount under a second exposure pattern having an exposure period that at least partially overlaps an exposure period of the first exposure pattern; and a processor that controls a light emission pattern for the light source, the first exposure pattern, and the second exposure pattern. The processor estimates a distance to a subject for each of the pixels on the basis of the light emission pattern and on the basis of the first charge amount and the second charge amount of each of the pixels obtained by the charge amount obtaining circuit, and estimates an optical flow for each of the pixels on the basis of the first exposure pattern, the second exposure pattern, and the first charge amount and the second charge amount obtained by the charge amount obtaining circuit.