Range Camera System Using Pixel-Shifted Image Super-Resolution

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current range cameras face limitations in spatial resolution, range accuracy, mechanical complexity, cost, and obstruction issues when capturing 3D range information, particularly in applications requiring high data quality and unobstructed views of entire volumes.

Innovation Solution

The method involves obtaining multiple pixel-shifted images with non-integer pixel shifts, using a sensor array to capture electromagnetic radiation, and applying geometric, radiometric corrections and noise reduction algorithms to determine 3D locations, enabling improved range accuracy and unobstructed views through a range camera system with a novel mount design.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a scanning laser rangefinder design is used, then range accuracy can be achieved, but mechanical complexity increases and scan times become longer

Engineering Contradiction:
Improverange accuracyVSAvoidmechanical complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical scanning system (rotating mirrors and mounts) with a stationary image capture sensor array that electronically records multiple pixels simultaneously. This substitution eliminates mechanical complexity while maintaining range measurement capability through parallel optical measurement across the sensor array.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent divides the single-beam scanning approach into multiple parallel measurement channels by using a sensor array with multiple pixels. Each pixel independently measures range at its location, transforming a sequential scanning process into simultaneous parallel measurements, thereby reducing scan time and mechanical complexity.

Inventive Principle:
Principle #1Segmentation

2Device complexity

If image capture type range camera is used, then mechanical complexity is reduced, but spatial resolution and range accuracy are limited

Engineering Contradiction:
Improvemechanical complexityVSAvoidspatial resolution
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent changes the parameter of pixel dimension size to achieve higher spatial resolution. By using physically smaller pixels with higher illumination sensitivity, the system maintains the simplicity of image capture while improving resolution. The smaller pixels can detect weaker signals, enabling accurate range measurements at higher resolutions without increasing mechanical complexity.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If smaller pixel dimension is used for higher resolution, then spatial resolution improves, but required illumination increases and safety limits are approached

Engineering Contradiction:
Improvespatial resolutionVSAvoidillumination requirement
Core Design Contradiction:
Measurement precisionVSIllumination intensity

Solution Approach 1:

The patent changes the parameter of pixel dimension to balance resolution and illumination requirements. Smaller pixels provide higher resolution while the system compensates for reduced light collection area through improved detector sensitivity and optimized optical design, allowing operation within safety limits while achieving desired resolution.

Inventive Principle:
Principle #35Parameter changes

4Ease of manufacture

If traditional tilt-and-swivel mount is used, then camera mounting is simple, but view obstruction occurs in certain areas

Engineering Contradiction:
Improvemounting simplicityVSAvoidview coverage
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent transitions from a two-dimensional tilt-and-swivel mounting system to a three-dimensional spherical mounting system. The spherical mount allows the camera to rotate freely in all directions (azimuth and elevation), eliminating blind spots and view obstructions that occur with traditional intersecting-axis mounts, while maintaining manufacturing feasibility through standard spherical joint mechanisms.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances spatial resolution and range accuracy, reduces costs, and allows for unobstructed capture of entire volumes, addressing the limitations of existing range cameras by combining pixel-shifted images and advanced processing techniques.

Implementation Method 1

generating electromagnetic radiation that is reflected from target objects in the scene about which range information is desired. The reflected electromagnetic radiation is collected using a sensor array

Methodology Applied
Scientific EffectElectromagnetic radiation reflection: Reflection

Data Source

PatentUS7551771B2Methods, systems, and computer program products for acquiring three-dimensional range information
Publication Date: 2009.06.23 AURORA OPERATIONS INC
  • US7551771B2 patent drawing
  • US7551771B2 patent drawing
  • US7551771B2 patent drawing

AI summary

Methods, systems, and computer program products for acquiring three-dimensional range information are disclosed. According to one aspect, acquiring three-dimensional range information of a scene includes obtaining multiple pixel-shifted images of a scene, where at least one of the images being shifted by a non-integer pixel value with respect to another of the images. Obtaining each of the pixel-shifted images includes generating electromagnetic radiation that is reflected from target objects in the scene about which range information is desired. The reflected electromagnetic radiation is collected using a sensor array of at least two dimensions, where an array of pixels is captured simultaneously. A data value is determined for each captured pixel based on analysis of the collected electromagnetic radiation, by combining the data values from the pixel-shifted images to create a super-resolution image of the scene, and by analyzing the data values of the super-resolution image to determine a three-dimensional location for each pixel of the super-resolution image.