Camera Array Segmentation for Depth Map Resolution

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional distance measurement methods using camera arrays face issues such as decreased resolution in range images when objects are nearby, low light conditions due to reduced lens diameter for increased depth of field, and inability to measure distances to both main objects and backgrounds simultaneously.

Innovation Solution

A camera array image capturing device with multiple image capturing units, each set to different focus positions, captures images where at least some in-focus distance ranges overlap, allowing for accurate distance measurement of both main objects and backgrounds from a single image acquisition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the lens diameter is reduced to increase the depth of field, then the depth of field is improved, but the amount of incident light to the lens decreases and noise in the captured image increases

Engineering Contradiction:
Improvedepth of fieldVSAvoidamount of incident light
Core Design Contradiction:
ReliabilityVSIllumination intensity

Solution Approach 1:

The patent divides the image capturing system into multiple image capturing units (first and second groups), each with different focus positions and lens diameters. This segmentation allows different units to serve different depth ranges, with closer units having smaller lenses for shallow depth and farther units having larger lenses for deep depth, resolving the contradiction between depth of field and light intake.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different image capturing units are assigned different optical characteristics tailored to their specific focus ranges. The first image capturing units have smaller lens diameters optimized for nearby objects, while the second image capturing units have larger lens diameters optimized for distant objects, allowing each local region to have optimal quality for its depth range.

Inventive Principle:
Principle #3Local quality

2Device complexity

If a single image capturing unit is used to capture images from different viewpoints, then the device complexity is reduced, but the resolution of the distance map decreases in image areas different from the focus position

Engineering Contradiction:
Improvenumber of image capturing unitsVSAvoidresolution of distance map
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent segments the image capturing units into two groups with different focus positions. The first group focuses on nearby objects while the second group focuses on distant objects. This segmentation ensures that each group provides high-resolution distance maps for their respective focus ranges, overcoming the limitation of single-unit systems that must compromise resolution across all depths.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent adds a new dimension of organization by grouping image capturing units according to their focus positions rather than using a single unified system. This dimensional reorganization allows the system to maintain high measurement precision across different depth ranges simultaneously by leveraging the specialized focus characteristics of each group.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If the focus position is adjusted to capture a substantially focused image of a distant object, then the image quality is improved, but the image becomes out of focus when the object is located at a nearby place

Engineering Contradiction:
Improveimage qualityVSAvoidfocus range coverage
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent divides the image capturing units into two distinct groups with different focus positions - the first group for nearby objects and the second group for distant objects. This segmentation enables the system to adapt to different object distances by selecting the appropriate group, maintaining image quality across varying focus ranges rather than compromising for a single fixed focus position.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically selects which image capturing unit group to use based on the object distance. When nearby objects are detected, the first group is activated; when distant objects are detected, the second group is activated. This dynamic adaptation allows the system to maintain optimal image quality across different depth ranges, overcoming the static focus limitation of single-unit systems.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9076214B2Image acquisition apparatus and image processing apparatus using selected in-focus image data
Publication Date: 2015.07.07 CANON KK
  • US9076214B2 patent drawing
  • US9076214B2 patent drawing
  • US9076214B2 patent drawing

AI summary

An image acquisition apparatus according to the present invention includes a first image capturing unit group including a plurality of image capturing units in which at least part of in-focus distance ranges overlap each other and a second image capturing unit group including a plurality of image capturing units in which at least part of in-focus distance ranges overlap each other. The second image capturing unit group is different from the first image capturing unit group. A first object distance to an object is obtained from image data acquired by the first image capturing unit group and a second object distance different from the first object distance is obtained from image data acquired by the second image capturing unit group.