Multispectral Binary Coded Projection for Real-Time 3D Scanning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

High-speed 3D scanning of dynamic scenes is challenging due to the need for multiple binary coded patterns, which can be cumbersome and require elaborate setup with high-number-of-channels projectors, making real-time capture and fast object detection difficult.

Innovation Solution

Using multiple low-number-of-channels projectors positioned at different angular positions to project color striped patterns with varying resolutions, which combine to form a combined color pattern for depth map calculation, allowing for efficient depth measurement and material property estimation without the need for a single high-number-of-channels projector.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a single multichannel projector with high number of channels is used for multispectral binary coded projection, then depth measurement robustness and one-shot capture capability are improved, but device complexity and setup difficulty increase

Engineering Contradiction:
Improvedepth measurement robustnessVSAvoidprojector setup complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent divides the functionality of a single high-channel projector into multiple low-channel projectors. Each projector handles a subset of spectral channels, and their projections are combined to achieve the same multispectral binary coded projection效果. This segmentation reduces the complexity of individual projectors while maintaining the overall system capability for robust depth measurement.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If multiple binary coded patterns are projected to achieve high depth resolution, then measurement precision is improved, but scanning speed and productivity deteriorate

Engineering Contradiction:
Improvedepth resolutionVSAvoidscanning speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent combines multiple binary coded patterns into a single composite pattern that can be projected in one shot. By encoding multiple bits of depth information across different spectral channels simultaneously, the system achieves high depth resolution (e.g., 10-bit) without requiring sequential projection of multiple patterns, thus enabling real-time capture of dynamic scenes.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent uses periodic color striped patterns with different spatial frequencies projected simultaneously across multiple spectral channels. These periodic patterns encode depth information through their frequency and phase characteristics, allowing the system to recover high-resolution depth maps from a single captured image by analyzing the periodic variations across channels.

Inventive Principle:
Principle #19Periodic action

3Ease of operation

If multiple projectors with different resolutions are used, then ease of operation and device availability are improved, but system complexity increases

Engineering Contradiction:
Improveprojector availabilityVSAvoidmulti-projector system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent assigns different spatial resolutions to different projectors based on their spectral channels and angular positions. Each projector is optimized for its specific role in the multispectral encoding scheme, with resolution requirements tailored to the information it contributes. This local optimization simplifies the selection and configuration of individual projectors while achieving high overall system performance.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10012496B2Multispectral binary coded projection using multiple projectors
Publication Date: 2018.07.03 CANON KK
  • US10012496B2 patent drawing
  • US10012496B2 patent drawing
  • US10012496B2 patent drawing

AI summary

A method of measuring a depth map for an object or a material property of an object involves positioning multiple projectors at respectively multiple angular positions relative to an object. Each of the projectors comprises color channels whose colors differ from that of other projectors. An image capture device is positioned relative to the multiple projectors. A combined color pattern is projected onto the object using the multiple projectors. Each projector projects a color striped pattern whose resolution differs from that of others of the projectors and the resolution of the color striped pattern is related to the angular position of the projector. An image of the object is captured with the combined color pattern using the image capture device and a depth map or a material property of the object is recovered by calculations using the captured image.