3D Height-Based Object Detection Using Projected Light Patterns

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image processing systems face challenges in accurately detecting the area of a target object within a three-dimensional image, especially when the object's color is similar to the background, leading to difficulties in precise area detection.

Innovation Solution

The system employs a projector to project stripe or grid patterns onto the target object, and an imager to capture images, calculating height information and using it to detect the target object area based on pixel data, thereby distinguishing the object from the background.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If color-based detection methods are used to identify the target object, then the detection process is simple, but the detection precision deteriorates when the object's color is similar to the background

Engineering Contradiction:
Improvedetection process simplicityVSAvoidtarget object area detection precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent transitions from two-dimensional color-based detection to three-dimensional height-based detection by projecting light patterns and measuring depth information. This dimensional change allows the system to distinguish objects from backgrounds even when their colors are similar, as height information provides an additional discrimination criterion independent of color

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces light projection patterns as an intermediary element between the imaging system and the target object. By projecting known patterns and analyzing their distortion upon contact with the object, the system obtains height information that serves as a mediator to identify object boundaries regardless of color similarity

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If three-dimensional imaging is implemented to improve object detection accuracy, then the detection precision improves, but the device complexity increases

Engineering Contradiction:
Improvetarget object area detection precisionVSAvoidimaging system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent makes the imaging device multi-functional by enabling it to perform both standard color imaging and three-dimensional height measurement using the same hardware platform. The imaging device can switch between capturing color images and capturing light pattern distortion images, eliminating the need for separate dedicated 3D sensing equipment

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent uses computational methods to generate height information by analyzing the distortion of projected light patterns in captured images. Instead of using complex dedicated 3D sensing hardware, the system creates a computational model that simulates height measurement by processing standard image data through algorithms that calculate depth from pattern deformation

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables accurate and efficient detection of the target object area, even when the object's color is similar to the background, by utilizing height information from projected patterns, improving detection precision and reliability.

Implementation Method 1

a projector for projecting a projection image having a stripe pattern or a grid pattern toward a target object

Methodology Applied
Scientific EffectLight projection and interference: Interference

Implementation Method 2

an imager for imaging a target object on which the projection image is projected

Methodology Applied
Scientific EffectOptical imaging and distortion detection: Photography

Data Source

PatentUS10247546B2Image processing system and method for detecting a target object area based on height information
Publication Date: 2019.04.02 PFU LTD
  • US10247546B2 patent drawing
  • US10247546B2 patent drawing
  • US10247546B2 patent drawing

AI summary

An image processing system, an imager, an area detection method, and a computer program easily and highly accurately detecting an area where a target object exists in an image acquired by imaging the target object are provided. The image processing system includes a projector for projecting a projection image having a stripe pattern or a grid pattern toward a target object, and an imager for imaging a target object on which the projection image is projected, and the imager includes an input image obtaining module for obtaining an input image acquired by imaging a target object on which the projection image is projected, a height information calculator for calculating height information of each pixel in the input image by using the input image, and a target object area detector for detecting a target object area where the target object exists in the input image, based on the height information of each pixel in the input image.