3D Image Capture Condition Control for Selective Depth Regions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D image-capturing devices for object picking by robots face challenges in accurately distinguishing between areas where distance information is not required and those where it is necessary, leading to inefficient object recognition and separation, especially when objects are closely positioned.

Innovation Solution

A 3D image-capturing device with a processor that adjusts image-capturing conditions by specifying a first area for minimal distance information acquisition and a second area for maximum acquisition, using parameters like exposure time, light intensity, and pattern matching scores, to ensure the amount of distance information meets predefined thresholds, allowing for precise object recognition and separation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If distance information is acquired uniformly across the entire image area, then complete object information is obtained, but processing time and computational load increase unnecessarily in areas where distance information is not needed

Engineering Contradiction:
Improveobject picking efficiencyVSAvoiddistance information processing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The image area is divided into a first area where distance information is not required and a second area where distance information is required. The processor selectively acquires distance information only in the second area, avoiding unnecessary processing in the first area. This segmentation resolves the contradiction by reducing processing time while maintaining complete object information where needed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different quality requirements are applied to different regions of the image. The first area uses a first threshold for distance information amount, while the second area uses a second threshold that is higher than the first. This local quality approach optimizes processing efficiency in non-critical areas while ensuring sufficient detail in critical areas for object recognition.

Inventive Principle:
Principle #3Local quality

2Productivity

If distance information acquisition is reduced in the first area to save processing time, then processing efficiency improves, but object recognition accuracy may deteriorate if the reduction is excessive

Engineering Contradiction:
Improveimage processing speedVSAvoidobject recognition accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The processor changes the parameter of distance information amount based on the spatial location within the image. A first threshold is set for the first area and a second threshold (higher than the first) is set for the second area. This parameter change ensures that processing speed is optimized in the first area while recognition accuracy is maintained in the second area where objects are more likely to be located.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system applies partial action by acquiring distance information to a lesser extent in the first area compared to the second area. This partial acquisition is sufficient for the first area's needs while the excessive (higher amount) acquisition in the second area ensures accurate object recognition, resolving the contradiction between speed and accuracy.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If the camera captures high-resolution distance information across the entire field of view, then object detail recognition is improved, but the data processing load and time consumption increase

Engineering Contradiction:
Improveobject distance measurement precisionVSAvoiddata processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The field of view is segmented into a first area and a second area with different distance information acquisition strategies. In the first area, distance information is acquired with a first threshold amount, while in the second area, distance information is acquired with a higher second threshold amount. This segmentation reduces overall data processing time while maintaining high measurement precision in the second area where objects are more likely to be positioned.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11943422B2Three-dimensional image-capturing device and image-capturing condition adjusting method
Publication Date: 2024.03.26 FANUC LTD
  • US11943422B2 patent drawing
  • US11943422B2 patent drawing
  • US11943422B2 patent drawing

AI summary

A 3D image-capturing device that includes at least one camera that acquires a 2D image and distance information of an object, a monitor that displays the 2D image acquired by the camera, and at least one processor including hardware. The processor acquires a first area for which the distance information is not required in the 2D image displayed on the monitor, and sets an image-capturing condition so that the amount of distance information acquired by the camera in the acquired first area is less than or equal to a prescribed first threshold and the amount of distance information acquired by the camera in a second area, which is at least part of an area other than the first area, is greater than a prescribed second threshold that is larger than the first threshold.