Imaging Device Aligning 3D Data with 2D Images on Moving Conveyor

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing imaging systems face challenges in simultaneously acquiring three-dimensional information and two-dimensional images of a moving workpiece, particularly when using stereo cameras, which complicates the detection of feature portions and reduces work efficiency due to the need to stop the conveyor machine.

Innovation Solution

An imaging device that includes a three-dimensional sensor and a two-dimensional sensor, along with a processing unit that generates three-dimensional information and acquires two-dimensional images. The processing unit also includes a movement control unit that adjusts the relative position of the three-dimensional information within a predetermined coordinate system to align with the two-dimensional image, allowing for synchronized acquisition even when the workpiece is moving.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If imaging is performed simultaneously to acquire three-dimensional information and two-dimensional images, then the workpiece position consistency is improved, but the reference pattern from the projector appears on the two-dimensional image making feature portion detection difficult

Engineering Contradiction:
Improveworkpiece position consistencyVSAvoidfeature portion detection
Core Design Contradiction:
Measurement precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The patent separates the two-dimensional sensor into two functional components: one that captures the reference pattern for three-dimensional measurement, and another that captures the workpiece image for feature detection. This extraction allows the reference pattern to be removed from the workpiece image, solving the contradiction between maintaining position consistency and enabling feature portion detection.

Inventive Principle:
Principle #2Taking out (Extraction)

2Measurement precision

If the carrier machine is stopped to acquire three-dimensional information and two-dimensional images, then the workpiece position consistency is improved, but the work efficiency is reduced

Engineering Contradiction:
Improveworkpiece position consistencyVSAvoidwork efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent enables dynamic imaging by allowing the carrier machine to continue moving while images are being captured. The system uses the position information from the three-dimensional sensor to dynamically adjust and align the two-dimensional image with the workpiece, eliminating the need to stop the carrier machine and thereby maintaining high work efficiency.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If the carrier machine is started or stopped, then the position of the workpiece on the carrier machine may shift, but continuous operation is required to maintain productivity

Engineering Contradiction:
Improveworkpiece position accuracyVSAvoidcontinuous operation
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent employs feedback control by using the position information obtained from the three-dimensional sensor to adjust and realign the two-dimensional image with the workpiece. This feedback mechanism ensures that even when the carrier machine is in motion, the images remain accurately aligned without requiring stops or causing position shifts, thus maintaining both precision and continuous productivity.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12219121B2Imaging device for acquiring three-dimensional information of workpiece surface and two-dimensional image of workpiece
Publication Date: 2025.02.04 FANUC LTD
  • US12219121B2 patent drawing
  • US12219121B2 patent drawing
  • US12219121B2 patent drawing

AI summary

Provided is an imaging device for acquiring three-dimensional information of a workpiece surface and a two-dimensional image. An imaging device comprises a visual sensor for acquiring a two-dimensional image after acquiring three-dimensional information of a workpiece surface. A position detection device is attached to the conveyor drive motor of a conveyor that conveys a workpiece. An image processing part calculates the amount of movement of the workpiece from when the three-dimensional information is acquired to when the two-dimensional image is captured on the basis of an output of the position detection device. The image processing part moves the three-dimensional information relative to the two-dimensional image in such a manner as to correspond to the amount of movement of the workpiece in a predetermined coordinate system.