2D Image Processing for Randomly Stacked Workpiece Position Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The high cost of introducing multiple three-dimensional measurement machines in factories makes it economically challenging to recognize the position and orientation of objects, prompting the need for an alternative method using two-dimensional image processing.

Innovation Solution

An image processing device with an acquiring section and an estimation section that captures images of randomly stacked workpieces, generates a matching map of features, estimates the position, orientation, and classification score, and calculates the object's position using a neural network model trained on three-dimensional data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If three-dimensional measurement machines are used to recognize the position and orientation of workpieces, then measurement precision is improved, but device cost increases significantly

Engineering Contradiction:
Improveposition and orientation recognition accuracyVSAvoidcost of introducing measurement machines
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent uses two-dimensional images captured by cameras as copies or representations of the three-dimensional workpiece arrangement. Instead of directly measuring workpieces with expensive three-dimensional measurement machines, the system captures images and processes them to extract position and orientation information, effectively using a lower-cost proxy (2D image) to achieve the same measurement function.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical three-dimensional measurement system with an optical system (camera) combined with image processing algorithms. The mechanical measurement process is substituted by capturing light reflected from workpieces and computationally deriving spatial information through feature extraction and matching algorithms.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If multiple three-dimensional measurement machines are introduced in factories, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improveworkpiece position and orientation detectionVSAvoidnumber of measurement machines required
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent makes the camera system universal by enabling it to perform multiple functions: capturing images for position detection, extracting feature information, and processing spatial data. A single camera system can handle various workpiece configurations and measurement tasks, eliminating the need for multiple specialized three-dimensional measurement machines.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent segments the measurement process into distinct computational steps: capturing images, extracting features from images, matching features between images, and calculating position and orientation. This segmentation allows the system to handle complex measurement tasks through a series of simpler processing stages rather than requiring complex hardware systems.

Inventive Principle:
Principle #1Segmentation

3Ease of manufacture

If two-dimensional image processing is used instead of three-dimensional measurement machines, then device cost is reduced, but measurement precision may deteriorate

Engineering Contradiction:
Improvecost of image processing systemVSAvoidposition estimation accuracy
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent transitions from two-dimensional image data to three-dimensional spatial information through computational processing. By capturing images from multiple perspectives and processing feature correspondences between images, the system reconstructs three-dimensional position and orientation data, effectively adding the depth dimension through algorithmic processing rather than physical three-dimensional sensors.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS12131457B2Image processing device and image processing method
Publication Date: 2024.10.29 MINEBEAMITSUMI INC
  • US12131457B2 patent drawing
  • US12131457B2 patent drawing
  • US12131457B2 patent drawing

AI summary

An image processing device (10) according to an aspect of the present invention includes an acquiring section (151) and an estimation section (152). The acquiring section (151) acquires a first image and a second image obtained by capturing randomly stacked workpieces (W1a, W1b). The estimation section (152) generates a matching map of a feature of the first image and a feature of the second image, estimates a position, an orientation and a classification score of each workpiece as a target for each of the first image and the second image, and estimates the position of the workpiece, based on a matching result using the matching map and an estimation result of the position.