Robot Grasping Vision with Candidate Area Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing for recognizing workpieces in a production line is time-consuming, hindering productivity in manufacturing processes.

Innovation Solution

A robot system with an image processing apparatus and control portion that uses deep learning-based object detection and pattern matching to quickly identify and grasp workpieces, employing multiple cameras and a robot arm to optimize the image processing and grasping sequence.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional image processing methods are used to recognize workpieces, then the workpieces can be identified, but the processing time is excessive and hinders productivity

Engineering Contradiction:
Improveworkpiece identification accuracyVSAvoidimage processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the image processing task into distinct stages: candidate workpiece area extraction followed by pattern matching. By dividing the processing into separate steps with different purposes, the system efficiently handles large images without excessive computation time, resolving the contradiction between accurate identification and processing speed

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts only the candidate workpiece areas from the entire image before performing pattern matching. This extraction step removes unnecessary image data, reducing the computational burden while maintaining identification accuracy, thus solving the time consumption problem

Inventive Principle:
Principle #2Taking out (Extraction)

2Productivity

If the image processing time is reduced to enhance productivity, then manufacturing efficiency improves, but the accuracy of workpiece identification may be compromised

Engineering Contradiction:
Improvemanufacturing efficiencyVSAvoidworkpiece identification accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

By segmenting the processing into area extraction and pattern matching stages, the system achieves fast preprocessing with accurate final identification. This segmented approach enables high productivity while maintaining measurement precision through the dedicated pattern matching step

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary extraction of candidate workpiece areas before pattern matching. This preliminary action reduces the data volume for subsequent processing, enabling faster manufacturing cycles without compromising identification accuracy

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12400285B2Robot system, control method, image processing apparatus, image processing method, method of manufacturing products, and recording medium
Publication Date: 2025.08.26 CANON KK
  • US12400285B2 patent drawing
  • US12400285B2 patent drawing
  • US12400285B2 patent drawing

AI summary

A robot system includes a robot, an image capture apparatus, an image processing portion, and a control portion. The image processing portion is configured to specify in an image of a plurality of objects captured by the image capture apparatus, at least one area in which a predetermined object having a predetermined posture exists, and obtain information on position and/or posture of the predetermined object in the area. The control portion is configured to control the robot, based on the information on position and/or posture of the predetermined object, for the robot to hold the predetermined object.