Robot Camera Posture Calibration Without Optical Markers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for determining the image pickup posture of a robot-mounted camera require repetitive visual observation and adjustment, making the process cumbersome, and the determination of correction parameters for converting image coordinates to robot coordinates is complex, often necessitating the use of optical markers.

Innovation Solution

An image processing apparatus that uses teaching point information to specify the working area and image pickup area, allowing for automatic determination of the image pickup posture and correction parameters, thereby simplifying the process and eliminating the need for optical markers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If repetitive visual observation and adjustment is performed to determine image pickup posture, then the camera can pick up the working area appropriately, but the operation becomes troublesome and time-consuming

Engineering Contradiction:
Improveimage pickup posture accuracyVSAvoidoperation simplicity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system performs self-calibration by automatically determining the image pickup posture and correction parameters using teaching point information and image processing, eliminating the need for manual visual observation and adjustment by the user

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

Teaching points are registered in advance during robot operation, and the image pickup posture is determined based on these pre-registered points, allowing automatic calibration without requiring manual adjustment during the actual image pickup process

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If calibration using optical marker is used to determine correction parameter, then the position and posture conversion can be achieved, but the correction becomes complicated requiring marker installation and calibration work

Engineering Contradiction:
Improvecoordinate conversion accuracyVSAvoidcalibration process complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The optical marker is extracted from the calibration process entirely. Instead of using physical markers, the system uses teaching point information (coordinates and postures) already registered during robot operation to determine correction parameters through image processing of the working area

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The teaching point information, originally used for robot position control, is also utilized for determining image pickup posture and correction parameters, making the existing robot operation data serve multiple functions and eliminating the need for separate calibration procedures

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11478936B2Image processing apparatus that processes image picked up by image pickup apparatus attached to robot, control method therefor, and storage medium storing control program therefor
Publication Date: 2022.10.25 CANON KK
  • US11478936B2 patent drawing
  • US11478936B2 patent drawing
  • US11478936B2 patent drawing

AI summary

An image processing apparatus capable of simplifying operations for determining an image pickup posture of an image pickup apparatus attached to a robot. The image processing apparatus processes an image that an image pickup apparatus attached to a robot picks up. The image processing apparatus includes a memory device that stores a set of instructions, and at least one processor that executes the set of instructions to specify a working area of the robot based on teaching point information showing a plurality of designated teaching points, specify an image pickup area of the image pickup apparatus so as to include the specified working area; and determine an image pickup posture of the robot based on the specified image pickup area.