Camera-Based Object Localization for Automated Coordinate Measuring

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional coordinate measuring machines face challenges in accurately and efficiently determining the position and orientation of complex objects, leading to cumbersome probe head movements and potential damage, especially in fully automated systems, due to the need for massive calculation power and complex algorithms.

Innovation Solution

The implementation of a method using a camera to capture images of objects with reference information, such as barcodes or QR codes, to quickly and accurately determine the position and orientation of objects, allowing for precise control of the drive mechanism to approach measurement points, thereby reducing computational requirements and risk of damage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If photogrammetric methods with multiple cameras or complex algorithms are used to determine object position and orientation, then measurement accuracy is improved, but calculation power requirements and device complexity increase significantly

Engineering Contradiction:
Improveobject position and orientation determination accuracyVSAvoidcamera system and algorithm complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

A reference object with known geometry and distinctive features is introduced as an intermediary between the camera system and the target object. The reference object serves as a mediator that simplifies the calculation of camera position and orientation by providing easily identifiable reference points, thereby reducing computational complexity while maintaining measurement accuracy

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

Instead of directly analyzing the complex target object, a simplified copy or representation is used through the reference object. The reference object creates a simplified geometric model that captures the essential information needed for camera localization without requiring complex algorithms to process the entire target object geometry

Inventive Principle:
Principle #26Copying

2Productivity

If the probe head moves quickly to measurement points, then productivity is improved, but the risk of damage to the probe head or workpiece increases due to impact

Engineering Contradiction:
Improvemeasurement speedVSAvoidrisk of probe head or workpiece damage
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The camera system performs preliminary localization of the target object and determines its precise position and orientation before the probe head begins measurement. This advance information allows the probe head to approach measurement points along optimized paths at higher speeds without risk of collision, as the system already knows where the object is located and how it is oriented

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The camera system provides continuous feedback about the object's position and orientation to the control system, which adjusts the probe head's movement in real-time. This feedback loop enables high-speed movement while maintaining safety margins, as the system can dynamically respond to any deviations in object position or unexpected obstacles

Inventive Principle:
Principle #23Feedback

3Loss of time

If conventional measurement methods are used without reference information, then device simplicity is maintained, but the speed and accuracy of determining object coordinates deteriorate

Engineering Contradiction:
Improvetime to determine object coordinatesVSAvoidaddition of camera and reference information system
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

Reference information is applied to the target object in advance of the measurement process. This preliminary marking or tagging of the object with identifiable features allows the camera system to quickly locate and analyze the object without requiring complex real-time processing, thereby reducing measurement time while keeping the added system complexity manageable

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables faster, more accurate, and reliable determination of object coordinates, reducing the risk of probe head or workpiece damage, while requiring less computational power and storage capacity, and allowing for precise localization in six degrees of freedom for enhanced measurement accuracy.

Implementation Method 1

capturing at least one image of the object by means of at least one camera of the automated machine

Methodology Applied
Scientific EffectPhotography: Photography

Data Source

PatentUS10234260B2Method to control a drive mechanism of an automated machine having a camera
Publication Date: 2019.03.19 HEXAGON INNOVATION HUB GMBH
  • US10234260B2 patent drawing
  • US10234260B2 patent drawing
  • US10234260B2 patent drawing

AI summary

The invention relates to a method to control a drive mechanism of an automated machine for approaching a point of interest on an object, the object having a surface on which a reference information of the object is provided as a one- or two-dimensional pattern, the method comprising capturing at least one image of the object by means of at least one camera of the automated machine, identifying the reference information in the at least one image, determining a position and orientation of the reference information relative to the at least one camera, determining a position and orientation of the object based on the determined position and orientation of the reference information, and controlling the drive mechanism based on the determined position and orientation of the object.