AR Robot Coordinate Recognition With Simultaneous Marker Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for recognizing a robot coordinate system using augmented reality devices are burdensome, requiring advance determination of marker positions, recording of robot models, and manual alignment, and are prone to display displacement issues, especially during rotational movements.

Innovation Solution

A robot system with reference indicators having clear coordinates and a robot coordinate system identification indicator allows simultaneous detection by an AR device, enabling easy and precise recognition of the robot's position or orientation, and suppressing AR graphic display displacement by placing indicators within the AR device's movement range.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If marker detection method is used for robot coordinate system recognition, then robot position can be identified, but marker position determination becomes burdensome and time-consuming

Engineering Contradiction:
Improverobot position recognition accuracyVSAvoidmarker position determination time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-defining the coordinate system origin and axis directions at the robot base in advance. This eliminates the need for time-consuming marker position determination during actual operation, as the coordinate system is already established and can be directly used for robot position recognition.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses image recognition to create a digital copy of the robot's physical position and orientation. By capturing images and recognizing the robot's coordinates through image processing, the system obtains accurate position information without physical markers, reducing time consumption while maintaining precision.

Inventive Principle:
Principle #26Copying

2Measurement precision

If manual alignment method is used for AR graphic positioning, then coordinate system can be established, but the process becomes extremely burdensome and time-consuming

Engineering Contradiction:
Improvecoordinate system alignment accuracyVSAvoidalignment time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces the manual mechanical alignment process with automated image recognition and coordinate calculation. Instead of manually aligning AR graphics with the robot's coordinate system, the system uses image processing to automatically determine the robot's position and orientation, then overlays the coordinate system information, dramatically reducing alignment time while maintaining or improving accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If AR device moves away from marker after recognition, then operational flexibility increases, but display position displacement occurs

Engineering Contradiction:
ImproveAR device movement flexibilityVSAvoiddisplay position accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent implements continuous feedback by repeatedly capturing images and recalculating the robot's coordinates based on its current position. As the AR device moves, the system continuously updates the coordinate information and re-aligns the AR graphics accordingly, ensuring that display position accuracy is maintained even when the device moves away from the initial recognition position.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11400602B2Robot system
Publication Date: 2022.08.02 FANUC LTD
  • US11400602B2 patent drawing
  • US11400602B2 patent drawing
  • US11400602B2 patent drawing

AI summary

The present invention provides a robot system capable of, regardless of the type of the robot, precisely measuring the positional relationship between an AR device and markers, and comparatively easily and with high precision recognizing the position or orientation of the robot with the AR device. The robot system includes a marker detecting unit that simultaneously detects a reference marker and a robot coordinate system identification marker in one detection operation; a robot system information receiving unit that receives information regarding the robot system; a robot coordinate system identifying unit that identifies a coordinate system of a robot from the position of the robot coordinate system identification indicator and coordinate system information; an AR device that displays the information regarding the robot system, based on the coordinate system of the robot; a coordinate system setting unit that sets an origin by moving the robot to a designated position; and a coordinate system information transmission unit that transmits the coordinate system information set by the coordinate system setting unit to the AR device.