AR Robot Tracking Setup for Position Verification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current robot systems face challenges in accurately and efficiently confirming whether setting information for positions of robots, photographing devices, and treating objects is correctly set, leading to potential collisions and increased workload, especially when treating objects are moved by conveyors.

Innovation Solution

The implementation of an Augmented Reality (AR) space to visualize setting information, where a robot control device calculates and displays the positions of the robot, photographing device, and treating object within the AR space, allowing operators to easily verify the accuracy of setting information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If position compensation is performed based on photographed images with previously set position information, then the robot can track the treating object, but it becomes difficult to confirm whether the setting information is appropriate, leading to potential collisions and increased operator workload

Engineering Contradiction:
Improvetracking accuracyVSAvoidconfirmation difficulty
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent creates a virtual CG model that copies the physical robot's appearance and behavior. This virtual model is displayed on a touch screen to represent the robot's position and movement. Operators can visually confirm the robot's tracked position through this copy, making it easy to verify whether position setting information is appropriate without directly observing the physical robot, thus resolving the contradiction between reliable tracking and ease of confirmation

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces a touch screen display as an intermediary between the physical robot and the operator. The display shows the CG image of the robot and the photographed image of the treating object together, serving as a mediator that enables operators to easily confirm position accuracy. This intermediary solves the problem of difficult confirmation while maintaining reliable tracking through the underlying position compensation system

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If the robot moves quickly to track the treating object on a conveyor, then productivity increases, but the risk of collision with operators or peripheral devices increases

Engineering Contradiction:
Improvetracking speedVSAvoidcollision risk
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The patent implements a feedback mechanism where the touch screen display continuously shows the CG robot image tracking the treating object in real-time. Operators can monitor the robot's movement and position relative to the treating object and surrounding environment. This visual feedback enables operators to quickly detect potential collision risks and issue stop commands, allowing the robot to operate at higher speeds while maintaining safety through continuous monitoring and rapid operator response

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11565427B2Robot system
Publication Date: 2023.01.31 FANUC LTD
  • US11565427B2 patent drawing
  • US11565427B2 patent drawing
  • US11565427B2 patent drawing

AI summary

A robot system includes a robot for performing predetermined processing to a treating object, a photographing device for photographing the treating object, a robot control device for performing position compensation of a moving destination of the robot so as to track the treating object, on a basis of previously-set information on positions of the robot, the photographing device and the treating object, and an image of the treating object photographed by the photographing device, and a display device for providing an AR space. The robot control device calculates a position of the photographing device on the basis of the information on the positions of the robot and the photographing device. The display device displays an image imitating the photographing device at a corresponding position in the AR space, on a basis of the calculated position of the photographing device.