Virtual Vision Compensation Training With HMD Coordinate Verification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for practical training in vision compensation for robots require costly equipment and make it difficult for operators to intuitively check if the coordinate system is properly set, leading to potential interference and inefficiencies.

Innovation Solution

An off-line simulation system using a head-mountable display and teaching apparatus that generates a virtual space for training, allowing operators to practice vision compensation by placing a robot and workpiece in a virtual environment, simulating camera placement, and performing vision compensation based on captured images, with a compensation checking unit to verify proper settings.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If practical training for vision compensation is conducted using actual robot equipment, then the training effectiveness is improved, but the equipment cost increases

Engineering Contradiction:
Improvetraining effectivenessVSAvoidequipment cost
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent creates a virtual copy of the robot system including the robot arm, vision sensor, workpiece, and coordinate systems in a virtual space. This virtual replica allows operators to practice vision compensation settings without using actual physical equipment, thereby reducing costs while maintaining training effectiveness through realistic simulation of the compensation process

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system performs preliminary vision compensation training in the virtual space before actual robot operation. Operators can configure and test coordinate systems and compensation parameters in advance in the virtual environment, ensuring proper settings are established before transitioning to real equipment, thus avoiding costly trial-and-error with actual hardware

Inventive Principle:
Principle #10Preliminary action

2Productivity

If vision compensation settings are configured without visual verification, then the operation speed is improved, but the setting accuracy deteriorates

Engineering Contradiction:
Improveoperation speedVSAvoidsetting accuracy
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The system provides real-time visual feedback by displaying the virtual camera's field of view and the detected workpiece position overlaid with coordinate system information. Operators can immediately see whether coordinate systems are properly configured and whether vision compensation is working correctly, allowing for rapid verification and adjustment without sacrificing accuracy

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent uses visual indicators including color-coded coordinate system overlays and highlighted detection results to provide intuitive feedback on setting correctness. Different colors indicate different coordinate systems and their proper alignment, enabling operators to quickly assess configuration accuracy through visual cues rather than numerical data alone

Inventive Principle:
Principle #32Color changes

Data Source

PatentUS12090669B2Off-line simulation system
Publication Date: 2024.09.17 FANUC LTD
  • US12090669B2 patent drawing
  • US12090669B2 patent drawing
  • US12090669B2 patent drawing

AI summary

Provided is an off-line simulation system that enables performance of efficient vision correction training. This vision correction training system for vision correction training is provided with a head mount display capable of displaying an image in a virtual space, and a teaching device communicably connected to the head mount display. The teaching device has: a vision correction unit that, on the basis of a captured image captured by a camera after the position of a workpiece has been moved, performs vision correction on a predetermined movement; and a correction confirmation unit that confirms that the vision correction is appropriately performed on the predetermined movement.