AR Robot Positioning With Virtual Replica Collision Preview

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing robot systems require high operator load and inefficiency when positioning a robot to prevent contact with other objects during workpiece fitting, as they rely solely on an orthogonal coordinate system without adequate visual guidance.

Innovation Solution

A robot system that includes an operating device, a real robot, a transmission type display device for visual recognition, and a control device to operate a virtual robot based on operator instructions, allowing the virtual robot to simulate the real robot's actions and display them on the transmission type display device, thereby reducing operator load and improving efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If an orthogonal coordinate system is displayed to show robot state, then information about robot position is provided, but the information is insufficient for precise positioning and operator load remains high

Engineering Contradiction:
Improvevisual information for positioningVSAvoidoperator load
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent creates a virtual robot that copies the real robot's appearance, actions, and state. This virtual replica is displayed on the transmission type display device to provide comprehensive visual information about robot position and potential contact with objects, replacing the insufficient orthogonal coordinate system and reducing operator cognitive load.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The virtual robot acts as an intermediary between the real robot and the operator. It translates complex robot state data into intuitive visual representations showing position, movement, and potential collisions, enabling better spatial understanding without increasing operator workload.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If the real robot operates directly based on operator instructions, then work efficiency is maintained, but the operator cannot visually grasp the position after operation and positioning becomes difficult

Engineering Contradiction:
Improvework efficiencyVSAvoidpositioning accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system first displays the virtual robot's predicted position and movement trajectory before the real robot executes the operation. This preliminary visualization allows the operator to verify positioning accuracy and make adjustments if needed, ensuring precise positioning before actual work execution.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The virtual robot provides real-time visual feedback about the real robot's position and potential contact with objects. This feedback loop enables the operator to monitor positioning accuracy continuously and make corrective adjustments, improving both positioning precision and work efficiency.

Inventive Principle:
Principle #23Feedback

3Loss of information

If additional visual information is superimposed on the display to indicate robot state, then robot state becomes visible, but the display complexity increases and does not provide sufficient positioning guidance

Engineering Contradiction:
Improverobot state informationVSAvoiddisplay complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

Instead of superimposing multiple separate information elements (coordinates, status indicators, warnings), the patent uses a single virtual robot replica that inherently displays all robot state information through its visual representation, position, and movement, simplifying the display while providing comprehensive information.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11865697B2Robot system and method for operating same
Publication Date: 2024.01.09 KAWASAKI JUKOGYO KK
  • US11865697B2 patent drawing
  • US11865697B2 patent drawing
  • US11865697B2 patent drawing

AI summary

A robot system includes an operating device that receives an operation instruction from an operator. The system further includes a real robot that is installed in a work space and performs a series of works constituted of a plurality of steps. The system further includes transmission type display device configured to allow the operator to visually recognize a real world and configured to display a virtual. The system further includes a control device configured to operate the virtual robot displayed on the transmission type display device based on instruction information input from the operating device. The control device is further configured to thereafter operate the real robot while maintaining a state that the virtual robot is displayed on the transmission type display device when operation execution information to execute an operation of the real robot is input from the operating device.