AR Robot Trajectory Visualization for Safer Human Collaboration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The integration of human-robot collaboration in manufacturing environments is hindered by the dangers posed by high-speed movements and massive forces generated by industrial robots, leading to unpredictable accidents, low adoption rates, and challenges in developing effective collaboration strategies and regulations.

Innovation Solution

The use of virtual reality (VR) and augmented reality (AR) technologies to display the trajectory of industrial robot movements on wearable headsets, providing workers with immersive training and feedback, thereby promoting awareness, comfort, and safety in collaborative robotics environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If industrial robots operate at high speed with massive forces, then productivity is improved, but safety and reliability deteriorate due to unpredictable accidents

Engineering Contradiction:
Improverobot speedVSAvoidsafety
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system performs preliminary action by displaying the robot's future trajectory to workers before the robot actually moves. This allows workers to anticipate and prepare for the robot's movements, eliminating the need for sudden reactions and preventing accidents caused by unpredictable high-speed movements.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback by providing real-time visual information about the robot's intended path through AR/VR displays. Workers receive continuous feedback about where the robot will move next, enabling them to adjust their behavior accordingly and maintain safety even at high operating speeds.

Inventive Principle:
Principle #23Feedback

2Loss of information

If workers are trained through traditional methods, then knowledge transfer occurs, but worker familiarity and comfort with robotic systems remain insufficient

Engineering Contradiction:
Improveknowledge transferVSAvoidworker familiarity
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system uses copying by creating virtual replicas of the robot and its movements in an AR/VR environment. Workers interact with these copies in a safe setting, allowing repeated practice and familiarization without risk. This virtual copying enables comprehensive training that builds both knowledge and comfort with robotic systems.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system adds another dimension to training by transitioning from traditional 2D screens to immersive 3D AR/VR experiences. This dimensional enhancement provides workers with spatial understanding and intuitive familiarity with robot movements that flat displays cannot achieve, significantly improving ease of operation.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Reliability

If physical testing of human-robot collaboration is conducted, then real-world interaction data is collected, but dangerous accidents occur

Engineering Contradiction:
Improvecollaboration strategy validationVSAvoidaccident risk
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The AR/VR system serves as an intermediary between physical testing and real-world operation. It creates a virtual testing environment that mediates the validation process, allowing collaboration strategies to be tested and validated without direct physical exposure to dangerous robot movements. This intermediary layer eliminates accident risk while maintaining validation reliability.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates virtual copies of physical testing scenarios in the AR/VR environment. By replicating collaboration strategies in this safe virtual space, organizations can collect interaction data and validate approaches without exposing workers to the harmful factors present in actual physical testing with high-speed robots.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11529737B2System and method for using virtual/augmented reality for interaction with collaborative robots in manufacturing or industrial environment
Publication Date: 2022.12.20 RAYTHEON CO
  • US11529737B2 patent drawing
  • US11529737B2 patent drawing
  • US11529737B2 patent drawing

AI summary

A method includes determining a movement of an industrial robot in a manufacturing environment from a first position to a second position. The method also includes displaying an image showing a trajectory of the movement of the robot on a wearable headset. The displaying of the image comprises at least one of: displaying an augmented reality (AR) graphical image or video of the trajectory superimposed on a real-time actual image of the robot, or displaying a virtual reality (VR) graphical image or video showing a graphical representation of the robot together with the trajectory.