AR Robot Path Visualization for Human Collision Avoidance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current human-robot interaction systems in industrial environments, particularly with mobile robots, are inadequate in preventing collisions between robots and human operators, and existing solutions are not scalable or adaptable, leading to safety concerns and productivity losses.

Innovation Solution

A system and method using augmented reality (AR) interfaces to visualize the planned movement paths of robotic devices relative to user positions, incorporating quantities such as identity, activity, mass, velocity, and proximity, to enhance safety and productivity by providing real-time, accurate visual and audio cues for collision avoidance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If collision detection or avoidance approaches are used, then collision safety is improved, but complete collision prevention is not achieved and work interruptions still occur

Engineering Contradiction:
Improvecollision prevention reliabilityVSAvoidwork continuity
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system displays the planned movement path of the robotic device before the device actually moves, allowing human operators to anticipate and avoid potential collision zones in advance. This preliminary information provision enables proactive safety measures rather than reactive collision response.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If physical modifications to the environment or robots are implemented (e.g., highlighting tape, additional displays), then collision awareness is improved, but scalability and adaptability deteriorate

Engineering Contradiction:
Improvecollision awarenessVSAvoidscalability and adaptability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent replaces physical modifications (highlighting tape on floors, additional displays on robots) with a virtual reality-based augmented reality display system. This substitution provides the same collision awareness function while being fully scalable and adaptable to different environments and requirements through software configuration rather than physical installation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If augmented reality techniques are used to display movement paths, then adaptability and scalability are improved, but the system complexity increases

Engineering Contradiction:
ImprovescalabilityVSAvoidAR system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The AR display system is designed to serve multiple functions: displaying planned movement paths, showing real-time robot position, providing collision warnings, and offering maintenance information. This multi-functionality consolidates what would otherwise require multiple separate systems into a single unified platform, managing complexity while enhancing adaptability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Ease of operation

If operators need to investigate robot movement information for inspection or maintenance, then operational control is improved, but time loss increases due to lack of real-time information

Engineering Contradiction:
Improvemovement information accessibilityVSAvoidinspection and maintenance time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system provides real-time feedback to operators about the robotic device's planned path, current position, and status information through the AR display. This immediate feedback eliminates the need for operators to manually investigate movement information, allowing them to monitor and respond to robot activities without time-consuming inspections.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20230334745A1System and method for indicating a planned robot movement
Publication Date: 2023.10.19 ABB (SCHWEIZ) AG
  • US20230334745A1 patent drawing
  • US20230334745A1 patent drawing
  • US20230334745A1 patent drawing

AI summary

An information system configured to indicate a condition of one or more robotic devices to a user, the information system having: a communication interface for obtaining at least one planned movement path of the robotic devices and a position of the user; an augmented-reality, AR, interface associated with the user; and processing circuitry configured to display, by means of the AR interface, a visualization of the at least one planned movement path relative to the user position, wherein the visualization is responsive to at least one quantity, which is one or more of: a robotic device's identity, a robotic device's mass or physical dimensions, a robotic device's velocity, a robotic device's proximity to the user position.