Augmented Reality Robot Display for Intuitive Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional robot systems using virtual reality lack reproducibility of the actual robot and environment, making it difficult for users to navigate and operate robots efficiently, as they rely on numerical or character-based status and navigation information rather than immersive augmented reality displays.

Innovation Solution

A robot system incorporating an augmented reality-compatible display that captures and overlays real-time images of the robot with additional information such as operation guides and status indicators, using a controller and image capturing-displaying device to enhance user interaction and navigation by providing a more intuitive and immersive experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If virtual reality technique is used to navigate robot status and work, then navigation information can be provided to user, but the reproducibility of actual robot and environment decreases

Engineering Contradiction:
Improvenavigation informationVSAvoidreproducibility of actual robot and environment
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The patent uses augmented reality to create a composite image that copies and overlays digital information onto the actual robot image, rather than replacing the real environment with a virtual one. This allows navigation information to be provided while maintaining the authenticity and reproducibility of the actual robot and environment.

Inventive Principle:
Principle #26Copying

2Loss of information

If numerical or character-based status information is displayed, then robot status can be communicated, but user interaction efficiency decreases

Engineering Contradiction:
Improverobot status informationVSAvoiduser operation efficiency
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The patent employs color-coded indicators and visual overlays to represent robot status and navigation information. Instead of using numerical or character-based displays, the system uses color changes and visual cues in the augmented reality interface to communicate status information more intuitively and efficiently to the user.

Inventive Principle:
Principle #32Color changes

3Productivity

If augmented reality display overlays additional information on actual robot image, then operational efficiency improves, but device complexity increases

Engineering Contradiction:
Improveuser operation efficiencyVSAvoidimage capturing-displaying device complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent merges the image capturing function and the display function into a single integrated device. The image capturing-displaying device captures the actual robot image, processes it by overlaying digital information, and displays the composite image all in one unit, thereby improving operational efficiency while managing device complexity through functional integration.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS10052765B2Robot system having augmented reality-compatible display
Publication Date: 2018.08.21 FANUC LTD
  • US10052765B2 patent drawing
  • US10052765B2 patent drawing
  • US10052765B2 patent drawing

AI summary

A robot system using an augmented reality-compatible display, capable of providing information on the status and/or an operation guide of a robot added to an actual image or actual environment, to a user of the robot, so as to improve the efficiency of operations carried out by the user. The robot system includes an actual robot, a controller which controls the actual robot, and an image capturing-displaying device connected to the controller by a wire or by radio. The image capturing-displaying device has a function for capturing an image of a scene including the actual robot and a function for displaying the captured image in real-time. The user can obtain a scene including the actual robot in real-time by directing a camera arranged on the image capturing-displaying device toward the actual robot, and can monitor an augmented reality image.