AR Robot Avatars for Mobile Robot Identification and Maintenance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Operators in factory settings face challenges in distinguishing and identifying individual mobile robots of the same type for maintenance and task assignment due to their similar external appearances, leading to inefficiencies and resource wastage.
Innovation Solution
A system and method utilizing augmented-reality (AR) visualization to represent mobile robots as localized humanoid avatars, where the avatars are responsive to non-visual characteristics such as size, type, load, health status, and maintenance status, allowing operators to easily differentiate between them using AR glasses.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If multiple mobile robots of the same type are deployed to improve production efficiency, then productivity increases, but it becomes difficult for operators to distinguish and identify individual robots for maintenance and task assignment
Solution Approach 1:
The patent applies color changes by mapping non-visual characteristics of robots to visual properties of their avatar representations. Different robot types, health statuses, and maintenance needs are encoded through color variations in the AR visualization, allowing operators to quickly distinguish between robots without physical inspection
Solution Approach 2:
The patent introduces an intermediary AR visualization layer that mediates between the physical robots and the operator's perception. This virtual layer projects robot information into the physical workspace, serving as a bridge that makes invisible characteristics visible without requiring operators to physically interact with each robot
2Ease of operation
If operators repeatedly differentiate and memorize individual robot information, then they can identify robots, but this consumes extensive time and cognitive resources
Solution Approach 1:
The system performs preliminary action by pre-processing robot information and encoding it into visual characteristics before the operator needs to identify the robots. Non-visual characteristics are transformed into perceivable visual cues in advance, eliminating the need for operators to perform time-consuming differentiation and memorization tasks
Solution Approach 2:
The patent replaces the mechanical/cognitive process of human differentiation and memorization with an automated information system. The system automatically processes robot data and presents it in visually distinguishable forms, substituting human cognitive effort with automated information processing and visual presentation
3Loss of information
If conventional representations using cluttering texts or charts are used to display robot information, then comprehensive information is provided, but operators' perception is distracted and extensive effort is required to absorb information
Solution Approach 1:
The patent applies local quality by assigning specific visual characteristics to represent different robot attributes at specific locations in the AR visualization. Each robot's avatar has localized visual properties (colors, symbols, highlights) that encode specific information, allowing operators to quickly perceive relevant details without being overwhelmed by comprehensive but cluttered data displays
Solution Approach 2:
The patent transitions from two-dimensional text and chart representations to three-dimensional spatial visualization in the AR environment. Robot information is projected into the physical workspace, creating a spatial dimension that naturally organizes information and reduces cognitive load compared to flat, text-heavy interfaces
Data Source
AI summary
A method of visualizing a plurality of mobile robots includes: obtaining positions of the mobile robots; obtaining information regarding at least one non-visual characteristic of the mobile robots; rendering a scene in an augmented-reality, AR, environment; and visualizing the mobile robots as localized humanoid avatars in the scene, wherein the avatars are responsive to the non-visual characteristic.