AR Robot Operational Zone Editing Without Controller Restarts
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Establishing and visualizing robot operational zones is difficult and time-consuming using existing techniques, which are menu-driven and lack intuitive interaction with real-world objects, requiring restarts of the robot controller for boundary changes.
Innovation Solution
An augmented reality system using a headset or device in communication with the robot controller to visualize and modify operational zones by overlaying computer graphics on real-world views, allowing users to resize and reshape zones interactively while the robot operates, with zone violations highlighted, and final changes uploaded to the controller.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If menu-driven methods are used to establish operational zones, then the robot controller can be operated, but the setup process becomes difficult and time-consuming
Solution Approach 1:
The patent replaces the mechanical menu-driven interface with an augmented reality visualization system that allows direct manipulation of operational zones through graphical user interface elements overlaid on the physical workspace. This substitution enables users to define zones by interacting with visual representations rather than navigating complex menus, significantly reducing setup time and improving ease of operation.
Solution Approach 2:
The patent introduces an augmented reality intermediary layer between the user and the robot controller. This intermediary provides visual feedback and manipulation capabilities that bridge the gap between physical workspace understanding and digital zone definition, making the zone establishment process more intuitive and faster without requiring controller restarts.
2Adaptability or versatility
If operational zones are modified using existing systems, then zone boundaries can be changed, but the robot controller must be restarted to evaluate changes
Solution Approach 1:
The patent implements dynamic zone modification where operational zones can be adjusted in real-time through the augmented reality interface without requiring system restarts. The robot controller continuously evaluates zone changes as they are made, allowing for adaptive and flexible zone definition that maintains productivity while enabling comprehensive zone customization.
3Loss of information
If 4D visualization systems are used to show operational zones, then robot operation can be monitored, but real-world object overlap cannot be displayed without importing computer-based object models
Solution Approach 1:
The patent uses augmented reality to create visual copies of operational zones overlaid on the actual physical workspace. Instead of requiring separate computer-based object models, the system projects virtual zone representations directly onto the real-world environment, allowing users to see zone boundaries and robot positions in context with actual objects without importing additional models.
Data Source
AI summary
An augmented reality (AR) system for visualizing and modifying robot operational zones. The system includes an AR device such as a headset in communication with a robot controller. The AR device includes software for the AR display and modification of the operational zones. The AR device is registered with the robot coordinate frame via detection of a visual marker. The AR device displays operational zones overlaid on real world images of the robot and existing fixtures, where the display is updated as the user moves around the robot work cell. Control points on the virtual operational zones are displayed and allow the user to reshape the operational zones. The robot can be operated during the AR session, running the robot's programmed motion and evaluating the operational zones. Zone violations are highlighted in the AR display. When zone definition is complete, the finalized operational zones are uploaded to the robot controller.