Virtual Reality Robot Interface for Real-Time and Automated Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing telerobotics systems require manual operation or automated programming, which are labor-intensive and time-consuming, especially when working with high-energy lines, and lack an intuitive interface for controlling robots.
Innovation Solution
A virtual reality interface that combines manual and automated control of robots, featuring a customizable interface with selectable icons and menus for real-time operation, allowing operators to control robots using input devices and a headset display, displaying video feeds and graphics for simultaneous viewing of the work environment and task instructions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual operation is used to control the robot, then the operator can control the robot in real-time, but it requires substantial labor and time, especially when changing parts and uploading new coding
Solution Approach 1:
The system pre-loads multiple automation programs into memory before they are needed. When an operator selects a program through the VR interface, it is already prepared and can be executed immediately without requiring real-time coding or part changes, thus reducing the time loss while maintaining operational control.
Solution Approach 2:
The invention creates virtual copies of automation programs and interfaces within the VR environment. Operators interact with virtual representations of control functions, allowing them to select and switch between pre-programmed automations without physical part changes or manual coding, significantly reducing time while preserving ease of operation.
2Productivity
If automated control is used to perform operations, then labor and time are reduced, but the operator has no real-time control over the robot's actions
Solution Approach 1:
The VR interface serves multiple functions simultaneously: it allows operators to monitor automated operations, intervene in real-time when needed, and switch between different automation programs. This multi-functional interface ensures that automated control maintains productivity while preserving operator control capability through a single unified system.
Solution Approach 2:
The system provides continuous visual feedback through the VR display, showing operators the robot's actions and status in real-time during automated operations. This feedback mechanism allows operators to monitor automated processes and intervene when necessary, maintaining control capability while benefiting from automated efficiency.
3Loss of information
If a traditional video feed interface is used, then the operator can view the robot's actions, but the interface is limiting and lacks intuitive control options
Solution Approach 1:
The invention transitions from a traditional 2D video feed interface to a 3D virtual reality interface. This dimensional change provides operators with immersive spatial awareness of the robot's environment and actions, while simultaneously offering intuitive 3D-arranged control options and menus that are naturally positioned in the virtual space, enhancing both information visibility and ease of operation.
4Productivity
If multiple automation programs are stored in memory for different operations, then productivity is improved, but the device complexity increases due to additional programming and setup requirements
Solution Approach 1:
The system stores virtual copies of multiple automation programs in memory, each representing a complete set of instructions for different operations. These virtual programs can be selected and executed without requiring physical reconfiguration or complex setup, improving productivity while managing device complexity through software-based solutions rather than hardware changes.
Data Source
AI summary
Systems and methods for providing a virtual reality interface operable to control a robot system by an operator are disclosed. In some embodiments, the robot system is provided on a boom of an aerial device. The robot system is operable to carry out instructions for performing work-related tasks in a work environment. An operator may interact with a virtual reality system providing the virtual reality interface to operate the robot system. The virtual reality interface may provide various menus and icon features that, when selected, cause display of menus and functions of the virtual reality interface. The virtual reality interface may provide a list of tasks to be performed and instructions to perform those tasks. In some embodiments, the icon features are presented based on the tasks to be performed and selection of the icon features initiates automated actions of the robot system to perform certain tasks.