Mixed Reality Robot Training for Remote Industrial Operation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing robotic training systems are costly and logistically challenging due to the need for physical robots and centralized training facilities, which is further complicated by remote work paradigms resulting from the global pandemic.
Innovation Solution
A mixed reality robotic training system that includes a first computing device and a mixed reality device, allowing users to control a simulated and mixed reality robot remotely through a touchscreen interface, with the ability to connect to an industrial robot for real-world application.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If physical robots are used for training, then hands-on training effectiveness is improved, but training cost and logistical complexity increase
Solution Approach 1:
The patent creates a virtual copy of the physical robot that replicates its appearance, movements, and operational characteristics. This virtual robot is rendered in real-time and displayed through head-mounted displays, allowing trainees to interact with and control the robot remotely without needing physical presence at the training location. The virtual copy maintains fidelity to the original robot while eliminating the need to transport or physically deploy the actual robot for training purposes.
Solution Approach 2:
The system introduces a virtual reality environment as an intermediary between the trainee and the physical robot. This intermediary layer allows trainees to control and observe the robot's actions remotely through immersive virtual displays, bridging the gap between physical robot operation and remote training requirements. The intermediary enables hands-on training experience without direct physical interaction.
2Adaptability or versatility
If multiple physical robots are deployed for training, then training versatility is improved, but cost and space requirements increase
Solution Approach 1:
The virtual robot system serves multiple training functions simultaneously. A single physical robot can be controlled and observed by multiple trainees through individual virtual reality interfaces, allowing one robot to replace multiple physical robots. The system can display different robot models, configurations, and operational scenarios within the same physical space, providing diverse training opportunities without requiring multiple physical robots.
Solution Approach 2:
The patent transitions from physical multiplication of robots to virtual multiplication through digital rendering. Instead of adding more physical robots to increase training capacity, the system creates multiple virtual instances or perspectives of robot operation through software. Trainees can access different robot types, configurations, and training scenarios through the same physical hardware platform, expanding versatility in the digital dimension rather than the physical dimension.
3Reliability
If centralized training facilities are used, then training quality is improved, but accessibility for remote workers deteriorates
Solution Approach 1:
The patent replaces the mechanical requirement of physical travel to centralized training facilities with an electronic/digital system. Trainees use head-mounted displays and control interfaces that connect to the robot system through communication networks, eliminating the need for physical transportation and location-based training. The mechanical act of traveling to a training center is substituted with electronic transmission of control signals and visual feedback.
Solution Approach 2:
The virtual reality display system acts as an intermediary that delivers high-quality training experiences to remote locations. This intermediary technology transmits real-time visual feedback, robot status information, and control interfaces to trainees anywhere with network connectivity, maintaining training quality standards while removing geographical barriers to access.
Data Source
AI summary
A robotic training system includes a first computing device and a mixed reality device. The first computing device includes a first program to control the mixed reality device. The first program also includes a simulated robot operating in a simulated environment and instructions for a mixed reality robot to be displayed by the mixed reality device. The first computing device can receive an input and determine instructions to control the simulated robot and determine instructions to control the mixed reality robot based on the input. The simulated robot can be viewed on a first display of the first computing device and the mixed reality robot can be viewed on the mixed reality device. Further, the first computing device can connect to a second computing device to train the user of the first computing device to operate an industrial robot. The second computing device can be connected to a physical robot.


