Virtual Robot Training in VR for Faster Factory Programming

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Small manufacturing entities face challenges in integrating robotic systems due to the need for high flexibility, rapid programmability, and cost-effectiveness without economy of scale, with current robot programming methods being cumbersome, time-consuming, and unintuitive.

Innovation Solution

The implementation of an immersive virtual reality environment (IVE) system that allows users to interact with virtual robots, enabling flexible human-robot interaction by creating a virtual representation of real-world robots, receiving user input, providing feedback, and training the virtual robot, which is then used to program the real-world robot.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional robot programming methods are used, then robot functionality is achieved, but programming time and complexity increase significantly

Engineering Contradiction:
Improveprogramming speedVSAvoidprogramming complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent creates a virtual copy of the physical robot in a VR environment. This virtual robot replica allows users to program and train robotic behaviors without directly programming the physical robot, significantly reducing programming time and complexity while maintaining full functionality transfer to the real robot.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The VR environment serves as an intermediary between the user and the physical robot. Users interact with the virtual robot in the immersive environment, and the system automatically translates these interactions into programmed behaviors for the real robot, eliminating complex traditional programming steps.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If physical robot interaction is required for programming, then direct control is achieved, but safety risks and operational limitations increase

Engineering Contradiction:
Improveprogramming easeVSAvoidsafety risks
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

By creating a virtual replica of the robot in the VR environment, users can program and test robotic behaviors safely without physical contact. The virtual copy absorbs all interaction risks while maintaining accurate mapping to the physical robot's movements and operations.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces physical mechanical interaction with the robot with virtual interaction in the VR environment. Users manipulate the virtual robot using VR controllers and gestures, and the system translates these virtual actions into real robot commands, eliminating safety risks associated with physical programming.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Reliability

If comprehensive robot training is performed, then task performance improves, but training time and resource consumption increase

Engineering Contradiction:
Improvetask performanceVSAvoidtraining time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent enables preliminary training of the virtual robot in the VR environment before deploying to the physical robot. Users can perform extensive training, testing, and refinement of robotic behaviors in the virtual space, ensuring optimal task performance is achieved before actual physical execution.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Training performed on the virtual robot copy automatically transfers to the physical robot. The virtual training sessions build up behavioral patterns and task proficiencies that are directly applicable to the real robot, reducing the need for repetitive physical training and significantly cutting down overall training time.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11279022B2Robot control, training and collaboration in an immersive virtual reality environment
Publication Date: 2022.03.22 JOHNS HOPKINS UNIVERSITY
  • US11279022B2 patent drawing
  • US11279022B2 patent drawing
  • US11279022B2 patent drawing

AI summary

System and methods to create an immersive virtual environment using a virtual reality system that receives parameters corresponding to a real-world robot. The real-world robot may be simulated to create a virtual robot based on the received parameters. The immersive virtual environment may be transmitted to a user. The user may supply input and interact with the virtual robot. Feedback such as the current state of the virtual robot or the real-world robot may be provided to the user. The user may train the virtual robot. The real-world robot may be programmed based on the virtual robot training.