VR Robot Control With Cyber Model for Real-Time Collaboration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current VR-based industrial robot control systems fail to achieve real-time control and complicate human-machine cooperation due to complex operation and training requirements, limiting their application in manufacturing.

Innovation Solution

A real-time control system integrating a VR headset, VR controller, model construction, motion control, and data communication modules, allowing users to interactively control industrial robots through a Cyber model, enabling real-time motion commands and simplifying the control process by eliminating the need for programming and debugging.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If VR-based control system is implemented for industrial robots, then ease of operation is improved, but device complexity increases

Engineering Contradiction:
Improveease of operationVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent creates a virtual copy (Cyber model) of the industrial robot and its workspace that mirrors the physical system in real-time. This virtual model allows operators to interact with a simplified digital representation rather than the complex physical robot directly, achieving ease of operation while the complexity is managed in the virtual domain

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The VR system acts as an intermediary layer between the operator and the industrial robot. The Cyber model serves as a mediator that translates simple VR controller inputs into complex robot motion commands, shielding the operator from the underlying system complexity while maintaining real-time control

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If digital simulation environment is used for path planning and collision detection, then manufacturing precision is improved, but productivity decreases

Engineering Contradiction:
Improvemanufacturing precisionVSAvoidproductivity
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent establishes continuous real-time bidirectional communication between the VR system and the industrial robot controller. Path planning and collision detection occur continuously in the virtual environment during robot operation, eliminating separate programming and debugging phases while maintaining manufacturing precision through ongoing virtual-physical synchronization

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The system performs preliminary path planning and collision detection in the virtual Cyber model before executing motions in the physical robot. By pre-validating trajectories in the virtual environment, the system ensures manufacturing precision while reducing trial-and-error debugging time, thereby improving productivity

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If command set planning and compilation process is implemented, then manufacturing precision is improved, but device complexity increases

Engineering Contradiction:
Improvemanufacturing precisionVSAvoiddevice complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical programming approaches with a virtual reality-based interaction system. Instead of manually planning and compiling command sets through complex programming interfaces, operators directly manipulate the virtual robot model with intuitive VR controllers, achieving manufacturing precision through visual feedback while eliminating programming complexity

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11986968B2Real-time control system for industrial robot based on virtual reality (VR)
Publication Date: 2024.05.21 HARBIN INST OF TECH
  • US11986968B2 patent drawing
  • US11986968B2 patent drawing
  • US11986968B2 patent drawing

AI summary

A real-time control system for industrial robots based on virtual reality (VR), including: a VR headset, a VR controller, a model construction module, a motion control module, a data communication system and a robot controller. Through the VR controller, a user can touch and drag an end of the gripper to move the robot in the Cyber environment. When the gripper moves into a bounding box of a control point, the data communication system is triggered, and a communication code corresponding to the control point is sent to the robot controller via a Unity engine script. After receiving the code, the robot controller sends the corresponding motion command such that the robot such that the robot moves in real time according to the control data.