Digital Twin Remote Assistance for AR Machine Operation Guidance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current remote assistance methods focus on inter-person communication, which can be ineffective in conveying complex machine operations, leading to difficulties for workers in improving their hands-on skills.
Innovation Solution
The method involves creating a digital twin of a machine that mirrors its real-world state, allowing a remote expert to perform operations on the digital twin and visualize the effects as augmented reality on the actual machine, thereby providing direct and intuitive assistance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If remote assistance focuses on inter-person communication through audio/video sessions, then communication between expert and worker is enabled, but the worker cannot properly carry out operations due to insufficient conveyance of complex machine operations
Solution Approach 1:
The patent creates a digital twin of the machine that replicates its physical state and operations. The remote expert interacts with this virtual copy to demonstrate operations, which are then automatically transferred to the physical machine. This copying approach preserves complex operational information perfectly while making it easily actionable for the worker, resolving the contradiction between information conveyance and operational ease.
Solution Approach 2:
The patent introduces an automated intermediary system that includes a local rendering device and mapping mechanism. This intermediary automatically translates the expert's actions on the digital twin into corresponding physical actions on the machine, eliminating the need for the worker to manually interpret complex verbal or visual instructions. The intermediary bridges the gap between information reception and operational execution.
2Productivity
If a remote expert provides verbal instructions through communication sessions, then assistance is provided, but the worker faces difficulties in improving hands-on skills due to lack of intuitive visual guidance
Solution Approach 1:
The digital twin serves as a visual copy of the physical machine, allowing the expert to demonstrate operations in a realistic virtual environment. The worker can observe these demonstrations intuitively, and the automated mapping system ensures the same actions are performed on the physical machine. This provides both efficient remote assistance and effective hands-on skill transfer through visual learning.
Solution Approach 2:
The patent replaces the mechanical training process where workers must physically practice and learn through trial and error with an automated visual demonstration system. The local rendering device projects visual guidance directly onto or near the physical machine, substituting manual apprenticeship with automated visual instruction, thereby improving both assistance efficiency and skill acquisition.
3Loss of information
If visual assistance information is mapped onto the machine at the working site, then intuitive guidance is provided to the worker, but additional devices and processing are required at both remote and local sites
Solution Approach 1:
The local rendering device acts as an intermediary that automatically maps visual assistance information from the digital twin to the physical machine. This intermediary handles the complex processing of translating virtual actions into physical visual guidance, preserving operational accuracy while shielding the user from system complexity. The device synchronizes visual information with the actual machine state, ensuring accuracy without requiring the worker to understand the underlying complex processes.
Data Source
Figure 1~2
Figure 3
Figure 4~5A
AI summary
The present disclosure provides a method for remote assistance and device. The method may include: adjusting a digital twin of a machine to be in the same state with the machine which is deployed at a working site; making the digital twin rendered at a remote site using a remote rendering device deployed at the remote site to enable a remote person at the remote site to perform an operation on the digital twin; making an effect of the operation rendered as visual assistance information mapped onto the machine at the working site using a local rendering device deployed at the working site.