Digital Twin Remote Assistance for Machine Operation Guidance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current remote assistance methods focus on inter-person communication, which can be ineffective in improving hands-on skills for machine operation and repair, as workers may struggle to execute operations correctly despite clear verbal instructions.
Innovation Solution
The method involves creating a digital twin of a machine that mirrors its state at a working site, allowing a remote expert to perform operations on the digital twin and render the effects as visual assistance information mapped onto the actual machine, enhancing hands-on skills through improved human-machine interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a remote expert provides verbal instructions through audio or video communication, then inter-person communication is improved, but the worker's hands-on skill improvement deteriorates
Solution Approach 1:
The patent creates a digital twin (virtual copy) of the physical machine that the remote expert can manipulate. The expert's operations on the digital twin are captured and transmitted as visual demonstrations to the worker, allowing the worker to see exactly what operations to perform on the actual machine, thereby bridging the gap between verbal instructions and hands-on execution
Solution Approach 2:
The digital twin serves as an intermediary between the remote expert and the worker. Instead of direct verbal communication, the expert interacts with the digital twin, which then generates visual demonstrations that guide the worker's hands-on operations, effectively mediating the knowledge transfer process
2Loss of information
If a remote virtual reality assistant system is used to enhance inter-person communication, then communication effectiveness is improved, but the complexity of the assistance system deteriorates
Solution Approach 1:
The system uses a digital twin that can serve multiple functions: it represents the physical machine's state, allows remote expert manipulation, generates visual demonstrations, and provides a platform for capturing operations. This multi-functional approach avoids the need for separate complex VR systems while achieving effective remote assistance
3Ease of operation
If visual content is rendered and mapped onto the machine at the working site, then hands-on skill improvement is enhanced, but the complexity of the rendering system increases
Solution Approach 1:
The system renders visual content by capturing the expert's operations on the digital twin and generating corresponding visual demonstrations. These visuals are then mapped to the physical machine, providing the worker with clear visual guidance without requiring complex rendering hardware at the working site
Data Source
AI summary
The present disclosure provides a method for remote assistance and device. 1. A method for remote assistance, the method comprising:determining a state of a machine deployed at a working site;adjusting a digital twin of the machine to be in the same state as the machine deployed at the working site;rendering the digital twin at a remote site using a remote rendering device to enable a remote person at the remote site to perform an operation on the digital twin; andmapping an effect of the operation rendered as visual assistance information onto the machine at the working site using a local rendering device deployed at the working site.