XR Digital Twin Two-Way Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional digital twins are static and lack two-way data flow, limiting real-time dynamic interaction and prediction of states between virtual and real assets in extended reality (XR) applications.
Innovation Solution
An XR system and method that enables real-time interaction and two-way control between digital twins and real assets using camera devices to track movements and states, generating 3D maps that reflect both real and predicted states, with rule-based and machine learning models for dynamic updates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If conventional digital twins use static snapshots with one-way data flow, then the system complexity is reduced, but the real-time dynamic interaction capability is lost
Solution Approach 1:
The patent transforms static digital twins into dynamic systems by implementing continuous bidirectional data flow between physical assets and virtual twins. The system uses real-time sensors on physical assets to update virtual twins, and vice versa, enabling dynamic adaptation and interaction rather than static representation.
Solution Approach 2:
The patent establishes feedback loops where data flows bidirectionally between physical assets and digital twins. Sensors on physical assets provide feedback to update virtual twins, while actions taken in the virtual twin feed back to control physical assets, creating a closed-loop control system that enables real-time dynamic interaction.
2Adaptability or versatility
If digital twins continuously track and predict real asset states in real-time, then the interaction capability is improved, but the data processing complexity increases
Solution Approach 1:
The patent implements prediction algorithms that anticipate future states of physical assets based on current and historical data. By performing preliminary actions in the virtual twin environment, the system can predict outcomes and optimize real-world operations without requiring complex real-time processing of every possible scenario.
Solution Approach 2:
The patent selectively tracks and processes only the most critical parameters and states of physical assets rather than attempting to model every detail. This partial action approach focuses computational resources on key interaction points, reducing overall data processing complexity while maintaining effective real-time interaction capability.
3Productivity
If two-way control is implemented between digital twins and real assets, then the operational efficiency is improved, but the system reliability requirements increase
Solution Approach 1:
The patent introduces virtual twins as intermediary systems between human operators and physical assets. The digital twin acts as a mediator that simulates and predicts outcomes before implementing actions on physical assets, reducing the risk of errors and enhancing system reliability while maintaining operational efficiency through automated control loops.
Data Source
AI summary
An extended reality system and extended reality method for digital twins, in which the digital twin can be a virtual asset of a real asset. The real asset can be a real object. For example, an initiation of an event in relation to the real asset causes the extended reality method to generate one or more predicted virtual states which are predicted to achieve the event in the virtual asset. The event can be initiated through the real asset and through the virtual asset. The extended reality method can receive one or more further real states of the real asset which achieve the event. The extended reality method can generate a reality 3D map in an extended reality application which concurrently displays, in the 3D space, the virtual asset in the one or more predicted virtual states and the real asset in the one or more further real states.