Digital Twin Generation for Remote XR Collaboration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current IT environments face challenges in efficiently curating, searching, and analyzing vast amounts of diverse data, particularly in remote collaboration for extended reality environments, where users struggle to interact with real-world environments due to limited views and restricted analysis capabilities.
Innovation Solution
A data intake and query system, similar to the SPLUNK® ENTERPRISE system, is employed to collect, index, and search machine data from various sources, using a flexible schema and late-binding schema to facilitate efficient data retrieval and analysis, enabling users to search all machine data and derive insights from diverse data sources.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If conventional video streaming is used for remote collaboration, then users can share visual information, but the remote participant is limited by the host's view and cannot analyze physical objects independently
Solution Approach 1:
The patent creates digital twins (virtual copies) of physical objects that can be manipulated and analyzed remotely. Instead of limiting remote participants to viewing the host's camera feed, the system generates accurate digital representations of physical objects that remote users can interact with independently, preserving complete object information while enabling autonomous analysis.
Solution Approach 2:
The patent transitions from 2D video streaming to 3D virtual environments where physical objects are represented as interactive digital twins. This dimensional transformation allows remote participants to view objects from any angle, manipulate them freely, and conduct comprehensive analysis without being constrained by the host's physical perspective.
2Loss of information
If massive quantities of diverse data are stored across multiple data sources, then new insights can be derived, but curating, searching, and analyzing the data becomes technically challenging
Solution Approach 1:
The patent implements a universal data model that can represent diverse data types (sensor data, images, videos, metadata) from multiple sources in a unified framework. This universal model enables consistent searching, filtering, and analysis across heterogeneous data sources without requiring complex source-specific processing logic.
Solution Approach 2:
The patent introduces virtual objects and digital twins as intermediary representations between physical objects and users. These virtual objects serve as mediators that consolidate information from multiple data sources into a single accessible interface, simplifying data retrieval and analysis while maintaining connections to underlying diverse data sources.
Data Source
AI summary
Various implementations of the present application set forth a method comprising generating a host extended reality (XR) environment representing a physical space that includes a real-world asset, generating, based on sensor data captured by a depth sensor on a mobile device, three-dimensional data representing the physical space, generating, based on sensor data captured by an image sensor on the mobile device, two-dimensional data representing the physical space, generating, based on the three-dimensional data and the two-dimensional data, an adaptable three-dimensional (3D) representation of the physical space, transforming the adaptable 3D representation into geometry data comprising a set of vertices, a set of faces comprising edges between pairs of vertices, and texture data, transmitting the geometry data to a set of one or more remote devices for at least a partial reconstruction of the adaptable 3D representation of the physical space in a set of one or more remote environments.