Remote Expert System for Wearable AR Collaboration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality systems lack the ability to effectively communicate and coordinate manipulation of virtual objects between multiple users and experts in real-time, especially in complex environments like construction sites, where multiple workers need to collaborate on the same physical object from different angles and locations.
Innovation Solution
A remote expert system that utilizes wearable devices to capture video feeds, location information, and orientation data to generate and update three-dimensional models of physical objects, allowing for real-time collaboration and analytics on object manipulations, and communicates these updates between users and experts through a network-based system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple users wear wearable devices to capture data from different angles and locations, then the completeness and accuracy of the three-dimensional model improves, but the system complexity and data coordination requirements increase
Solution Approach 1:
The system divides the data collection task into segments performed by multiple independent wearable devices worn by different users. Each device captures data from its specific angle and location, and the server segments the coordination task by assigning unique identifiers and tracking individual device contributions to the overall model construction.
Solution Approach 2:
A central server acts as an intermediary that receives data from multiple wearable devices, processes the information, and coordinates the integration of data from different sources. The server manages the complexity of synchronizing multiple users' contributions and generates the unified three-dimensional model without requiring direct peer-to-peer coordination between devices.
2Productivity
If real-time communication and coordination between multiple users and experts is enabled, then collaboration efficiency improves, but the data transmission requirements and network load increase
Solution Approach 1:
The system extracts only the essential manipulation actions and model update data from the complete data stream generated by wearable devices. Instead of transmitting all raw sensor data, the server identifies and extracts specific manipulation events and relevant model changes, reducing the overall data transmission volume while maintaining real-time collaboration capability.
Solution Approach 2:
The system implements partial real-time communication by continuously updating only the portions of the three-dimensional model that have changed due to user manipulations, rather than transmitting complete model data. This selective updating approach maintains collaboration efficiency while significantly reducing network load compared to full data synchronization.
3Speed
If the system processes and analyzes manipulations of virtual objects in real-time, then the responsiveness and user feedback quality improve, but the computational requirements and processing time increase
Solution Approach 1:
The system performs preliminary processing of manipulation data by the server, which pre-computes the effects of virtual object manipulations and prepares updated model states in advance. This preliminary action allows the client devices to receive pre-processed results quickly, improving response speed while distributing computational power requirements to the server infrastructure.
Solution Approach 2:
The system creates simplified copies or representations of manipulation data and model states that can be quickly transmitted and processed. Instead of handling complex raw sensor data and full three-dimensional models throughout the processing chain, the server generates streamlined data copies that maintain essential information while reducing computational requirements for real-time analysis.
Data Source
AI summary
A remote expert application identifies a manipulation of virtual objects displayed in a first wearable device. The virtual objects are rendered based a physical object viewed with a second wearable device. A manipulation of the virtual objects is received from the first wearable device. A visualization of the manipulation of the virtual objects is generated for a display of the second wearable device. The visualization of the manipulation of the virtual objects is communicated to the second wearable device.