AR Content Sharing on External Displays With Local Edge Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional AR systems face limitations such as processing bottlenecks due to limited client device power, latency issues from central server processing, reliance on continuous network connectivity, scalability challenges, data privacy concerns, and inefficient energy consumption, which detract from the user experience and effectiveness.
Innovation Solution
The AR system architecture decentralizes processing by integrating computational tasks into the AR device, minimizing data transmission and reliance on external servers, enabling local data processing, and optimizing energy usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Power
If computational tasks are centralized on external servers, then processing power is sufficient, but latency increases and network connectivity is required
Solution Approach 1:
The patent segments the AR system into multiple components: a head-worn device for local processing, an external display system for visualization, and optional cloud services for non-time-critical tasks. This segmentation allows computational tasks to be distributed, enabling local processing of time-sensitive operations while maintaining sufficient processing power through the combined system architecture.
Solution Approach 2:
The patent transitions from a single-dimension centralized cloud processing model to a multi-dimensional distributed architecture where processing occurs across multiple spatial and functional layers: edge processing in the head-worn device, mid-layer processing in external devices, and cloud processing for batch operations. This dimensional expansion resolves the latency-power tradeoff by assigning tasks to appropriate processing layers.
2Power
If computational tasks are centralized on external servers, then processing power is sufficient, but network connectivity is required
Solution Approach 1:
The system segments processing requirements into online and offline capabilities. The head-worn device contains sufficient local processing power for autonomous operation, while optional cloud connectivity provides enhanced capabilities when available. This segmentation enables the system to adapt to varying connectivity conditions without compromising core functionality.
Solution Approach 2:
The head-worn device is designed with self-sufficient processing capabilities, containing its own computational resources to handle AR rendering and processing independently. This self-service capability eliminates mandatory network dependency, allowing the device to function autonomously in offline scenarios while optionally leveraging external resources when connected.
3Loss of time
If processing is done locally on the AR device, then latency is reduced, but device power requirements increase
Solution Approach 1:
The patent segments the computational workload between the head-worn device and external systems. The head-worn device handles time-critical processing locally to minimize latency, while less time-sensitive tasks can be offloaded to external devices with greater processing power. This segmentation balances local responsiveness with overall system power efficiency.
4Power
If data is transmitted to external servers, then processing capability is enhanced, but data privacy is compromised
Solution Approach 1:
The patent extracts sensitive data processing from centralized cloud servers and relocates it to the edge device. By extracting the processing of personally identifiable information and sensitive user data from the cloud infrastructure, the system maintains enhanced processing capability for non-sensitive tasks while protecting privacy-critical operations through localized handling.
Solution Approach 2:
The head-worn device acts as an intermediary layer between the user and external servers. It processes and anonymizes data locally before transmitting only necessary aggregated information to cloud services, thereby mediating between the need for cloud processing power and the requirement for data privacy protection.
Data Source
AI summary
A head-worn device system equipped with cameras, display devices, and processors uses stored instructions to facilitate interactions between an augmented reality (AR) device and an external display system. When executed, these instructions establish a communications link between the AR device and the external display. The system identifies the pose of the external display and receives user inputs from the AR device user, relating to interactions with virtual objects in a real-world setting. It also identifies the positions of viewers watching the external display. Based on the external display's pose and the viewer locations, the system generates display data for the virtual object, ensuring it appears correctly on the external display. This display data is then transmitted to the external display system, completing the interaction loop and enhancing the viewing experience for the audience.