AR Content Sharing on External Displays With Low-Latency Local Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional AR systems face limitations due to processing power constraints on client devices, latency issues from central server processing, reliance on continuous network connectivity, scalability challenges, and concerns over data privacy and energy consumption, which detract from the user experience and effectiveness.
Innovation Solution
The AR system architecture decentralizes processing by integrating computational tasks directly into the AR device, minimizing reliance on external servers, reducing latency, and enhancing local data processing capabilities to improve responsiveness, scalability, and privacy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Power
If processing tasks are centralized on external servers, then computational power is sufficient, but latency increases and network connectivity is required
Solution Approach 1:
The patent segments the processing architecture by dividing computational tasks between the AR device and external servers. The AR device handles time-critical rendering and display tasks locally, while less time-sensitive tasks can be processed externally. This segmentation reduces latency for critical operations while maintaining access to external computational resources when needed.
Solution Approach 2:
The patent introduces a local processing intermediary (the AR device itself) between the user and the external server. This intermediary handles real-time rendering and processing locally, mediating between external computational resources and the user's immediate needs, thereby reducing perceived latency while still utilizing external server capabilities.
2Loss of time
If processing tasks are decentralized to the AR device, then latency is reduced and responsiveness is improved, but processing power constraints are encountered
Solution Approach 1:
The patent implements partial decentralization where only the necessary portion of processing tasks is performed locally on the AR device. By selectively offloading specific rendering and processing tasks to the device's local capabilities while maintaining the option to use external resources, the system achieves improved responsiveness without requiring the full processing power to be available locally.
3Adaptability or versatility
If computational tasks are performed locally on the AR device, then network connectivity is not required, but energy consumption increases
Solution Approach 1:
The patent implements a dynamic processing architecture that can adaptively switch between local and external processing modes based on available network connectivity and energy constraints. When network connectivity is available, the system can offload tasks to reduce local energy consumption. When connectivity is limited or unavailable, it seamlessly transitions to local processing, providing continuous adaptability to changing environmental conditions.
4Reliability
If data is processed centrally on servers, then data privacy concerns are reduced, but network dependency increases
Solution Approach 1:
The patent applies local quality by processing sensitive user data locally on the AR device rather than transmitting it externally. This ensures that privacy-sensitive operations (such as capturing and processing user images or personal information) are performed in a secure, localized environment, maintaining data privacy while reducing network dependency for these critical functions.
Data Source
AI summary
A head-worn device system equipped with cameras, display devices, and processors uses stored instructions to facilitate interactions between an augmented reality (AR) device and an external display system. When executed, these instructions establish a communications link between the AR device and the external display. The system identifies the pose of the external display and receives user inputs from the AR device user, relating to interactions with virtual objects in a real-world setting. It also identifies the positions of viewers watching the external display. Based on the external display's pose and the viewer locations, the system generates display data for the virtual object, ensuring it appears correctly on the external display. This display data is then transmitted to the external display system, completing the interaction loop and enhancing the viewing experience for the audience.