AR Eyewear Always-On Hyper-Connection and Stream Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality (AR) wearable electronic devices lack seamless, frictionless connectivity for users to share real-time experiences, such as vision, audio, and annotations, requiring manual setup and acceptance processes.
Innovation Solution
The system enables always-on hyper-connection between electronic eyewear devices, allowing users to share camera, microphone, and screen streams without setup, through point of view (POV) streams, audio streams, and annotation streams, using a processor-driven configuration that allows seamless synchronization of senses.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If manual setup and acceptance processes are implemented for AR device connectivity, then connection reliability is improved, but ease of operation deteriorates
Solution Approach 1:
The system performs preliminary actions by automatically establishing connections between AR devices without requiring manual setup. The processor-driven configuration proactively manages connection parameters, authentication, and synchronization before users need to interact, thereby eliminating friction while maintaining reliable connections through pre-configured protocols
2Ease of operation
If seamless hyper-connection is implemented between AR devices, then ease of operation is improved, but device complexity increases
Solution Approach 1:
The patent introduces a communication interface and processor-driven configuration system that acts as an intermediary between users and the complex underlying connectivity infrastructure. This intermediary layer handles the complexity of hyper-connection protocols, device synchronization, and resource management internally, while presenting a simplified interface to users through automatic connection establishment
3Productivity
If real-time synchronization of senses is enabled, then productivity is improved, but use of energy increases
Solution Approach 1:
The system implements periodic action by synchronizing audio, video, and annotation streams at optimized intervals rather than continuously. The processor manages data transmission in synchronized periods, allowing real-time collaboration experience while reducing overall energy consumption through intermittent rather than constant data flow between devices
Data Source
AI summary
Systems and methods are described for selectively sharing audio and video streams amongst electronic eyewear devices. Each electronic eyewear device includes a camera arranged to capture a video stream in an environment of the wearer, a microphone arranged to capture an audio stream in the environment of the wearer, and a display. A processor of each electronic eyewear device executes instructions to establish an always-on session with other electronic eyewear devices and selectively shares an audio stream, a video stream, or both with other electronic eyewear devices in the session. Each electronic eyewear device also generates and receives annotations from other users in the session for display with the selectively shared video stream on the display of the electronic eyewear device that provided the selectively shared video stream. The annotation may include manipulation of an object in the shared video stream or overlay images registered with the shared video stream.