Collaborative AR Eyewear Alignment Using Shared 6DOF Trajectories
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) technologies face challenges in enabling seamless collaborative AR experiences between multiple users without relying on common image content or markers, which can be computationally intensive and require complex global mapping pipelines.
Innovation Solution
The use of ego motion alignment through six degrees of freedom (6DOF) tracker trajectories generated by 6DOF pose trackers, such as visual inertial odometry (VIO) pose trackers, allows eyewear devices to track each other's motion, enabling collaborative AR experiences without the need for shared image content or markers. This approach runs a local odometry system on each device, reducing computational burden and memory requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If common image content or markers are used for collaborative AR alignment, then alignment accuracy is improved, but computational burden and device complexity increase
Solution Approach 1:
The patent extracts the alignment problem from global coordinate system dependency by using local odometry trajectories. Each device independently tracks its own motion through VIO, eliminating the need for complex global mapping pipelines and shared image content while maintaining alignment accuracy through relative motion compensation.
Solution Approach 2:
The patent introduces ego-motion trajectories as an intermediary between devices for alignment. Instead of directly sharing image content or markers, each device shares its computed odometry trajectory, which serves as a lightweight mediator enabling collaborative AR without heavy computational requirements.
2Measurement precision
If global mapping pipelines are used for collaborative AR, then alignment accuracy is improved, but memory requirements and computational resources increase
Solution Approach 1:
The patent segments the collaborative AR system into independent local odometry modules running on each device. Instead of a centralized global mapping pipeline requiring shared memory, each device maintains its own VIO trajectory independently, dramatically reducing memory requirements while preserving alignment accuracy through trajectory sharing.
3Measurement precision
If image sharing is implemented for collaborative AR, then alignment accuracy is improved, but piracy concerns and security risks increase
Solution Approach 1:
The patent uses odometry trajectory copying instead of image sharing. Each device independently computes and shares its motion trajectory data, which is sufficient for alignment but cannot be used to recreate the original visual content, thereby preventing piracy while maintaining alignment accuracy.
Data Source
AI summary
Eyewear providing an interactive augmented reality experience between two eyewear devices by using alignment between respective 6DOF trajectories, also referred to herein as ego motion alignment. An eyewear device of user A and an eyewear device of user B track the eyewear device of the other user, or an object of the other user, such as on the user's face, to provide the collaborative AR experience. This enables sharing common three-dimensional content between multiple eyewear users without using or aligning the eyewear devices to common image content such as a marker, which is a more lightweight solution with reduced computational burden on a processor. An inertial measurement unit may also be used to align the eyewear devices.