AR Device Pairing via Machine-Readable Optical Label for Coordinate Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) devices face challenges in sharing AR experiences due to differences in their reference coordinate systems, leading to inconsistencies in the display of virtual objects across multiple devices.
Innovation Solution
A system that enables AR devices to pair and share AR experiences by aligning their coordinate systems using machine-readable codes. These codes encode pose data from one device, which is then decoded and used to determine the relative pose between devices, allowing for alignment of their VIO reference frames.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If each AR device uses its own independent 6DoF tracker and reference coordinate system, then each device can independently track and display virtual content, but sharing AR experiences between multiple devices becomes difficult and virtual objects appear differently across devices
Solution Approach 1:
The patent introduces a machine-readable code as an intermediary object that contains encoded pose data. This code serves as a mediator between devices with different coordinate systems, allowing them to exchange and align their spatial reference information without requiring direct complex communication protocols between the trackers themselves
Solution Approach 2:
The patent copies pose data from one device's coordinate system into a machine-readable code format that can be read and interpreted by other devices. This copying mechanism allows the transfer of spatial reference information across devices with different native coordinate systems, enabling them to understand each other's spatial references
2Ease of operation
If AR devices use different reference coordinate systems for tracking, then each device maintains its own coordinate independence, but virtual objects displayed across multiple devices appear inconsistent and misaligned
Solution Approach 1:
The patent changes the parameter representation by encoding pose data (position and orientation parameters) into a machine-readable code format. This transformation allows coordinate information from different devices to be standardized and compared, enabling alignment while preserving the independence of each device's native coordinate system
3Adaptability or versatility
If AR devices establish a common reference coordinate system for shared experiences, then virtual objects can be consistently displayed across devices, but the complexity of coordinate system alignment and communication increases
Solution Approach 1:
The machine-readable code acts as a simplified intermediary that encapsulates complex pose data in an easily readable format. This mediator handles the complexity of coordinate transformation internally, presenting a simple scanning and decoding interface to users while managing the sophisticated coordinate alignment processes in the background
Data Source
AI summary
A method for aligning coordinate systems from separate augmented reality (AR) devices is described. In one aspect, a first device accesses first pose data from a first Visual Inertial Odometry (VIO) system of the first device. A camera of the first device captures an image of a machine-readable code that is displayed on a display of a second device. The second device encodes the machine-readable code with second pose data from a second VIO system of the second device. The first device decodes the second pose data from the machine-readable code, and determines a relative pose between the first device and the second device based on the first pose data and the second pose data.