AR Eyewear Hand Tracking Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) systems face limitations in aligning multiple mobile devices without the use of stationary alignment markers, which restricts their flexibility and applicability in various environments.
Innovation Solution
The use of somatic alignment markers, such as the joints and connectors of a hand, allows user devices to dynamically align with a common reference coordinate system, enabling alignment in any location without predefined markers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If stationary alignment markers are used to align multiple mobile devices, then alignment precision can be achieved, but the system loses flexibility and applicability in various environments
Solution Approach 1:
The patent transforms the alignment system from static (stationary markers) to dynamic (hand-based somatic markers). Users can perform hand gestures that are captured by cameras, allowing the alignment reference to move and adapt to different environments while maintaining precision through real-time tracking of hand joint positions and orientations.
Solution Approach 2:
The patent introduces hand gestures as an intermediary between users and the alignment system. Instead of requiring environmental markers, the system uses the user's hand as a portable reference object, mediated through camera capture and processed via machine learning to extract joint positions and orientations for alignment calculations.
2Measurement precision
If stationary alignment markers are required for device alignment, then alignment accuracy is maintained, but device complexity and setup requirements increase
Solution Approach 1:
The system enables users to perform alignment themselves using their own hands as reference markers. The machine learning model automatically detects hand joint positions and orientations from camera images, eliminating the need for external alignment tools or complex setup procedures while maintaining alignment accuracy through automated feature extraction and pose estimation.
Solution Approach 2:
The hand-based alignment system serves multiple functions: it acts as an alignment reference, a user interface for initiating alignment, and a portable marker that works in any environment. The same hand gesture can be used across different devices and settings, reducing system complexity while maintaining alignment accuracy through a universal alignment mechanism.
Data Source
AI summary
A method for aligning coordinate systems of user devices in an augmented reality system using somatic points of a user's hand as alignment markers. Images captured from multiple user devices are used to align the reference coordinate systems of the user devices to a common reference coordinate system. In some examples, user devices capture images of a hand of a user and use object recognition to identify somatic points as alignment markers. The somatic points of a user device are translated to a common reference coordinate system determined by another user device.