Distributed AR Bracelet Hand Tracking Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented reality (AR) systems face challenges in providing sufficient power and computation due to their reduced form factor, limiting the capacity for enhancing user experience and integrating hand gestures within the environment, as they often rely on headset devices that cannot capture hand movements effectively.
Innovation Solution
A distributed AR system comprising a bracelet device with position sensors, cameras, and magnetic sensors that track hand motions and contextualize them within the user's environment, combined with an eyewear device and neckband for processing and power distribution, allowing for immersive and responsive AR experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Weight of moving object
If AR systems use reduced form factor headset devices, then user comfort and tolerance are improved, but power and computation capacity deteriorate
Solution Approach 1:
The system divides the AR system into multiple independent devices: a lightweight headset for visual output, a bracelet device for hand tracking, and a neckband device for computation and power management. This segmentation allows each component to be optimized for its specific function while distributing the overall power and computation requirements across multiple devices, resolving the contradiction between lightweight design and sufficient power capacity.
2Volume of moving object
If headset devices have limited field of view, then device size is reduced, but hand gesture capture capability deteriorates
Solution Approach 1:
The hand tracking functionality is extracted from the headset device and implemented in a separate bracelet device worn on the user's wrist. This extraction allows the headset to maintain its compact size with limited field of view while the bracelet device, positioned near the hands, provides dedicated hand gesture capture capability without compromising either function.
3Device complexity
If conventional hand tracking systems focus only on capturing hand movements, then system complexity is reduced, but contextual understanding of hand motions deteriorates
Solution Approach 1:
The system merges hand tracking data from the bracelet device with environmental context data from the headset's field of view and other system sensors. The neckband device integrates these multiple data streams to provide contextual understanding of hand motions, such as determining whether a pointing gesture is directed at a relevant object in the environment. This merging enables rich contextual interpretation while distributing processing complexity across the distributed system.
Data Source
AI summary
A system includes an eyewear device configured to present content to a user. A processor is communicatively coupled to the eyewear device. A bracelet device includes a first tracking sensor configured to determine a position signal in response to movement of the user's hand. The bracelet device is communicatively coupled to the processor. The processor determines a pose of the user's hand based in part on the position signal.