Wearable Sensor Tracking for Low-Power XR Object Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Extended reality (XR) devices face challenges in tracking objects efficiently due to high power consumption and privacy concerns from multiple cameras, which can limit their functionality and user experience.
Innovation Solution
A wearable accessory with embedded sensors, such as a ring, bracelet, or glove, provides tracking measurements to the XR device, enhancing tracking accuracy and reducing power consumption by adjusting camera operations based on the wearable's position and visibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple cameras are used for tracking objects in XR devices, then tracking accuracy is improved, but power consumption increases
Solution Approach 1:
The system uses a subset of available cameras rather than all cameras continuously. The wearable accessory provides tracking measurements that allow the XR device to use only one or two cameras for tracking instead of multiple cameras, reducing power consumption while maintaining adequate tracking accuracy through sensor fusion
Solution Approach 2:
A wearable accessory with embedded sensors acts as an intermediary between the user and the XR device. It provides additional tracking measurements (position, orientation, movement) that supplement camera data, allowing the system to reduce camera usage while maintaining or improving tracking accuracy through multi-source data fusion
2Adaptability or versatility
If multiple cameras are used for tracking objects, then tracking coverage is improved, but privacy concerns increase
Solution Approach 1:
The wearable accessory serves as an intermediary that collects tracking data locally on the user's body and transmits only essential tracking measurements to the XR device. This eliminates the need for multiple cameras to capture visual data, maintaining tracking coverage while reducing privacy concerns by avoiding visual recording
Solution Approach 2:
The system replaces optical/mechanical camera-based tracking with sensor-based tracking using accelerometers, gyroscopes, and other motion sensors in the wearable accessory. This substitution maintains tracking coverage and adaptability while eliminating the privacy issues associated with camera-based visual capture
3Reliability
If cameras operate continuously for tracking, then tracking reliability is improved, but power consumption increases
Solution Approach 1:
Instead of continuous camera operation, the system uses periodic sensor measurements from the wearable accessory combined with intermittent camera updates. The wearable sensors continuously provide reliable tracking data with low power consumption, while cameras operate periodically to refresh visual context and maintain overall tracking reliability
Solution Approach 2:
The wearable accessory with embedded sensors acts as a reliable intermediary tracking source that operates independently of camera power state. It provides continuous motion and position data that maintains tracking reliability even when cameras are powered down or operated intermittently to save energy
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
Systems, methods, and non-transitory media are provided for tracking operations using data received from a wearable device. An example method can include determining a first position of a wearable device in a physical space; receiving, from the wearable device, position information associated with the wearable device; determining a second position of the wearable device based on the received position information; and tracking, based on the first position and the second position, a movement of the wearable device relative to an electronic device.