Aerial Sensor Feedback for Occlusion-Robust VR Body Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual, augmented, and mixed reality systems face challenges in accurately tracking the user's body position, leading to discrepancies between actual and perceived physical stimuli, which affects the immersive experience.
Innovation Solution
A system comprising a sensor array on aerial vehicles that monitor the user's body position, a physical feedback mechanism, and a controller to provide synchronized physical feedback, allowing for accurate determination and rendering of the user's position, including occluded surfaces, using a combination of sensors and aerial vehicle repositioning for optimal imaging.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If cameras are used to determine user body position, then the system can provide physical feedback, but the tracking accuracy deteriorates when body parts are occluded
Solution Approach 1:
The system segments the sensing function across multiple aerial vehicles, each equipped with sensors to monitor specific body parts. This distributed segmentation allows continuous tracking even when individual body parts are occluded, as other sensors can compensate and maintain overall position accuracy.
Solution Approach 2:
Aerial vehicles serve as intermediaries between the user and the tracking system. These mobile platforms carry sensors that can dynamically position themselves to maintain line of sight with body parts, acting as mediators that overcome occlusion problems inherent in fixed camera systems.
2Device complexity
If fixed cameras are used for tracking, then the system structure is simple, but the ability to track occluded body parts deteriorates
Solution Approach 1:
The system transitions from static fixed cameras to dynamic aerial vehicles that can move and reposition themselves. This dynamic capability allows the sensors to maintain optimal viewing angles and line of sight with body parts, significantly improving tracking precision for occluded regions while accepting increased system complexity.
3Measurement precision
If aerial vehicles are deployed to improve tracking, then occluded body parts can be monitored, but the system complexity and cost increase
Solution Approach 1:
The aerial vehicles are designed as multi-functional units that combine sensor arrays, navigation capabilities, and communication systems. This universality allows a single platform to perform multiple functions (tracking, positioning, data transmission), reducing overall system complexity compared to having separate specialized components for each function.
Data Source
AI summary
A system is disclosed, comprising an array of sensors disposed on a plurality of aerial vehicles, a sensor array controller for controlling the plurality of aerial vehicles, a physical feedback mechanism for providing physical feedback to a user, the physical feedback mechanism being configured to be worn on the user's body, and a feedback controller. The sensor array controller is configured to reposition the plurality of aerial vehicles so as to provide a line of sight between each one of the plurality of sensors and a respective part of the user's body monitored by said one of the plurality of sensors. The feedback controller is configured to determine a current position of the user's body based on information obtained using the plurality of sensors, and to control the physical feedback mechanism to provide physical feedback to the user in dependence on the determined position of the user's body.