VR Headset Camera Multiplexing for 6DoF and Hand Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing head-mounted VR all-in-one machines face limitations in 6DoF tracking, eye movement tracking, facial expression recognition, and bare hand recognition, which restrict the tracked field of view and user immersion.
Innovation Solution
The implementation of a head-mounted VR system with multiple cameras positioned strategically on the front cover plate, including four first tracking cameras for 6DoF and bare hand recognition, two second tracking cameras for eye and facial expression tracking, and an IMU sensor, allowing for combined modules for comprehensive tracking and recognition.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If two tracking cameras are used for 6DoF tracking, then device complexity is reduced, but tracked field of view is limited
Solution Approach 1:
The tracking system is segmented into multiple independent camera modules (four first tracking cameras and two second tracking cameras) positioned at different locations. Each camera independently captures a portion of the field of view, and their data is integrated to achieve comprehensive 6DoF tracking coverage.
Solution Approach 2:
The system transitions from a two-camera planar arrangement to a multi-dimensional spatial configuration with cameras positioned at different heights, angles, and locations (front, side, and bottom of the head-mounted device), creating three-dimensional coverage for expanded field of view.
2Adaptability or versatility
If additional gesture recognition trackers are added for bare hand recognition, then tracking capability is improved, but device complexity increases
Solution Approach 1:
The first tracking cameras serve multiple functions: they simultaneously enable 6DoF head tracking and bare hand gesture recognition. This multi-functional design eliminates the need for separate gesture recognition trackers, reducing overall device complexity while maintaining versatile tracking capabilities.
Solution Approach 2:
The system merges the 6DoF tracking function and gesture recognition function into a single camera system. The four first tracking cameras are shared between these two functions, combining what would traditionally require separate hardware into one integrated solution.
3Measurement precision
If more cameras are added for eye and facial expression tracking, then tracking accuracy is improved, but device complexity increases
Solution Approach 1:
Different camera modules are optimized for different tracking purposes: the second tracking cameras are specifically positioned near the eyes for high-precision eye tracking, while the third tracking camera is positioned at the bottom for facial expression tracking. Each camera's position and orientation are locally optimized for its specific function.
Data Source
AI summary
A head-mounted VR all-in-one machine comprises a front cover plate. Four first tracking cameras are arranged on an outer side frame of the front cover plate, two second tracking cameras are respectively arranged at positions on an inner side of the front cover plate that are close to the left eye and the right eye of a user, and a third tracking camera is arranged at a position on the lower bottom of the front cover plate that is close to the mouth of the user, wherein the four first tracking cameras and an IMU sensor form a 6DoF user head tracking module, the two second tracking cameras form a user eyeball tracking module, the two second tracking cameras and the one third tracking camera form a user facial expression recognition module, and the four first tracking cameras form a user bare hand recognition tracking module in a multiplexed manner.