VR Headset Gesture Recognition via Shared Infrared Camera
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual and augmented reality head-mounted devices face challenges in efficiently implementing gesture recognition without increasing computational time and maintaining cost-effectiveness while providing accurate six-degrees-of-freedom motion tracking.
Innovation Solution
A head-mounted device equipped with an infrared camera module and an illuminator, configured to operate within a specific bandwidth, along with a control unit that implements both six-degrees-of-freedom and gesture tracking algorithms, using the same camera for both tasks by activating the illuminator at a lower framerate than the camera, allowing for efficient gesture recognition without excessive processing overhead.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If gesture recognition is implemented in VR/AR head-mounted devices, then interaction capability is improved, but computational time and processing load increase
Solution Approach 1:
The patent segments the processing tasks by separating 6DoF motion tracking from gesture recognition. The system uses different algorithms and processing pipelines for each function, allowing parallel execution and reducing overall computational time. Gesture recognition is processed independently from motion tracking, enabling both functions to operate simultaneously without excessive processing overhead.
Solution Approach 2:
The patent employs a universal camera system that serves multiple functions: it captures images for both 6DoF motion tracking and gesture recognition. The same image data stream is utilized by both algorithms, eliminating the need for separate sensors and reducing overall computational burden. This multi-functional approach allows the system to perform gesture recognition without adding excessive processing requirements.
2Adaptability or versatility
If multiple sensors and algorithms are added for gesture recognition, then functionality is improved, but device complexity increases
Solution Approach 1:
The patent uses a single camera system that performs dual functions: 6DoF motion tracking and gesture recognition. The same optical sensor and image processing pipeline are utilized for both purposes, eliminating the need for additional dedicated gesture sensors. This approach maintains functionality while minimizing device complexity.
Solution Approach 2:
The patent merges the gesture recognition processing with the existing motion tracking pipeline. Both algorithms process images from the same camera system and share computational resources. The control unit executes both 6DoF and gesture recognition algorithms using integrated processing, reducing the need for separate hardware components and simplifying the overall device architecture.
3Measurement precision
If high-framerate illuminator is used for gesture tracking, then gesture recognition accuracy is improved, but energy consumption increases
Solution Approach 1:
The patent implements periodic illumination using the infrared LED at the same framerate as the camera capture. The illuminator is activated in synchronization with image acquisition, providing necessary infrared lighting for gesture tracking only when needed. This periodic action ensures adequate illumination for accurate gesture recognition while minimizing energy consumption by keeping the illuminator off between capture cycles.
Solution Approach 2:
The system performs preliminary synchronization between the illuminator and camera shutter. The infrared LED is activated just before each image capture moment, ensuring that the gesture-tracking hand is illuminated when the camera takes the picture. This preliminary action guarantees measurement precision for gesture recognition while limiting energy usage to only the brief moments when illumination is actually required.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution enables reliable and cost-effective gesture recognition in virtual and augmented reality applications, maintaining low computational time and providing accurate motion tracking, while being compatible with existing hardware components.
Implementation Method 1
at least one infrared camera module configured to operate at a predetermined bandwidth, and an illuminator having a wavelength of operation inside the bandwidth of the infrared camera
Data Source
AI summary
A head mounted device for virtual or augmented reality including:a display element configured to display content;at least one infrared camera module configured to operate at a predetermined bandwidth;an illuminator having a wavelength of operation inside the bandwidth of the infrared camera, and having a field of view before the camera module; anda control unit implementing a six degrees of freedom (6DoF) algorithm to determine 6DoF poses from data including image data of the camera module, and implementing a gesture tracking algorithm.