Head-Mounted Display Tracking Mode Switching by Motion Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing head-mounted displays struggle to accurately switch between hand and controller tracking modes when the controller is not in a static state, leading to inaccurate hand tracking and reduced user experience due to blocking and misidentification.
Innovation Solution
A head-mounted display system that includes an image capturing device and processor to calculate motion information for both the controller and tracked hand, dynamically determining the appropriate tracking mode based on their motion relationship, adjusting display content accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the controller is attached to the user and moves together with the user, then the controller is not in a static state, but the existing technology cannot correctly switch the tracking mode
Solution Approach 1:
The system dynamically determines tracking mode by analyzing the motion relationship between controller and hand in real-time, rather than relying on static state detection. The processor continuously calculates motion information and switches modes based on dynamic motion relationships, enabling accurate tracking whether the controller is stationary or moving with the user.
Solution Approach 2:
The patent replaces the mechanical/static state detection method with an image processing and motion analysis system. Instead of detecting whether the controller is physically stationary, the system uses image capturing devices to calculate motion information and determine tracking modes based on visual data analysis.
2Adaptability or versatility
If the hand tracking mode and the controller tracking mode are turned on at the same time, then the controller may block part of the hand image, but this causes inaccurate hand tracking pose data
Solution Approach 1:
The system dynamically switches between hand tracking mode and controller tracking mode based on the motion relationship between the controller and hand. When the controller blocks the hand, the system automatically transitions to controller tracking mode, maintaining continuous and accurate tracking without the precision loss that would occur from simultaneous mode operation.
Solution Approach 2:
The system extracts and separates the tracking functions into distinct modes rather than operating them simultaneously. By taking out the hand tracking and controller tracking as separate, mutually exclusive modes, the system eliminates the problem of the controller blocking the hand image while maintaining the ability to track either the hand or the controller independently.
3Device complexity
If the existing technology determines tracking mode based on static state, then the switching is simple, but it fails when the controller is not static
Solution Approach 1:
The patent replaces the simple static state detection mechanism with an image processing-based motion analysis system. The processor calculates motion information from captured images to determine tracking modes, substituting mechanical state detection with optical field analysis to achieve both simplicity and reliability.
Solution Approach 2:
The system introduces motion information calculation as an intermediary step between image capture and tracking mode determination. Rather than directly detecting static state, the processor calculates motion information from sequential images, providing a reliable bridge that accurately reflects the controller's state regardless of whether it is static or moving.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A head mounted display and a tracking mode switching method are provided. The head mounted display calculates a first motion information corresponding to a controller and a second motion information corresponding to a tracked hand based on the real-time images. The head mounted display determines to switch to a hand-held controller tracking pose mode or a hand tracking pose mode based on a motion relationship between the controller and the tracked hand.