Vehicle-Induced Pose Correction for Head-Mounted Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Virtual reality and head-mounted display devices incorrectly report changes in direction when a user is in a moving vehicle, causing the view to shift due to vehicle movements rather than head rotations, leading to user discomfort and incorrect alignment.
Innovation Solution
A method and system that use computer vision and sensors to determine the center pose of an electronic device, track key points in a scene, and adjust the device's pose when a difference is detected between the actual and expected center poses, thereby correcting for vehicle-induced changes in direction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If sensors in the HMD or mobile device are used for head orientation tracking, then head rotation can be detected, but vehicle-induced motion is incorrectly reported as head rotation causing view shift and misalignment
Solution Approach 1:
The patent introduces an intermediary system consisting of external cameras and computer vision algorithms that mediate between the sensors and the final orientation output. The external cameras capture visual features in the environment, and the computer vision system processes these features to determine vehicle motion, which then compensates for the sensor-reported head orientation to produce accurate tracking even during vehicle turns
Solution Approach 2:
The system implements feedback by continuously monitoring the discrepancy between sensor-reported head orientation and visually-determined orientation. When vehicle motion is detected through computer vision analysis of tracked visual features, the system generates compensatory adjustments that feed back into the orientation calculation, correcting the view shift caused by vehicle-induced motion
2Measurement precision
If the HMD view is corrected for vehicle motion, then accurate head tracking is maintained, but additional sensors and processing are required
Solution Approach 1:
The patent makes the mobile device serve multiple functions: it acts as both the rendering device for the virtual/augmented reality experience and the computer vision processing unit for vehicle motion detection. The mobile device's existing camera and processor are leveraged to perform dual roles, eliminating the need for separate dedicated vehicle motion sensing hardware and reducing overall system complexity
Solution Approach 2:
The system uses the mobile device's own resources (camera, processor, sensors) to detect and compensate for vehicle motion affecting the HMD. The mobile device essentially services its own ecosystem by providing computer vision-based motion detection that benefits the connected HMD, without requiring external third-party systems
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
A method to correct for a vehicle induced change of direction in an electronic device is described. The method comprises determining a first center pose of the electronic device, and determining when a motion of the electronic device is caused by a vehicle. At least one key point within a scene can be tracked, using a sensor in conjunction with computer vision operating on a processor, to determine a second center pose. It is then determined whether the second center pose is within a tolerance with respect to the first center pose; and the second center pose is adjusted when there is a difference between the second center pose and the first center pose.