Vehicle HMD Pose Tracking Using Projected Light Patterns
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 6DOF algorithms for head-mounted displays (HMDs) face challenges in low light, featureless, and unpredictable environments, particularly in vehicles with windows or sunroofs, leading to disrupted head tracking in mixed or augmented reality experiences.
Innovation Solution
A system comprising a head-mounted display with adjustable optical elements and a light generation device that projects light patterns onto vehicle surfaces, allowing image-based head pose determination even in challenging conditions, combined with inertial measurement units to filter noisy motion data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If 6DOF algorithms use near-IR monochrome computer vision with inertial measurements for head tracking, then head tracking can be implemented, but performance deteriorates in challenging environments such as low light spaces, featureless spaces, and vehicle movements with unpredictable nature and high acceleration
Solution Approach 1:
The patent introduces an intermediary light generation device that projects light patterns onto the environment to create artificial features. This intermediary element mediates between the HMD's imaging system and the challenging environment, providing reliable tracking references even when natural features are absent or insufficient. The light patterns act as synthetic landmarks that enable consistent head pose estimation across diverse and difficult conditions.
Solution Approach 2:
The system dynamically adjusts operational parameters based on environmental conditions. When entering low light or featureless environments, the light generation device activates to modify the visual landscape, creating artificial features that change the photometric parameters of the scene. This parameter change enables the imaging system to maintain tracking capability in previously unsuitable conditions.
2Speed
If HMD uses motion data from sensors for head pose determination, then tracking speed is improved, but noise in motion data disrupts tracking accuracy in unpredictable environments
Solution Approach 1:
The system implements feedback mechanisms where the processor continuously monitors the quality of motion data and light pattern detection. When noise levels exceed thresholds or tracking accuracy deteriorates, the system switches to alternative data sources or adjusts processing parameters. This feedback loop maintains precision by adapting to changing data quality conditions while preserving speed through intelligent data fusion strategies.
Solution Approach 2:
The patent applies different processing quality levels to different data sources based on their reliability. High-quality motion data is processed with full precision, while noisy or unreliable data is processed with reduced precision or discarded. This local quality differentiation allows the system to maintain overall tracking speed while preserving accuracy in critical measurements by focusing computational resources on reliable data sources.
3Area of stationary object
If HMD operates in vehicles with windows or sunroofs providing direct light of sight outdoors, then field of view is improved, but heading tracking becomes particularly challenging due to the unpredictable nature of vehicle movements and high acceleration
Solution Approach 1:
The light generation device serves as an intermediary that creates stable reference frames within the vehicle interior. By projecting light patterns onto surfaces inside the vehicle, the system establishes reliable tracking targets that are not affected by vehicle motion. This intermediary reference system allows the HMD to maintain accurate heading tracking even when the vehicle experiences high acceleration or unpredictable movements, while still benefiting from the expanded field of view provided by windows and sunroofs.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate and stable head pose tracking in low light, featureless, and unpredictable environments by using projected light patterns and optical elements to redirect camera views, improving the reliability of mixed or augmented reality experiences.
Implementation Method 1
a light generation device that projects light patterns onto vehicle surfaces
Implementation Method 2
adjustable optical elements and a light generation device that projects light patterns onto vehicle surfaces, allowing image-based head pose determination
Data Source
AI summary
A light generation device (LGD) includes an attachment configured to couple the LDG to a surface of an interior of a vehicle, a sensor configured to capture motion data of the LGD, a plurality of light projectors configured to generate a plurality of light patterns within the interior, a memory, and a processor operatively coupled to the sensor and the memory. The processor is configured to cause the plurality of light patterns to be generated within the interior via the plurality of light projectors, and send the motion data to a head mounted display (HMD) that determines a pose associated with the HMD after receiving the motion data based on at least one of the motion data or image data (1) that is captured by the HMD and (2) that includes a representation of at least some patterns from the plurality of light patterns.