Optical Head Pose Mapping With Multi-Density Fiducials

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing head tracking systems for head-worn displays face challenges in achieving high-integrity head pose estimation due to the reduced detectability of high-density fiducials, which are difficult to capture with sufficient pixel accuracy, leading to potential inaccuracies in safety-critical applications.

Innovation Solution

A system utilizing a combination of medium-density and low-density fiducials, where medium-density fiducials include encoded identifiers and low-density fiducials provide positional information, enabling high-integrity head pose estimation through a processor that determines the head pose by combining 2D image data with a 3D constellation database.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If high-density fiducials are used to increase correspondence integrity, then measurement precision is improved, but detectability deteriorates

Engineering Contradiction:
Improvehead pose estimation accuracyVSAvoidfiducial detectability
Core Design Contradiction:
Measurement precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The patent divides the fiducial system into multiple separate fiducials with medium-density encoding rather than using a single high-density fiducial. This segmentation allows each individual fiducial to remain detectable while the collection provides sufficient correspondence integrity through their combined unique identifiers and spatial relationships.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different fiducials are assigned different density levels (medium-density with encoded identifiers versus low-density without encoded identifiers) based on their specific roles in the system. Medium-density fiducials provide identification while low-density fiducials provide positional reference, optimizing detectability for each type's function.

Inventive Principle:
Principle #3Local quality

2Loss of information

If the density of bits within an individual fiducial is increased, then correspondence integrity is improved, but detectability deteriorates

Engineering Contradiction:
Improvecorrespondence integrityVSAvoidpixel accuracy
Core Design Contradiction:
Loss of informationVSDifficulty of detecting and measuring

Solution Approach 1:

The information encoding is segmented across multiple fiducials rather than concentrated in a single high-density fiducial. Each medium-density fiducial contains some encoded information, and the complete correspondence integrity is achieved through the combination of identifiers from multiple fiducials plus their spatial arrangement.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transitions from relying solely on high bit-density within individual fiducials to using spatial dimension information (positions and orientations of multiple fiducials in 3D space) as an additional layer of encoding. This dimensional approach maintains detectability while achieving correspondence integrity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Difficulty of detecting and measuring

If multiple fiducials are used instead of a single high-density fiducial, then detectability is improved, but device complexity increases

Engineering Contradiction:
Improvefiducial detectabilityVSAvoidfiducial system complexity
Core Design Contradiction:
Difficulty of detecting and measuringVSDevice complexity

Solution Approach 1:

Multiple fiducials share common detection and processing mechanisms, allowing the system to handle multiple fiducials using the same algorithmic approach. This universality reduces the complexity increase that would otherwise result from having multiple distinct fiducial types.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent uses fiducials with similar visual characteristics and detection properties (medium-density encoding scheme) rather than mixing vastly different fiducial types. This homogeneity simplifies the detection and processing system while still achieving the needed correspondence integrity through multiple fiducials.

Inventive Principle:
Principle #33Homogeneity

Data Source

PatentEP4209826B1High-confidence optical head pose correspondence mapping with multiple markers for high-integrity headtracking on a headworn display (HWD)
Publication Date: 2025.12.10 ROCKWELL COLLINS INC
  • EP4209826B1 patent drawingFigure 1
  • EP4209826B1 patent drawingFigure 2
  • EP4209826B1 patent drawingFigure 3A~3B

AI summary

A system and method for high integrity head pose estimation receives a 2D image including medium-density fiducials (302) and low-density fiducials (304). The system then detects the medium-density fiducials (302) and compares them with a 3D constellation to form an initial head pose estimate. The initial head pose estimate is then checked for possible alternative correspondences. A selection from a set of candidate initial head pose estimates is made. The selected head pose estimate then has search areas established for the medium-density fiducials (302) and low-density fiducials (304). The system then determines whether or not the head pose is valid and accurate based on whether or not the fiducials appear in their respective search areas.