Data Glasses Head Pose Calculation Using Sensor Fusion

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current data glasses for driver assistance systems face challenges in accurately calculating the head pose due to the superimposition of head motion and vehicle motion, leading to incorrect display of virtual elements when the vehicle accelerates or corners, resulting in a distorted image excerpt.

Innovation Solution

The proposed solution involves a special processor unit in the data glasses that implements a Kalman filter for sensor fusion, combining motion data from both the glasses' measurement unit and the vehicle's measurement unit to accurately calculate the head pose, using an additional glasses measurement unit for absolute head pose calculation and image analysis to correct for vehicle acceleration effects, and smoothing motion data to enhance stability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If motion data from both glasses measurement unit and vehicle measurement unit are combined using sensor fusion with Kalman filter, then head pose calculation accuracy is improved, but device complexity increases

Engineering Contradiction:

Improvehead pose calculation accuracyVSAvoidprocessor unit complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The system divides the measurement task into two independent measurement units: one in the glasses for head motion and one in the vehicle for vehicle motion. This segmentation allows each unit to specialize in measuring specific motion components, improving overall accuracy while enabling modular processing through sensor fusion.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The Kalman filter acts as an intermediary that combines measurements from both measurement units. It processes the raw data from the glasses measurement unit and the vehicle measurement unit, separating head motion from vehicle motion to produce accurate head pose calculations without requiring direct complex interaction between the measurement units.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Measurement precision

If additional glasses measurement unit is used for absolute head pose calculation, then measurement precision is improved, but loss of time increases due to additional processing

Engineering Contradiction:

Improvehead pose accuracyVSAvoidprocessing time

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The glasses measurement unit continuously measures head motion and pre-calculates absolute head pose data using image analysis from the additional measurement unit. This preliminary calculation ensures that accurate head pose data is ready when needed, reducing processing delays during actual display updates.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system maintains continuous measurement and processing of head pose data through the additional glasses measurement unit. By continuously analyzing images and calculating absolute head pose, the system ensures uninterrupted accurate data flow, eliminating the need for periodic recalibration or batch processing that would cause time losses.

Inventive Principle:

Principle #20Continuity of useful action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach provides a highly accurate and stable head pose calculation, enabling a true Augmented Reality experience by correctly positioning virtual information within the driver's field of view, independent of vehicle motion and acceleration.

Implementation Method 1

a special processor unit which implements a Kalman filter for sensor fusion, combining motion data from both the glasses' measurement unit and the vehicle's measurement unit to accurately calculate the head pose

Methodology Applied

Scientific EffectSensor fusion:

Implementation Method 2

using an additional glasses measurement unit for absolute head pose calculation and image analysis to correct for vehicle acceleration effects

Methodology Applied

Scientific EffectImage analysis: Image Processing

Data Source

PatentUS10775634B2Method for calculating the movement data of the head of a driver of a transportation vehicle, data glasses and transportation vehicle for use in the method, and computer program

Publication Date: 2020.09.15 VOLKSWAGEN AG

AI summary

A method for calculating the motion data of the head of a driver of a transportation vehicle wherein the driver is wearing a pair of data glasses. The data glasses are equipped with at least one glasses measurement unit which detects the movements of the head of the driver. The transportation vehicle is equipped with a transportation vehicle measurement unit which detects at least the accelerations of the transportation vehicle. The measured accelerations of the transportation vehicle are transferred wirelessly to the data glasses. The calculation of the head pose is carried out in a special processor unit of the data glasses which includes an implementation of a Kalman filter in which the motion data of the glasses measurement unit, corrected by the motion data of the transportation vehicle measurement unit, are merged with the motion data of an additional glasses measurement unit.