HMD Positioning via GNSS Compensation for AR Display

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current Head-Up Displays (HUDs) and Head-Mounted Displays (HMDs) for vehicles lack precision and accuracy in determining the driver's field of view and displaying augmented reality images, requiring complex hardware and software implementations and high computational resources, which affects driving safety and efficiency.

Innovation Solution

A method and system using a wearable HMD with at least two cameras and reference elements inside the vehicle to determine the HMD's position and orientation with precision, allowing for accurate display of augmented reality images without the need for external sensors, using GNSS data and processing unit to compensate for display errors, and enabling real-time operation with reduced computational costs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If complex hardware and software implementations are used to determine the driver's field of view, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvefield of view determination precisionVSAvoidhardware and software complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces a positioning module as an intermediary device that uses GNSS technology to determine the HMD's position and orientation. This mediator translates complex field of view analysis into simple position coordinates, resolving the contradiction by providing precise measurement through an intermediate positioning layer rather than direct complex analysis

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces complex mechanical and software-based field of view detection systems with a GNSS-based positioning system. By substituting the mechanical/optical tracking mechanisms with satellite-based positioning, the system achieves high precision while dramatically reducing hardware and software complexity

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If external sensors are used to determine HMD position, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
ImproveHMD position determination precisionVSAvoidsensor system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts the positioning function from the HMD device itself and relocates it to a separate positioning module using GNSS technology. This extraction removes the need for complex external sensors on the HMD while maintaining high position determination precision, as the positioning module independently handles the measurement function

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The positioning module serves multiple functions: it determines the HMD's position, calculates the driver's field of view, and provides data for augmented reality image projection. This multi-functionality eliminates the need for separate external sensors, reducing device complexity while maintaining measurement precision

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If high computational resources are allocated to calculate HMD orientation, then measurement precision is improved, but productivity decreases

Engineering Contradiction:
ImproveHMD orientation calculation precisionVSAvoidreal-time processing efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent replaces computationally intensive mathematical calculations for orientation determination with direct GNSS coordinate data. By substituting complex calculation mechanisms with satellite-based positioning, the system achieves high orientation precision while maintaining real-time processing efficiency

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the fundamental parameter used for orientation calculation from complex sensor data analysis to simple GNSS position coordinates. This parameter transformation reduces computational complexity from high-dimensional data processing to basic coordinate transformation, improving both precision and real-time performance

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentEP4034841B1Method and system of vehicle driving assistance
Publication Date: 2024.10.30 POLITECNICO DI MILANO
  • EP4034841B1 patent drawingFigure 1
  • EP4034841B1 patent drawingFigure 2
  • EP4034841B1 patent drawingFigure 3

AI summary

The present invention relates to a method (900) for assisting the driving of a vehicle (5). The method (900) can be implemented by a relative system (1) comprising an HMD (10), and a positioning module (20) mounted on the vehicle (5). In particular, the method (900) comprises the steps of: detecting (919) a vehicle position by means of the positioning module (20); determining (921) a position of the HMD (10) by applying a compensation law to the vehicle position, based on the position of the HMD (10), determining (923) a view volume (VOL) corresponding to a volume of space comprised in the field of view (FOV) of the HMD (10); comparing (925) a set of positions comprised in the view volume (VOL) with at least one position of interest (PW1-3) associated with an object of interest (WP1-3) stored in a memory area (31) of the system (1), and if one or more positions of interest (PW1-3) are in the view volume (VOL), calculating (927) a visualization position (PA1-3) of the HMD (10) in which to display an image (AR1-3) associated with the object of interest (WP1-3) and displaying on the HMD (10) the image (AR1-3) in said visualization position (PA1-3). The visualization position (PA1-3) is such that a user wearing the HMD (10) sees the image (PA1-3) in correspondence of the object of interest (WP1-3).