AR Windshield Maneuver Markers for Low-Cognitive Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current head-up displays in vehicles are limited in their ability to provide easily perceptible navigation markings, especially at a distance, as they often require cognitive effort to interpret virtual information in the context of the real scene, and existing augmented reality solutions struggle to project clear, stationary markers on the road surface for upcoming maneuvers.

Innovation Solution

An augmented reality display device projects a target maneuver marker that stands vertically on the lane to be traveled, positioned at the edge of the lane, allowing it to be clearly visible from a distance, and can increase in size and include additional navigation information or animations as the vehicle approaches the maneuver location, ensuring the driver can reliably recognize the required action.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If navigation information is displayed as virtual images in conventional head-up displays, then the driver's field of vision is enriched with navigation data, but the driver must interpret and transfer this information to the real situation, increasing cognitive load

Engineering Contradiction:
Improvenavigation information deliveryVSAvoidcognitive processing requirement
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent uses augmented reality to project virtual navigation markers that are spatially registered with the real-world road scene. Instead of displaying abstract virtual images that require interpretation, the system creates visual copies of navigation instructions directly overlaid on the corresponding physical locations (e.g., turning arrows projected on the road surface at the turn location), enabling immediate intuitive understanding without cognitive transfer

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transitions from two-dimensional conventional HUD displays to three-dimensional spatially registered augmented reality projections. Virtual markers are positioned at specific depths and locations in the driver's field of vision, creating a multi-layered display where navigation information exists in the same spatial dimension as the real road scene, enhancing intuitive comprehension

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of time

If navigation markers are projected at a distance to provide advance warning, then the driver has more time to prepare for maneuvers, but the markers become difficult to perceive and may have only a few pixels height

Engineering Contradiction:
Improveadvance warning timeVSAvoidmarker visibility
Core Design Contradiction:
Loss of timeVSDifficulty of detecting and measuring

Solution Approach 1:

The patent implements dynamic marker sizing and positioning that adapts to the vehicle's distance from the maneuver location. As the vehicle approaches, markers are updated at different rates and their visual size is adjusted to maintain optimal visibility. The system also dynamically repositions markers to account for the vehicle's motion, ensuring they remain clearly visible throughout the approach phase

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent projects navigation markers at multiple distance levels in advance of the actual maneuver location. Long-range markers provide early warning at greater distances, while intermediate and close-range markers are projected progressively as the vehicle approaches, creating a staged warning system that maintains visibility across all distance phases

Inventive Principle:
Principle #10Preliminary action

3Device complexity

If the display area is limited to directly below the driver's primary field of vision, then the display technology is simpler to implement, but the information cannot be registered in the real scene and requires more head and eye movements

Engineering Contradiction:
Improvedisplay system complexityVSAvoidhead and eye movement requirement
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The patent employs the windscreen as a universal projection surface that serves both as the vehicle's protective barrier and as the display medium for augmented reality navigation information. By utilizing this existing component for dual purposes, the system expands the display area across the entire windscreen surface without adding separate display hardware, thereby reducing overall system complexity while enabling wide-field information presentation

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent transitions from a limited two-dimensional display area directly below the driver's view to a three-dimensional augmented reality display that spans the entire windscreen surface. Virtual markers are projected at various depths and positions across the windscreen, creating a multi-layered spatial display that covers the driver's entire field of vision, eliminating the need for head and eye movements to locate information

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

4Ease of operation

If maneuver arrows are displayed as a virtual crash barrier, then the driver's attention is captured, but the display still requires interpretation and does not provide contact-analogous marking of the road

Engineering Contradiction:
Improvedriver attention captureVSAvoidintuitive scene registration
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent creates visual copies of road markings and navigation instructions that are spatially registered with the actual road scene. Virtual markers such as turning arrows and lane guidance lines are projected to appear as if they are physically present on the road surface, providing contact-analogous marking that directly corresponds to the real-world geometry, enabling intuitive understanding without interpretation

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent uses the windscreen as an intermediary medium to project augmented reality markers that bridge the gap between the driver and the real road scene. The projection system creates virtual images that appear to exist in the driver's field of vision at the correct spatial locations, serving as a mediator that overlays navigational guidance directly onto the perceived road environment without requiring the driver to shift attention between separate displays

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution reduces cognitive load by providing a clear, stationary visual anchor for upcoming maneuvers, enhancing driver awareness and reducing the need for continuous display updates during turns, even when the maneuver location is obscured.

Implementation Method 1

The light beams of a display built into the dashboard are folded over several mirrors and lenses and reflected into the driver's eye via a projection surface

Methodology Applied
Scientific EffectReflection: Reflection

Implementation Method 2

The light beams of a display built into the dashboard are folded over several mirrors and lenses and reflected into the driver's eye via a projection surface

Methodology Applied
Scientific EffectRefraction: Refraction

Data Source

PatentEP3765324B1Method, device and computer-readable storage medium with instructions for controlling a display of an augmented reality display device for a motor vehicle
Publication Date: 2023.09.06 VOLKSWAGEN AG
  • EP3765324B1 patent drawingFigure 1~2
  • EP3765324B1 patent drawingFigure 3~4
  • EP3765324B1 patent drawingFigure 5~6

AI summary

The invention relates to a method, a device and a computer-readable storage medium with instructions for controlling a display of an augmented reality display device for a motor vehicle. In a first step (10), a manoeuvre scheduler determines a target manoeuvre of the motor vehicle. In addition, an execution location of the target manoeuvre is determined (11). The graphics generator generates (12) a target manoeuvre marking for a display by the augmented reality display device on the basis of said information. The target manoeuvre marking is finally outputted (13) for display by the augmented reality display device. The target manoeuvre marking is displayed in such a way that the target manoeuvre marking is displayed in a stationary manner in the region of the execution location of the target manoeuvre perpendicularly on a lane to be travelled by the motor vehicle.