Head-Up Display Image Correction for Vehicle Latency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing head-up display systems experience latency and delay in displaying information, distracting drivers and compromising the quality of visual signaling, particularly due to complex algorithms for object recognition and movement prediction.

Innovation Solution

A method and device that determine a corrected display image based on a predefined three-dimensional vehicle environment model and a captured image sequence, allowing for positionally accurate and timely projection of graphic elements directly related to the real environment, reducing processing times and latency by using simpler algorithms and efficient image data transmission.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If complex algorithms are used for object recognition and movement prediction, then object detection accuracy is improved, but processing time increases causing latency in display

Engineering Contradiction:
Improveobject detection accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by capturing a first image and detecting objects in advance, then using this pre-detected object information to generate the display image. This preliminary object detection allows the system to prepare graphic elements before final display, reducing the critical processing time path and minimizing latency while maintaining accurate object recognition.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If complex algorithms are used for object recognition, then detection accuracy is improved, but device complexity increases

Engineering Contradiction:
Improveobject detection accuracyVSAvoidalgorithm complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the image processing task into distinct stages: first image capture and object detection, then using detected object information to generate the display image. By separating object detection from display image generation, the system can use accurate detection algorithms only where needed while simplifying the overall processing pipeline, reducing device complexity while maintaining detection accuracy.

Inventive Principle:
Principle #1Segmentation

3Manufacturing precision

If high resolution image data is transmitted for display, then image quality is improved, but data transmission time increases

Engineering Contradiction:
Improveimage qualityVSAvoiddata transmission time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system extracts only the essential object information from the first image data that is needed for display image generation. Instead of transmitting or processing the entire high-resolution first image, the system extracts relevant object characteristics and positions, then uses this extracted information to create the display image. This extraction approach maintains image quality while significantly reducing data transmission time and processing load.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentEP2888623B1Operating a head-up display of a vehicle and image determining system for the head-up display
Publication Date: 2021.01.13 BAYERISCHE MOTOREN WERKE AG
  • EP2888623B1 patent drawingFigure 1
  • EP2888623B1 patent drawingFigure 2
  • EP2888623B1 patent drawingFigure 3

AI summary

On the basis of a prescribed three-dimensional vehicle environment model and on the basis of a second image, acquired at that time, of the image sequence, a corrected display image is determined. The vehicle environment model is determined here on the basis of at least a first image of an image sequence and comprises an object detected in the first image that has a prescribed resultant absolute position and/or a prescribed resultant position with reference to the vehicle (1). The second image is acquired a prescribed period of time after the first image and comprises the detected object. The corrected display image comprises at least one graphic element which represents the detected object and is determined in such a way that it is suitable for being projected onto a prescribed display area of the head-up display (5) such that the at least one graphic element is perceived by a viewer of the display area from a prescribed viewing position with direct reference to the actual environment of the vehicle (1).