AR Head-Up Display Viewpoint Correction for Image Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional in-vehicle systems fail to address the issue of positional shift between the object and the virtual image (AR image) in the visible region of a windshield or the like by using an AR function, where the display position of the AR image does not match the actual visual recognition by the driver due to changes in the driver's eye position.

Innovation Solution

A head up display apparatus that projects an image to a windshield or a combiner, utilizing a controller to correct the display position of the AR image based on information from external and internal cameras, adjusting the position to align with the driver's new viewpoint after movement, thereby reducing the shift between the object and the AR image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the AR image is displayed at a fixed position determined by design and calculation, then the display system is simple and stable, but the position shift between the object and AR image increases when the driver's eye position changes

Engineering Contradiction:
Improveposition matching accuracyVSAvoiddisplay control complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system uses cameras to detect the driver's actual eye position and provides feedback to the display control unit. The display control unit then adjusts the AR image position based on this feedback to maintain accurate alignment with the object, resolving the contradiction between position accuracy and system complexity.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system transitions from a static fixed-position display to a dynamic adjustable display. The AR image position is no longer fixed but is dynamically adjusted based on the detected eye position, allowing the system to maintain accuracy while adapting to changing conditions.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If the AR image position is adjusted to follow the driver's eye position, then the position matching accuracy improves, but the device complexity increases due to additional sensors and control mechanisms

Engineering Contradiction:
Improveeye position detection accuracyVSAvoidsystem structure complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system introduces cameras as intermediary devices to detect eye position indirectly. Rather than directly tracking the eye, the system uses images captured by cameras to determine eye position, which simplifies the overall system structure while maintaining detection accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system replaces complex mechanical eye-tracking mechanisms with optical detection using cameras. This substitution reduces mechanical complexity while achieving accurate eye position measurement through image processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Reliability

If additional cameras and control mechanisms are added to track eye position, then the position shift is reduced, but the device complexity and cost increase

Engineering Contradiction:
ImproveAR image alignment accuracyVSAvoidnumber of components
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The cameras serve multiple functions: they capture images for object recognition, detect the driver's eye position, and provide input for AR image generation. This multi-functionality reduces the need for dedicated eye-tracking hardware, thereby reducing overall system complexity while maintaining alignment accuracy.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system merges the eye position detection function with the existing camera-based object recognition system. By combining these functions into a single integrated system rather than adding separate dedicated components, the overall device complexity is reduced while achieving the desired alignment accuracy.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution enables suitable AR display by minimizing the shift between the object and the virtual image, allowing the driver to easily recognize the object and the AR image, even when the viewpoint position changes.

Implementation Method 1

The image light from the display element is projected through the mirror and the like to a predetermined region within the visible region of a windshield, a combiner, or the like. The light reflected in the predetermined region enters the eyes of the driver and forms an image on the retina

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUSRE50732E1Head up display apparatus and display control method thereof
Publication Date: 2026.01.06 MAXELL LTD
  • USRE50732E1 patent drawing
  • USRE50732E1 patent drawing
  • USRE50732E1 patent drawing

AI summary

In relation to a HUD apparatus having an AR function, the shift between an object and a virtual image (AR image) is reduced. The HUD apparatus extracts a predetermined object based on an image taken by an external camera, acquires object information including an object position in space, viewpoint position information of a driver and the amount of movement of the viewpoint position in space based on an image taken by an internal camera, and information including a position of a virtual image region in space. The HUD apparatus generates the image to be superimposed on the object, and corrects a display position of the image in the virtual image region including at least a position in a horizontal direction, and performs conversion processing at the time of the correction so that a virtual image region is set as a display position of the image after correction.