HUD Content Control Using LIDAR Depth Sensing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing HUD systems fail to enhance driver visibility effectively in low lighting or adverse weather conditions by adding unnatural graphics, which can distract and obscure the view, leading to decreased situational awareness and increased response time.

Innovation Solution

A system that uses LIDAR for depth sensing and camera imagery to generate a light-contoured image, projecting it onto the windshield in alignment with the natural view, enhancing contours with realistic lighting to improve visibility without adding distracting graphics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If existing HUD systems add graphics to enhance visibility, then visibility enhancement is achieved, but distraction and view obstruction increase

Engineering Contradiction:
Improvevisibility enhancementVSAvoiddistraction and view obstruction
Core Design Contradiction:
Illumination intensityVSObject-generated harmful factors

Solution Approach 1:

The system applies lighting effects selectively to specific features in the driver's view rather than adding uniform graphics across the entire display. Depth information from LIDAR is used to identify specific contours and features that require enhancement, applying lighting cues only to those localized areas while leaving the rest of the natural view unobstructed.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system creates a synthetic contoured image that copies and enhances the natural visual scene rather than adding unrelated graphics. By using depth information to generate a contoured representation of actual features in the driver's view and overlaying it with realistic lighting effects, the system enhances visibility while maintaining fidelity to the natural scene.

Inventive Principle:
Principle #26Copying

2Illumination intensity

If HUD projects enhanced graphics to improve visibility in poor conditions, then visibility is improved, but natural view clarity is reduced

Engineering Contradiction:
Improvevisibility in poor lightingVSAvoidview clarity
Core Design Contradiction:
Illumination intensityVSReliability

Solution Approach 1:

The system changes the lighting parameters of the displayed image by applying synthetic lighting effects that mimic natural lighting conditions. Rather than adding bright graphics that could obscure the view, the system adjusts parameters such as light direction, intensity, and shading to enhance contours and features in a way that is consistent with natural visual perception.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system creates a synthetic contoured image that copies and enhances the natural visual scene rather than adding unrelated graphics. By using depth information to generate a contoured representation of actual features in the driver's view and overlaying it with realistic lighting effects, the system enhances visibility while maintaining fidelity to the natural scene.

Inventive Principle:
Principle #26Copying

3Loss of information

If HUD adds multiple display elements to provide comprehensive information, then information completeness is improved, but response time increases

Engineering Contradiction:
Improveinformation completenessVSAvoiddriver response time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system extracts only the essential visual information needed for safe driving and presents it in an enhanced form rather than displaying all available data. By using depth information to identify and enhance only the most relevant features in the driver's view, the system provides comprehensive safety information while minimizing cognitive load and maintaining quick response times.

Inventive Principle:
Principle #2Taking out (Extraction)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system enhances driver visibility by realistically sharpening feature contours, improving driving safety in poor lighting and weather conditions by using natural lighting cues, maintaining a clear and unobstructed view.

Implementation Method 1

The depth information is sensed using Laser Imaging, Detection and Ranging (LIDAR) and is formatted as a depth image

Methodology Applied
Scientific EffectLIDAR: LIDAR

Implementation Method 2

projecting it onto the windshield in alignment with the natural view, enhancing contours with realistic lighting

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentEP3811326B1Heads up display (HUD) content control system and methodologies
Publication Date: 2023.08.09 VOLKSWAGEN AG
  • EP3811326B1 patent drawingFigure 1
  • EP3811326B1 patent drawingFigure 2
  • EP3811326B1 patent drawingFigure 3

AI summary

A system and methodologies for controlling the content of a heads up display to provide increased visibility of naturally occurring contours and surfaces in the environment is provided. Depth information is provided along with predefined lighting conditions in order to output an image by the HUD with enhanced feature contours.