Vehicle HUD Virtual Marker Alignment via Image Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

During the promotion and demonstration of vehicle-mounted heads up display (HUD) functions, the limited size of projection screens leads to mismatches between the position of virtual markers and objects in the virtual image, affecting the driving experience due to the inability to accurately simulate real road conditions.

Innovation Solution

A method and system that set a projection region overlapping the virtual display region, obtain relative position and size relationships, project images, capture and process images to generate a virtual recognition region, determine object positions, and display virtual markers at corresponding positions within the virtual display region, ensuring accurate alignment and improved virtual-real fusion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a projection screen is used to demonstrate HUD functions, then the demonstration can be performed, but the limited screen size causes mismatch between virtual markers and objects

Engineering Contradiction:
Improveaccuracy of virtual marker positioningVSAvoidprojection screen size
Core Design Contradiction:
ReliabilityVSArea of stationary object

Solution Approach 1:

The patent creates a virtual recognition region that copies the spatial relationship and proportion from the real road scene. By mapping objects from the captured image to the virtual display region using coordinate transformation and proportion calculation, the system reproduces the accurate spatial positioning without being constrained by the physical screen size, thus resolving the mismatch between virtual markers and objects.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transforms the coordinate system and scaling parameters between the projection region and virtual display region. By calculating the proportion relationship between corresponding regions and applying coordinate transformation formulas, the system adapts the positioning parameters to ensure accurate alignment of virtual markers with actual objects despite different display areas.

Inventive Principle:
Principle #35Parameter changes

2Ease of operation

If the projection region is made smaller to fit demonstration spaces, then the setup becomes more compact, but the alignment accuracy between virtual markers and real objects deteriorates

Engineering Contradiction:
Improvedemonstration setup convenienceVSAvoidposition matching accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent introduces a virtual coordinate system dimension that is independent of the physical screen dimensions. By establishing a mapping relationship between the projection region coordinate system and the virtual display region coordinate system through proportion calculations, the system achieves accurate positioning in the virtual space regardless of the physical projection area size, thus maintaining precision while allowing flexible setup.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Area of moving object

If the virtual display region is enlarged to show more road information, then the field of view increases, but the position correspondence with projected objects becomes inaccurate

Engineering Contradiction:
Improvevirtual display region areaVSAvoidposition correspondence accuracy
Core Design Contradiction:
Area of moving objectVSManufacturing precision

Solution Approach 1:

The patent dynamically adjusts the scaling parameter r based on the relative sizes of the projection region and virtual display region. When the virtual display region is enlarged, the system recalculates the proportion relationship and applies the updated scaling factor in the coordinate transformation formula, ensuring that position correspondence accuracy is maintained regardless of the display region size.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach ensures that virtual markers match the real positions of objects, enhancing the driving experience by providing a more accurate simulation of road conditions, thereby improving the demonstration and promotion of HUD functions.

Implementation Method 1

The heads up display on the automobiles may be installed on dashboards of the automobiles, to project in real time important driving information... onto windscreens in the form of text and/or icon by using the principle of optical reflection

Methodology Applied
Scientific EffectOptical reflection: Reflection

Data Source

PatentUS11376961B2Method and system for demonstrating function of vehicle-mounted heads up display, and computer-readable storage medium
Publication Date: 2022.07.05 BEIJING BOE TECH DEV CO LTD
  • US11376961B2 patent drawing
  • US11376961B2 patent drawing
  • US11376961B2 patent drawing

AI summary

Method and system for demonstrating a function of a vehicle-mounted heads up display are disclosed. The method includes setting a projection region for displaying a first image, obtaining relative position and relative size relationships between the projection region and the virtual display region, projecting the first image in the projection region, capturing a second image of the first image, generating a virtual recognition region in the second image, determining whether an object in the second image is located within the virtual recognition region, and determining, in a case that the object is located within the virtual recognition region, a first position of the object within the virtual recognition region, determining, based on the first position, a display position of a virtual marker representative of the object within the virtual display region, and displaying the virtual marker at the display position within the virtual display region.