AR-HUD Position Image Control Using Multi-Sensor Reliability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality head-up displays (AR-HUDs) face issues with position image offset relative to detection objects due to variations in sensing results from plural sensors, particularly in varying weather conditions and sensor types, without adequate solutions in prior art.

Innovation Solution

A display control device and method that calculates the reliability of sensing information from multiple sensors, deciding whether to display a position image based on these reliabilities, and adjusts display accordingly to prevent offset, using a first ECU to calculate perception states and a second ECU to decide on image display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If position images are displayed using sensing information from multiple sensors, then the coverage and sensing capability are improved, but position offset and display accuracy deteriorate due to variations in sensing results

Engineering Contradiction:
Improvesensing capabilityVSAvoidposition accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent changes the parameter of sensor selection from static to dynamic by calculating reliability values based on environmental conditions (weather, lighting, sensor type) and selectively using sensing information only from sensors whose reliability exceeds a predetermined threshold, thereby resolving the position offset issue while maintaining multi-sensor capability

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent segments the sensing information from multiple sensors by evaluating each sensor's reliability independently and selectively combining only high-reliability sensing results, rather than uniformly processing all sensor data, which prevents position offset caused by low-reliability sensors

Inventive Principle:
Principle #1Segmentation

2Quantity of substance

If all sensing information from multiple sensors is used for position calculation, then the quantity of sensing data is improved, but the reliability of position display deteriorates due to inclusion of low-reliability data

Engineering Contradiction:
Improvesensing information volumeVSAvoidsensing information reliability
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent introduces a reliability parameter threshold that dynamically filters sensing information based on environmental conditions, transforming the approach from using all available data to using only data that meets the reliability criterion, thus resolving the contradiction between quantity and reliability

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent extracts and excludes low-reliability sensing information from the processing pipeline by comparing each sensor's reliability against a predetermined threshold, thereby preventing contaminated data from affecting position calculation while retaining high-reliability data

Inventive Principle:
Principle #2Taking out (Extraction)

3Productivity

If position images are displayed without reliability verification, then the display frequency and responsiveness are improved, but the accuracy and trustworthiness of position display deteriorate

Engineering Contradiction:
Improvedisplay responsivenessVSAvoidposition image accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent performs preliminary reliability verification of sensing information before position calculation and display by calculating reliability values and comparing them against thresholds in advance, ensuring that only verified high-reliability data proceeds to position image generation, thus maintaining both responsiveness and accuracy

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12594947B2Display control device, display control method, and non-transitory computer-readable medium
Publication Date: 2026.04.07 TOYOTA JIDOSHA KK
  • US12594947B2 patent drawing
  • US12594947B2 patent drawing
  • US12594947B2 patent drawing

AI summary

A display control device configured to include a processor coupled to a memory, the processor calculating, based on sets of sensing information acquired from plural sensors that sense objects in front of a vehicle, a position of a detection object in front of the vehicle and, when displaying a position image representing the position of the detection object so as to overlay the position image on a foreground in a display area in front of a driver's seat, deciding whether or not to display the position image based on reliabilities of the sets of sensing information acquired from the plural sensors.