Occlusion Adjustment for In-Vehicle Augmented Reality HUDs

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In-vehicle augmented reality systems with HUDs face confusion when physical obstacles occlude displayed graphics, leading to potential safety risks as drivers misinterpret object distances and locations.

Innovation Solution

An occlusion adjustment system that uses internal and external sensors to determine the eye position of the driver and object positions, adjusting graphics on the HUD to accurately represent occluded objects, either turning off the graphic or displaying a secondary graphic indicating the object's location behind the occluding object based on importance and occlusion status.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If graphics are displayed on HUD to represent interested objects, then driver awareness of objects is improved, but driver confusion occurs when physical obstacles occlude the graphics leading to misinterpretation of object distances and locations

Engineering Contradiction:
Improvedriver awareness of object locationVSAvoiddriver confusion and safety risk
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The system dynamically adjusts the display behavior of graphics based on real-time occlusion detection. When occlusion is detected, the system transitions from displaying accurate location graphics to displaying indication graphics that warn of occluded objects. This dynamic adaptation resolves the contradiction by maintaining driver awareness while preventing confusion about object distances and locations.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses different visual representations (different colors or styles) to distinguish between visible objects and occluded objects. Graphics representing occluded objects are displayed in a manner that indicates their hidden status, allowing drivers to understand that these objects are not directly visible but are present behind obstacles. This visual differentiation prevents misinterpretation while maintaining awareness.

Inventive Principle:
Principle #32Color changes

2Object-affected harmful factors

If graphics representing occluded objects are turned off to prevent confusion, then driver misinterpretation is reduced, but driver awareness of important occluded objects is lost

Engineering Contradiction:
Improvedriver misinterpretationVSAvoiddriver awareness of occluded objects
Core Design Contradiction:
Object-affected harmful factorsVSLoss of information

Solution Approach 1:

The system introduces indication graphics as an intermediary between the occluded object and the driver. These graphics do not represent the actual location of the occluded object (which would cause confusion), but instead indicate the presence of an occluded object in a way that doesn't mislead about distance or position. This intermediary solution maintains awareness while preventing misinterpretation.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The display system segments information about occluded objects from information about visible objects. Instead of using the same graphical representation for both, the system creates distinct visual indicators for occluded objects. This segmentation allows the driver to understand that certain objects are hidden behind obstacles without confusing them with the actual spatial layout.

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If the system displays graphics accurately representing object locations, then measurement precision is improved, but reliability decreases when occlusion causes the graphics to misrepresent reality

Engineering Contradiction:
Improvegraphic location accuracyVSAvoidgraphic representation accuracy
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system dynamically changes the representation mode based on occlusion status. When no occlusion is present, graphics accurately represent object locations. When occlusion is detected, the system switches to an indication mode that preserves the precision of object detection while adding contextual information about occlusion status. This dynamic approach maintains both measurement precision and reliability.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10248196B2System for occlusion adjustment for in-vehicle augmented reality systems
Publication Date: 2019.04.02 TOYOTA JIDOSHA KK
  • US10248196B2 patent drawing
  • US10248196B2 patent drawing
  • US10248196B2 patent drawing

AI summary

The disclosure includes embodiments for providing occlusion adjustment for an in-vehicle augmented reality system. A system may include a three-dimensional heads-up display unit (“3D HUD”) installed in a vehicle. The system may include a memory storing instructions that, when executed, cause the system to: display, on the 3D HUD, a first graphic that is viewable by a driver of the vehicle as overlaying the interested object when the driver is looking at the 3D HUD; determine that at least a portion of the interested object is occluded by an occluding object; turn off the first graphic so that the first graphic is not displayed on the 3D HUD; and display, on the 3D HUD, a second graphic that does not overlay the occluding object and visually indicates to the driver the location of the interested object behind the occluding object when the driver is looking at the 3D HUD.