AR-HUD POI Overlay With Engagement Feedback for Vehicles

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality head-up displays (AR-HUDs) for vehicles do not provide information about points-of-interest (POIs) in the environment surrounding the vehicle to occupants, limiting their environmental awareness.

Innovation Solution

A system that includes a global navigation satellite system (GNSS), a vehicle communication system, a display system, and a vehicle controller, which determines the vehicle's location, transmits this data to a remote server, and displays graphics related to POIs on the windscreen using an AR-HUD system, while tracking occupant engagement metrics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If current AR-HUDs display basic navigational information, then the occupant's forward field of view is maintained, but additional information about points-of-interest is not provided

Engineering Contradiction:
Improveinformation about POIsVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system segments information display by creating separate functional modules: a POI information module that retrieves and processes point-of-interest data, and a display integration module that overlays this information on the windscreen. This segmentation allows POI information to be added without redesigning the entire AR-HUD system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary processing layer between the navigation system and the display system. This intermediary module receives POI data, processes it into appropriate visual formats, and coordinates with the AR-HUD display controller to overlay information seamlessly. The intermediary handles data formatting, positioning calculations, and timing synchronization.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If more information is displayed to enhance environmental awareness, then occupant awareness is improved, but the risk of diverting attention from the road increases

Engineering Contradiction:
Improveenvironmental awarenessVSAvoidsafety
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The system applies local quality by positioning POI information displays at specific locations on the windscreen that correspond to the actual spatial location of points-of-interest in the external environment. This spatial correspondence allows occupants to naturally associate the displayed information with its real-world location without requiring attention shifts.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system implements periodic action by updating POI information displays only when relevant events occur, such as when the vehicle approaches a new point-of-interest or when the occupant's gaze indicates interest. This event-driven update strategy minimizes unnecessary visual changes that could distract the occupant.

Inventive Principle:
Principle #19Periodic action

3Adaptability or versatility

If engagement metrics are tracked to improve service, then user experience is enhanced, but data processing requirements increase

Engineering Contradiction:
Improveservice customizationVSAvoiddata processing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system implements self-service by automatically tracking engagement metrics such as gaze duration and interaction patterns without requiring manual input from the occupant. The system autonomously processes this data to infer user preferences and automatically adjusts POI information display priorities, filter criteria, and presentation formats according to detected user preferences.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent establishes a feedback loop where engagement metrics are continuously monitored and fed back to the information selection algorithm. This feedback mechanism allows the system to learn from occupant behavior patterns and dynamically adjust the types of POI information displayed, the timing of displays, and the level of detail provided, thereby personalizing the experience without manual configuration.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20250076072A1Informing vehicle occupants about points-of-interest
Publication Date: 2025.03.06 GM GLOBAL TECHNOLOGY OPERATIONS LLC
  • US20250076072A1 patent drawing
  • US20250076072A1 patent drawing
  • US20250076072A1 patent drawing

AI summary

A system for providing information to an occupant of a vehicle includes a global navigation satellite system (GNSS), a vehicle communication system, a display system configured to provide information to the occupant of the vehicle, and a vehicle controller in electrical communication with the GNSS, the vehicle communication system, and the display system. The vehicle controller is programmed to determine a location of the vehicle using the GNSS. The vehicle controller is further programmed to transmit the location of the vehicle to a remote server system using the vehicle communication system. The vehicle controller is further programmed to display a graphic using the display system. The graphic is received from the remote server system. The vehicle controller is further programmed to transmit an engagement metric of the graphic to the remote server system using the vehicle communication system.