AR Content Depth Adjustment on Vehicle HUD

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional augmented reality (AR) systems struggle to effectively present virtual content on heads-up displays (HUDs) in a manner that simulates its depth and location relative to real-world objects, especially in dynamic environments like vehicles, where distances and positions change continuously.

Innovation Solution

The system adjusts the rendering of virtual content based on the depth of physical objects from the user's perspective, using sensors and computer vision to update the size and position of virtual content on the HUD, creating the illusion that it is part of the real-world environment by correlating with the depth and location of physical objects, such as buildings or cross-streets.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If virtual content is displayed at a fixed position on the screen, then the rendering is stable and simple to implement, but the content does not accurately reflect the depth and location of real-world objects

Engineering Contradiction:
Improvedepth accuracyVSAvoidrendering complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent implements dynamic rendering of virtual content by continuously adjusting the size and position of virtual objects based on real-time depth information from sensors. The virtual content transitions from a fixed static display to a dynamic display that responds to changing environmental conditions, specifically depth changes of physical objects captured by the device

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses sensor data to provide feedback about the depth of physical objects, which then feeds back into the rendering process to adjust the virtual content display. This closed-loop feedback mechanism ensures that the virtual content accurately reflects the spatial relationship with real-world objects, resolving the contradiction between display accuracy and implementation complexity

Inventive Principle:
Principle #23Feedback

2Reliability

If the AR system continuously updates virtual content position and size, then the immersion and accuracy are improved, but the processing requirements and energy consumption increase

Engineering Contradiction:
ImproveAR experience qualityVSAvoidprocessing energy
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent applies partial updates to virtual content by only adjusting the size and position parameters that are directly affected by depth changes, rather than completely re-rendering all virtual content. This selective updating approach maintains high AR experience quality while reducing the processing energy required compared to full scene re-rendering

Inventive Principle:
Principle #16Partial or excessive action

3Adaptability or versatility

If the virtual content size is adjusted based on depth, then the realism and integration with real environment are improved, but the consistency of content display may be compromised

Engineering Contradiction:
Improveenvironmental integrationVSAvoidcontent display consistency
Core Design Contradiction:
Adaptability or versatilityVSStability of the object's composition

Solution Approach 1:

The patent changes specific display parameters (size and position) of virtual content based on depth information while maintaining other display parameters constant. This selective parameter adjustment allows the virtual content to adapt to environmental changes and integrate realistically with the real world, while preserving the consistency and stability of the overall content composition

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11373357B2Adjusting depth of augmented reality content on a heads up display
Publication Date: 2022.06.28 ENVISICS LTD
  • US11373357B2 patent drawing
  • US11373357B2 patent drawing
  • US11373357B2 patent drawing

AI summary

Disclosed are systems, methods, and non-transitory computer-readable media for adjusting depth of AR content on HUD. A viewing device identifies, based on sensor data, a physical object visible through a transparent display of the vehicle. The sensor data indicates an initial distance of the physical object from the vehicle. The viewing device gathers virtual content corresponding to the physical object and generates an initial presentation of the virtual content based on the initial distance. The viewing device presents the initial presentation of the virtual content on the transparent display at a position on the transparent display corresponding to the physical object. The viewing device determines, based on updated sensor data, an updated distance of the physical object and generates an updated presentation of the virtual content based on the updated distance. The viewing device presents the updated presentation of the virtual content on the transparent display of the vehicle.