Vehicle Augmented Reality Overlay with Dynamic Virtual Element Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality systems for motor vehicles lack interactive and dynamic integration of real-world environments with virtual elements, limiting driver engagement and situational awareness during navigation.
Innovation Solution
A method and system that record the motor vehicle's environment using image data, detect real objects, and overlay virtual elements controlled by user input, allowing for interactive and dynamic combination of real and virtual elements in a three-dimensional space for enhanced situational awareness and engagement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional augmented reality systems use marker objects with identification patterns for tracking, then the system can identify and track objects in the environment, but the system lacks interactivity and dynamic integration with user input
Solution Approach 1:
The patent extracts the identification pattern requirement from the marker objects, allowing tracking without predefined patterns. The system takes out the complex pattern recognition component and replaces it with direct coordinate determination from image data, simplifying the system while maintaining tracking capability
Solution Approach 2:
The system implements feedback by continuously receiving user input (mouse clicks, touches) and dynamically adjusting the virtual element's position and behavior based on this input. The virtual element responds to user actions in real-time, creating an interactive loop that enhances adaptability
2Loss of information
If the system overlays virtual elements on real-world objects, then situational awareness is enhanced, but driver focus may be compromised due to distraction from interactive elements
Solution Approach 1:
The virtual element is designed to be dynamic rather than static. It moves and changes behavior based on user input and environmental context, allowing it to adapt to the driving situation. This dynamic nature enables the system to enhance situational awareness while minimizing distraction by making the element responsive rather than intrusive
Solution Approach 2:
The virtual element acts as an intermediary between the driver and the real-world environment. It provides additional information and interaction capabilities without directly blocking the view of the environment, serving as a mediator that enhances awareness while maintaining situational context
3Reliability
If the system uses predefined pattern templates for marker identification, then object identification is reliable, but the system cannot accommodate dynamic user-controlled virtual elements
Solution Approach 1:
The system determines the coordinate range of the real object in advance from the image data before overlaying the virtual element. This preliminary action establishes a reliable spatial reference framework that enables both accurate object identification and flexible virtual element placement without requiring predefined patterns
Solution Approach 2:
The patent transitions from two-dimensional pattern recognition to three-dimensional coordinate-based tracking. By working with coordinate ranges in 3D space rather than 2D patterns, the system achieves both reliable identification and the flexibility to place and control virtual elements in dynamic positions
Data Source
AI summary
A method and system for generating augmented reality with a display of a vehicle is provided. The method comprises recording an image of an environment of the vehicle in the form of image data, determining a virtual space in three dimensions from the image data, and detecting a real object in the image data. The method further comprises determining a first coordinate range of the real object in the three dimensional virtual space, adding a virtual element to the three dimensional virtual space, and controlling the virtual element in the three dimensional virtual space based on a user input. The method further comprises outputting the environment and the controlled virtual element in combined form in an output image, modifying the output image when the first coordinate range of the real object and a second coordinate range of the controlled virtual element form an intersection area, and displaying the output image.