Vehicle Augmented Reality Object Representation System

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality systems for vehicles lack the ability to effectively identify and display relevant objects in real-time, especially as the vehicle moves, and do not provide detailed views of objects of interest beyond their immediate field of view.

Innovation Solution

An augmented reality system that uses an image sensor device, data storage, identification, and augmented reality devices to record, identify, and generate representations of objects based on user-defined criteria, allowing for storage and display of image data with high resolution and additional information, even after objects have left the field of view.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If image data of all identified objects is stored in high resolution, then the image quality and detail information are improved, but the storage space requirement increases significantly

Engineering Contradiction:
Improveimage resolutionVSAvoidstorage space
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent applies local quality by storing image data at different resolutions based on object characteristics and relevance. High-resolution images are stored for objects of interest identified by the selection criterion, while other objects are stored at lower resolutions or in compressed formats. This selective quality approach maintains image quality for important objects while reducing overall storage requirements.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system changes the resolution parameter of stored image data based on the selection criterion. The identification device determines which objects meet the selection criterion, and the storage device stores image data for these objects at high resolution while storing other objects at variable resolutions. This dynamic parameter adjustment resolves the contradiction between quality and storage space.

Inventive Principle:
Principle #35Parameter changes

2Loss of information

If all recorded image data is processed and stored, then no information is lost, but the processing time and computational resources increase

Engineering Contradiction:
Improveinformation completenessVSAvoidprocessing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent extracts only the necessary image data for storage based on the selection criterion. The identification device processes recorded image data in real-time and extracts only those objects that meet the predetermined selection criterion (e.g., objects of interest, specific categories, or objects matching search criteria). This extraction approach prevents information loss for important objects while avoiding the processing burden of storing all image data.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system performs preliminary identification and selection of objects during the recording phase, before final storage. The identification device continuously analyzes recorded image data and pre-identifies objects that meet the selection criterion, preparing a list of objects requiring high-resolution storage. This preliminary action reduces the computational load during playback and ensures no important information is lost.

Inventive Principle:
Principle #10Preliminary action

3Duration of action of stationary object

If the system stores image data for a long period, then retrospective analysis capability is improved, but the storage resource consumption increases

Engineering Contradiction:
Improvedata retention periodVSAvoidstorage capacity
Core Design Contradiction:
Duration of action of stationary objectVSQuantity of substance

Solution Approach 1:

The system dynamically adjusts the storage duration parameter based on object relevance. Image data for objects meeting the selection criterion is stored for extended periods, while data for other objects is stored for shorter durations or in compressed archives. This selective retention approach enables retrospective analysis of important objects without consuming excessive storage capacity indefinitely.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentEP2813999B1Augmented reality system and method of generating and displaying augmented reality object representations for a vehicle
Publication Date: 2020.01.01 ROBERT BOSCH GMBH
  • EP2813999B1 patent drawingFigure 1
  • EP2813999B1 patent drawingFigure 2
  • EP2813999B1 patent drawingFigure 3~4

AI summary

The invention provides an augmented reality system and a method for generating and displaying augmented reality object representations for a vehicle, comprising: an image sensor device (10; 10'); a data storage device (12) with a first memory (13) and a second memory (14); an identification device (15) which can identify objects (4; 114, 124; 214, 224) present in the recorded image data (2) according to a predetermined first selection criterion and is further configured such that, by means of the identification device (15), according to a predetermined second selection criterion which includes specifications for the image resolution of the image data (2), certain image data (2) relating to the identified existing objects (4; 114, 124; 214, 224) can be transferred to the second memory (14) for storage; an augmented reality device (17) which combines the recorded image data (2) with additional data (3; 154, 155, 175, 176;255, 257, 275) augmented reality object representations (112, 122, 154, 174; 212, 222, 254, 274); and a selection device (18) which, based on a portion of the image data stored in the second memory (14) selected by the selection device (18) according to a predefined third selection criterion, can generate augmented reality object representations (112, 122, 154, 174; 212, 222, 254, 274) for display by means of a display device (6; 16; 66).