Vehicle AR Navigation Using Image Segmentation and LiDAR

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles face challenges in navigating due to the vast amount of data from sensors and traditional mapping technologies, which can limit navigation efficiency and accuracy.

Innovation Solution

A system that augments vehicle images using a processor to segment images, integrate point cloud data from LiDAR, and add augmented reality objects for enhanced navigation, reducing the need for extensive data storage and processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional mapping technology is used for autonomous vehicle navigation, then navigation coverage is improved, but data storage requirements and processing complexity increase significantly

Engineering Contradiction:
Improvenavigation accuracyVSAvoiddata volume
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential navigation elements (lane markings, road signs, traffic signals) from the complete map data, storing them as discrete objects with minimal attributes. This extraction approach maintains navigation accuracy by preserving critical information while dramatically reducing the overall data volume that needs to be stored and processed.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The navigation data is segmented into distinct functional components: map data containing geometric information, object data containing semantic information about traffic elements, and sensor data containing real-time measurements. This segmentation allows the system to process only relevant data subsets for each navigation task, reducing computational complexity and data storage requirements.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If complete map data is stored and processed, then navigation accuracy is improved, but processing time and computational resources increase

Engineering Contradiction:
Improvelocation accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs partial processing by focusing computational resources only on processing and analyzing the specific map objects and sensor data relevant to the current navigation context, rather than processing complete map data. This partial action approach maintains location accuracy by concentrating computational effort on critical data subsets while reducing overall processing time.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

Map data and object data are pre-processed and organized into structured formats with defined schemas before runtime use. This preliminary organization of spatial relationships and object attributes enables faster query execution and data retrieval during navigation, reducing real-time processing requirements while maintaining accuracy.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250225740A1Multi-view augmented reality
Publication Date: 2025.07.10 MOBILEYE VISION TECH LTD
  • US20250225740A1 patent drawing
  • US20250225740A1 patent drawing
  • US20250225740A1 patent drawing

AI summary

Systems and methods for generating augmented image data for vehicle navigation are disclosed. In one implementation, a system includes a processor programmed to receive an image captured by a camera of a host vehicle; segment the image by identifying a first portion of the at least one image and a second portion of the at least one image; receiving a point cloud generated based on an output of a LiDAR; determining a location for an augmented reality object relative to the image based on the first portion of the segmented image and at least a portion of the point cloud; selecting or generating an augmented reality object; and augmenting the image to include a representation of the augmented reality object.