Vehicle AR Navigation Using Image Segmentation and LiDAR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Autonomous vehicles face challenges in navigating due to the vast amount of data from sensors and traditional mapping technologies, which can limit navigation efficiency and accuracy.
Innovation Solution
A system that augments vehicle images using a processor to segment images, integrate point cloud data from LiDAR, and add augmented reality objects for enhanced navigation, reducing the need for extensive data storage and processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional mapping technology is used for autonomous vehicle navigation, then navigation coverage is improved, but data storage requirements and processing complexity increase significantly
Solution Approach 1:
The patent extracts only the essential navigation elements (lane markings, road signs, traffic signals) from the complete map data, storing them as discrete objects with minimal attributes. This extraction approach maintains navigation accuracy by preserving critical information while dramatically reducing the overall data volume that needs to be stored and processed.
Solution Approach 2:
The navigation data is segmented into distinct functional components: map data containing geometric information, object data containing semantic information about traffic elements, and sensor data containing real-time measurements. This segmentation allows the system to process only relevant data subsets for each navigation task, reducing computational complexity and data storage requirements.
2Measurement precision
If complete map data is stored and processed, then navigation accuracy is improved, but processing time and computational resources increase
Solution Approach 1:
The system performs partial processing by focusing computational resources only on processing and analyzing the specific map objects and sensor data relevant to the current navigation context, rather than processing complete map data. This partial action approach maintains location accuracy by concentrating computational effort on critical data subsets while reducing overall processing time.
Solution Approach 2:
Map data and object data are pre-processed and organized into structured formats with defined schemas before runtime use. This preliminary organization of spatial relationships and object attributes enables faster query execution and data retrieval during navigation, reducing real-time processing requirements while maintaining accuracy.
Data Source
AI summary
Systems and methods for generating augmented image data for vehicle navigation are disclosed. In one implementation, a system includes a processor programmed to receive an image captured by a camera of a host vehicle; segment the image by identifying a first portion of the at least one image and a second portion of the at least one image; receiving a point cloud generated based on an output of a LiDAR; determining a location for an augmented reality object relative to the image based on the first portion of the segmented image and at least a portion of the point cloud; selecting or generating an augmented reality object; and augmenting the image to include a representation of the augmented reality object.


