LIDAR Fault Detection Using Synthetic Point Cloud Training
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for detecting LIDAR malfunctions are limited to specific environments and cannot detect malfunctions when the LIDAR is not operating.
Innovation Solution
A method using artificial intelligence technology to generate a type-specific LIDAR-abnormal dataset based on a normal dataset, train a LIDAR malfunction detection model, and use it to detect malfunctions in various environments, including techniques like K-means and DBSCAN clustering, and a 3D-GCN model for point cloud data analysis.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If existing methods use test patterns or targets in specific environments to detect LIDAR malfunctions, then detection can be performed in controlled conditions, but detection capability is limited to specific environments only
Solution Approach 1:
The patent creates synthetic LIDAR point cloud data that copies the characteristics of real LIDAR data through simulation. Normal point cloud data is generated from 3D model data of vehicles and surrounding objects, and abnormal data is created by introducing various failure modes into this synthetic data. This allows the detection model to be trained on diverse virtual scenarios without requiring physical test patterns or targets in specific environments.
Solution Approach 2:
The patent varies multiple parameters in the synthetic data generation process including object positions, distances, orientations, weather conditions, and LIDAR failure modes to create diverse training datasets. By changing these parameters systematically, the model learns to detect malfunctions across various environmental conditions rather than being limited to specific test scenarios.
2Reliability
If existing methods detect LIDAR malfunctions based on LIDAR operation, then malfunction detection is possible during operation, but malfunctions cannot be detected when LIDAR does not operate
Solution Approach 1:
The patent performs preliminary training of the detection model using synthetic normal and abnormal point cloud data before actual LIDAR operation begins. This pre-training phase allows the model to learn malfunction patterns in advance, enabling it to detect issues whether the LIDAR is operating or not. The model is prepared beforehand to handle various failure scenarios without requiring active LIDAR operation during the detection setup phase.
3Measurement precision
If a LIDAR malfunction detection model is trained using real abnormal data, then accurate detection can be achieved, but data collection costs and time increase significantly
Solution Approach 1:
Instead of collecting real abnormal LIDAR data through actual failures or test patterns, the patent copies the essential characteristics of abnormal data by introducing simulated failure modes into synthetic point cloud data. This includes adding noise, occlusions, and other artifacts that mimic real malfunction conditions without requiring actual LIDAR failures or extensive field testing.
Solution Approach 2:
The patent uses computationally inexpensive synthetic data generation methods rather than expensive and time-consuming real-world data collection. The synthetic datasets can be generated quickly through simulation and can be discarded or regenerated as needed, unlike real abnormal data which requires extensive field deployment and actual failure occurrences.
Data Source
Figure 1A
Figure 1B
Figure 2~3
AI summary
A method and an apparatus for detecting malfunction of LIDAR, and a method and an apparatus for generating data therefor are disclosed. According to an aspect of the present disclosure, there is provided a method for detecting malfunction of a LIDAR, including: acquiring point cloud data from the LIDAR; determining whether the number of points included in the point cloud data is less than a point count threshold; and determining whether the LIDAR has a fault based on the point cloud data by using a LIDAR malfunction detection model when the number of points is greater than or equal to the point count threshold, wherein the LIDAR malfunction detection model is a pre-trained model based on a normal dataset and at least one LIDAR-abnormal dataset, the normal dataset includes preset statistics and point cloud data acquired from the LIDAR in a normal state, and the LIDAR-abnormal dataset includes point cloud data generated based on the normal dataset.