Road Sign Visibility Determination Using Multi-Sensor Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Modern vehicles equipped with cameras for identifying road signs face challenges in determining the state of visibility, leading to incorrect updates in map databases when signs are obscured, either by other vehicles or weather conditions, without clear reasons for obscurity.
Innovation Solution
An apparatus and method utilizing vehicle sensor data to determine the state of visibility for road signs, including proximity checks, obscuration by other vehicles, and weather conditions, generating signals to indicate the cause of obscurity and establishing a confidence level for accurate data validation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If cameras are used to identify road signs, then road sign information can be captured, but the system cannot distinguish between signs obscured by vehicles versus weather conditions
Solution Approach 1:
The patent segments the obscurity detection function into multiple independent sensor components: cameras for visual detection, LIDAR for spatial mapping, and weather sensors for environmental monitoring. Each sensor type independently contributes to determining the cause of obscurity, allowing the system to distinguish between vehicle obstruction and weather conditions without requiring a single complex sensor to perform all functions.
2Measurement precision
If multiple sensors are deployed to determine visibility state, then accuracy improves, but device complexity increases
Solution Approach 1:
The patent implements a multi-functional sensor system where LIDAR serves multiple purposes: it detects the spatial position of road signs, identifies obscuring objects, and provides depth information for classification. The camera system similarly performs both road sign identification and obscuration detection. This multi-functionality reduces the need for entirely separate sensor systems for each function, thereby managing complexity while maintaining high measurement precision.
Solution Approach 2:
The patent introduces a processor as an intermediary that receives data from multiple sensors and synthesizes the information to determine the state of visibility. The processor acts as a mediator that integrates camera images, LIDAR point clouds, and weather sensor readings to distinguish between vehicle obscuration and weather conditions, thereby managing system complexity through centralized intelligent processing rather than requiring complex hardware integration.
3Measurement precision
If cameras alone are used to detect road signs, then processing resources are consumed, but accuracy of determining obscuration cause is insufficient
Solution Approach 1:
The patent replaces the purely optical camera-based detection system with a multi-modal sensor system that includes LIDAR and weather sensors. LIDAR provides active illumination and spatial mapping capabilities that are not dependent on ambient light conditions, thereby reducing the processing burden on cameras in adverse weather. The system substitutes mechanical/optical measurement (camera imaging) with electromagnetic radiation measurement (LIDAR time-of-flight) to achieve more reliable obscuration cause detection with reduced overall processing energy consumption.
Data Source
AI summary
An apparatus, method and computer program product are provided for determining a state of visibility of a road object, such as a road sign, using vehicle sensor data. For example, the apparatus determines whether one or more sensors of a first vehicle observes a road sign. If the road sign is not observed by the one or more sensors, the apparatus determines whether one or more second vehicles is obscuring the road sign. If the one or more second vehicles is not obscuring the road sign, the apparatus determines whether the road sign is obscured due to a weather condition. If the road sign is obscured due to the weather condition, the apparatus generates a signal indicating that the road sign was obscured due to the weather condition.