Fog ADAS Sensor Fusion for Visibility-Aware Driver Assistance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current advanced driver assistance systems (ADAS) are inadequate in providing effective assistance to motor-vehicle drivers in low meteorological visibility conditions, particularly with fog, as their efficiency suffers due to adverse environmental influences such as heavy rain, fog, or snow.
Innovation Solution
An advanced driver assistance system (ADAS) that incorporates a combination of automotive sensory systems, including forward-looking cameras and infrared cameras, along with an electronic control unit (ECU) to communicate with automotive systems and provide enhanced driver assistance by adjusting lighting and displaying augmented reality data to improve visibility and safety in foggy conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If camera-based ADAS are used in good meteorological conditions, then safety and driving comfort are improved, but their efficiency deteriorates in adverse environmental conditions such as fog, heavy rain, or snow
Solution Approach 1:
The system segments the sensing function across multiple sensor types (visible spectrum cameras, infrared cameras, and radar) rather than relying on a single camera-based system. Each sensor type operates independently to detect different aspects of the environment, allowing the system to maintain reliability when one sensor type is degraded by environmental conditions.
Solution Approach 2:
The system uses a composite sensing approach by integrating multiple sensor technologies (visible cameras, infrared cameras, and radar) into a unified ADAS system. This composite architecture allows the system to leverage the strengths of each sensor type - visible cameras for clear conditions, infrared cameras for thermal detection in fog, and radar for penetration through adverse weather - thereby maintaining overall system reliability across varying environmental conditions.
2Measurement precision
If visible spectrum cameras are used for ADAS, then image capture works well in good conditions, but visibility detection deteriorates in foggy conditions
Solution Approach 1:
The system dynamically switches between visible spectrum cameras and infrared cameras based on detected environmental conditions. When fog is detected, the system transitions from relying on visible cameras to using infrared cameras, which can detect thermal signatures and provide visibility measurement through foggy conditions where visible light is scattered.
Solution Approach 2:
The system changes the operational parameter of the imaging system by switching from visible spectrum detection to infrared detection. This parameter change allows the system to detect thermal radiation patterns that penetrate fog, thereby maintaining measurement precision for visibility detection in adverse conditions where visible cameras fail.
3Reliability
If the system provides comprehensive driver assistance functions, then driving safety is improved, but device complexity increases
Solution Approach 1:
The system achieves multi-functionality by using a single integrated electronic control unit that processes data from multiple sensor types (visible cameras, infrared cameras, radar) and controls multiple automotive systems (lighting, display, cruise control). This universal approach allows comprehensive driver assistance functions to be implemented without proportionally increasing overall system complexity, as one control unit performs multiple functions.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system effectively assists drivers by switching lighting modes, providing visual and acoustic warnings, and limiting cruise speed to ensure safe driving in low visibility conditions, thereby enhancing driving safety and comfort.
Implementation Method 1
an additional front camera (12) designed to operate in an electromagnetic spectrum invisible to the human eye, in particular in the infrared spectrum, to capture digital images of the environment in front of the motor-vehicle (2)
Data Source
Figure 1
Figure 2
Figure 3
AI summary
ADAS (1) designed to assist a driver of a motor-vehicle (2) in low meteorological visibility conditions, in particular with fog, comprising a sensory system (3) comprising a front vision system (4) arranged on the motor-vehicle (2) to monitor an environment in front of the motor-vehicle (2) and comprising one or different first front cameras (10, 11) designed to operate in the electromagnetic spectrum visible to the human eye, and one or different second front cameras (12) designed to operate in the electromagnetic spectrum invisible to the human eye; and electronic processing resources (5) communicatively coupled to the sensory system (3) to receive and process outputs of one or more of the automotive front cameras (10, 11, 12) to determine a meteorological visibility in front of the motor-vehicle (2) and assist the driver of the motor-vehicle (2) based on the meteorological visibility in front of the motor-vehicle (2). Assisting the driver of the motor-vehicle (2) comprises differentially controlling operation(s) of one or different automotive systems comprising an external lighting system (7), a user interface (8), and a cruise control system (9) based on the meteorological visibility in front of the motor-vehicle (2). Assisting the driver of the motor-vehicle (2) further comprises visually assisting the driver of the motor-vehicle (2) via the user interface (8) by displaying on at least one automotive display thereof either a video streaming of an automotive front camera (10, 11, 12) or a virtual depiction of an environment in front of or surrounding the motor- vehicle (2) computed based on information from the sensory system (3).