Virtual LiDAR Rain Snow Modeling for ADAS

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current Advanced Driver Assistance Systems (ADAS) face challenges in effectively simulating and evaluating their performance under various weather conditions, such as rain and snow, which are difficult to replicate in real-world scenarios without risking safety or convenience.

Innovation Solution

A method and system for modeling rain and snow effects in a virtual LiDAR sensor by generating stochastic models of precipitation, estimating the probability of light interaction with raindrops or snowflakes, and modifying point cloud models to include effects like attenuation, backscattering, and water splashing, correlated with vehicle speed and patterns.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If real-world field testing is used to evaluate ADAS performance under weather conditions, then actual sensor response data can be obtained, but safety risks and convenience issues arise due to extreme weather conditions

Engineering Contradiction:
ImproveADAS performance evaluation accuracyVSAvoidsafety risks in extreme weather
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent creates a virtual LiDAR sensor that copies and simulates the behavior of a real LiDAR sensor under various weather conditions. Instead of physically testing in rain and snow, the system generates synthetic point cloud data that replicates how a real sensor would respond to precipitation, allowing safe yet accurate ADAS evaluation

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The virtual LiDAR sensor acts as an intermediary between the ADAS system and real-world weather conditions. It mediates the testing process by providing simulated sensor responses to precipitation scenarios, eliminating the need for dangerous field testing while maintaining evaluation validity

Inventive Principle:
Principle #24Intermediary (Mediator)

2Object-affected harmful factors

If virtual simulation is used to model weather effects, then safety risks are eliminated, but the complexity of accurately modeling light interaction with precipitation increases

Engineering Contradiction:
Improvesafety risksVSAvoidmodeling complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The system models weather effects by changing key parameters such as attenuation coefficients, backscattering intensity, and point cloud density based on precipitation type and intensity. Instead of complex physical simulations, it adjusts these parameters to replicate sensor responses under various weather conditions

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent applies different modeling approaches to different aspects of the problem: using stochastic models for precipitation distribution, geometric optics for light-raindrop interaction, and empirical correlations for tire splashing. Each local aspect is handled with the most appropriate method, balancing accuracy and complexity

Inventive Principle:
Principle #3Local quality

3Measurement precision

If detailed physics-based modeling is applied to simulate light interaction with raindrops and snowflakes, then measurement precision improves, but computational requirements and processing time increase

Engineering Contradiction:
Improvesensor response accuracyVSAvoidcomputation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system applies physics-based modeling selectively to the most critical aspects of light interaction (attenuation and backscattering) while using simplified stochastic models for less critical elements like precipitation spatial distribution. This partial application of complex modeling maintains measurement precision for key parameters while reducing overall computational burden

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables robust simulation of ADAS performance under diverse weather conditions, improving development and evaluation by accurately simulating LiDAR sensor responses, thereby enhancing the reliability of autonomous driving systems.

Implementation Method 1

LiDAR (Light Detection And Ranging) sensors can be used to determine distances to an object by emitting a laser pulse and determining the time it takes for the pulse to bounce off the object and return to the laser source

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Implementation Method 2

emitting a laser pulse and determining the time it takes for the pulse to bounce off the object and return

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 3

estimating a probability that a light source from the LiDAR sensor hits a raindrop or a snowflake based on the stochastic model

Methodology Applied
Scientific EffectLight scattering: Scattering

Implementation Method 4

modeling effects of attenuation of light sourced from the LiDAR sensor or returned to the LiDAR sensor due to a raindrop or a snowflake

Methodology Applied
Scientific EffectLight attenuation: Absorption (EM radiation)

Implementation Method 5

modeling backscattering intensity from raindrops or snowflakes hit by light sourced from the LiDAR sensor

Methodology Applied
Scientific EffectBackscattering: Scattering

Data Source

PatentUS20240134022A1Physics-based modeling of rain and snow effects in virtual lidar
Publication Date: 2024.04.25 GM GLOBAL TECHNOLOGY OPERATIONS LLC
  • US20240134022A1 patent drawing
  • US20240134022A1 patent drawing

AI summary

A method of modeling precipitation effects in a virtual LiDAR sensor, the method includes receiving a point cloud model representing three-dimensional coordinates of objects as the objects would be sensed by a LiDAR sensor. The method further includes generating a stochastic model of rainfall or snowfall, estimating a probability that a light source from the LiDAR sensor hits a raindrop or a snowflake based on the stochastic model, and modifying the received point cloud model to include effects induced by the modeled rainfall or snowfall based on the probability that light sourced from the LiDAR sensor encounters a raindrop or a snowflake.