Hyperspectral LiDAR Classification of Solid and Non-Solid Reflections

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles face challenges in distinguishing between solid and non-solid reflective features using conventional LIDAR, leading to unnecessary maneuvers to avoid non-hazardous objects like exhaust plumes and water vapor, which can impact safety and fuel efficiency.

Innovation Solution

Combining LIDAR with a hyperspectral sensor to characterize reflective features spectrally, identifying solid materials based on their spectral fingerprints and controlling the vehicle to avoid only solid obstacles while ignoring non-solid ones.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional LIDAR is used to detect reflective features, then the vehicle can identify objects in the environment, but it cannot distinguish between solid and non-solid objects leading to unnecessary maneuvers

Engineering Contradiction:
Improveobject classification accuracyVSAvoidnavigation efficiency
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent combines LIDAR technology with hyperspectral imaging technology into an integrated sensing system. The LIDAR provides precise spatial mapping and distance measurement, while the hyperspectral sensor captures spectral signatures of detected objects. By merging these two technologies, the system achieves both accurate object detection and material classification, enabling distinction between solid and non-solid reflective features without compromising navigation efficiency

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The hyperspectral sensor acts as an intermediary component that bridges the gap between simple object detection and accurate material classification. It captures spectral information that serves as a mediator to identify material composition, allowing the system to determine whether detected reflective features are solid or non-solid without requiring direct contact or complex analysis of the objects themselves

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If the vehicle avoids all reflective features detected by LIDAR, then safety is improved, but fuel efficiency deteriorates due to unnecessary maneuvers around non-solid objects

Engineering Contradiction:
Improvenavigation safetyVSAvoidfuel consumption
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The system applies different navigation responses based on the local quality of detected objects. Solid objects, identified through their spectral signatures, trigger avoidance maneuvers to ensure safety. Non-solid objects, also identified through spectral analysis, are recognized as not requiring avoidance. This localized differentiation in response based on object material properties eliminates unnecessary maneuvers around non-solid features like exhaust plumes or water vapor, reducing energy consumption while maintaining safety

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system changes the parameter of object classification from binary detection to material composition analysis. By analyzing spectral parameters, the system transforms the understanding of detected features from mere presence to material identity. This parameter change enables the navigation system to adjust its behavior dynamically - avoiding solid objects for safety while ignoring non-solid objects to conserve energy, thereby resolving the contradiction between safety and fuel efficiency

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances navigation safety and efficiency by accurately differentiating between solid and non-solid objects, reducing unnecessary maneuvers and improving passenger safety and fuel efficiency.

Implementation Method 1

Individual points are measured by generating a laser pulse and detecting a returning pulse, if any, reflected from an environmental object

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

determining the distance to the reflective object according to the time delay between the emitted pulse and the reception of the reflected pulse

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Implementation Method 3

distinct materials can be identified according to their characteristic spectral transmission and/or reflection 'fingerprints'

Methodology Applied
Scientific EffectSpectral reflection: Reflection

Implementation Method 4

each pixel can include a power spectral density values for a series of wavelength ranges

Methodology Applied
Scientific EffectAbsorption spectroscopy: Absorption Spectroscopy

Data Source

PatentUS11802831B1Characterizing optically reflective features via hyper-spectral sensor
Publication Date: 2023.10.31 WAYMO LLC
  • US11802831B1 patent drawing
  • US11802831B1 patent drawing
  • US11802831B1 patent drawing

AI summary

A light detection and ranging device associated with an autonomous vehicle scans through a scanning zone while emitting light pulses and receives reflected signals corresponding to the light pulses. The reflected signals indicate a three-dimensional point map of the distribution of reflective points in the scanning zone. A hyperspectral sensor images a region of the scanning zone corresponding to a reflective feature indicated by the three-dimensional point map. The output from the hyperspectral sensor includes spectral information characterizing a spectral distribution of radiation received from the reflective feature. The spectral characteristics of the reflective feature allow for distinguishing solid objects from non-solid reflective features, and a map of solid objects is provided to inform real time navigation decisions.