Dichroic Mirror 3D LiDAR for Camera-LiDAR Image Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional LIDAR devices for autonomous vehicles face challenges in synchronizing their field of view with cameras, requiring additional computational power and are hindered by deviations in spin speeds, leading to mismatches in image synchronization.

Innovation Solution

A 3D LIDAR system that uses a dichroic mirror to direct both visible and invisible light beams from a target to separate cameras and sensors, allowing for automatic synchronization of images without the need for additional processing, and includes a scanning component to increase pixel density and a zoom lens to adjust the field of view.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If traditional mechanical LIDAR devices with motorized rotating spinners are used to achieve 360 degrees horizontal field of view, then the field of view coverage is improved, but the synchronization with cameras becomes complex requiring additional computational power and may lead to mismatches due to spin speed deviations

Engineering Contradiction:
Improvehorizontal field of viewVSAvoidimage synchronization complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical rotating spinner system with a fixed optical array configuration. Multiple LIDAR sensors are arranged in a fixed geometric pattern around the vehicle, eliminating mechanical rotation while maintaining 360-degree coverage. This substitution resolves the synchronization issue by removing the moving parts that caused spin speed deviations and computational complexity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent divides the single 360-degree LIDAR function into multiple fixed LIDAR sensors positioned at different locations (front, rear, left, right). Each sensor covers a specific sector, and together they provide complete coverage. This segmentation eliminates the need for mechanical rotation and simplifies synchronization since all sensors are stationary and can be coordinated through software timing.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If LIDAR spin speeds vary over time, then the LIDAR can adapt to different scanning requirements, but image synchronization mismatches occur between LIDAR and camera data

Engineering Contradiction:
Improvescan speed adaptabilityVSAvoidimage synchronization accuracy
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent implements a fixed physical configuration with dynamic software control. The LIDAR sensors are physically fixed in position, but the system dynamically adjusts scanning patterns, rotation speeds, and data processing timing through software to adapt to different operational requirements while maintaining synchronization accuracy.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If computational algorithms are added to synchronize LIDAR and camera field of view, then synchronization accuracy improves, but computational power requirements and system complexity increase

Engineering Contradiction:
Improvefield of view alignment accuracyVSAvoidcomputational processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent establishes precise physical alignment of LIDAR sensors and cameras during the manufacturing and installation phase. The sensors are positioned and oriented to have inherent geometric relationships, so that their fields of view are naturally aligned without requiring complex real-time computational synchronization. This preliminary physical configuration reduces the computational burden to simple coordinate transformations.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the generation of synchronized 3D images with both distance and color information, reducing computational load and improving accuracy in object detection and navigation for autonomous vehicles.

Implementation Method 1

a dichroic mirror configured to direct the light beam reflected from the target to the light detector to generate a first image, wherein the dichroic mirror further directs optical lights reflected from the target to the first camera to generate a second image

Methodology Applied
Scientific EffectDichroic mirror reflection: Reflection

Data Source

PatentUS11758111B23D lidar system using a dichroic mirror for autonomous driving vehicles
Publication Date: 2023.09.12 BAIDU USA LLC
  • US11758111B2 patent drawing
  • US11758111B2 patent drawing
  • US11758111B2 patent drawing

AI summary

In one embodiment, a three-dimensional LIDAR system includes a light source (e.g., laser) to emit a light beam (e.g., a laser beam) to sense a physical range associated with a target. The system includes a camera and a light detector (e.g., a flash LIDAR unit) to receive at least a portion of the light beam reflected from the target. They system includes a dichroic mirror situated between the target and the light detector, the dichroic mirror configured to direct the light beam reflected from the target to the light detector to generate a first image, wherein the dichroic mirror further directs optical lights reflected from the target to the camera to generate a second image. The system includes an image processing logic coupled to the light detector and the camera to combine the first image and the second image to generate a 3D image.