LiDAR-Imager Synchronization for 3D Fusion Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies lack a method to synchronize a ranging apparatus and an image-capturing apparatus for improved fusion recognition performance.
Innovation Solution
A sensor fusion system that includes a ranging apparatus with a light source module and an image-capturing apparatus, synchronized by a synchronization controller to control the timing of light emission and pixel exposure, enabling synchronized distance and image data fusion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a ranging apparatus and an image-capturing apparatus are used separately without synchronization, then each apparatus can independently capture distance and image data, but the fusion recognition performance is poor due to lack of temporal and spatial coordination
Solution Approach 1:
The patent merges the ranging apparatus and image-capturing apparatus into a unified sensor fusion system with shared control. The synchronization controller coordinates the light source emission timing with the pixel exposure timing, and the drive section synchronizes the light emission direction with the pixel scanning direction, creating an integrated system that captures correlated distance and image data simultaneously.
Solution Approach 2:
The synchronization controller receives feedback from the drive section about the light emission direction and adjusts the pixel exposure timing accordingly. The system uses feedback loops to ensure that the light is emitted to the same region that the pixels are scanning, maintaining temporal and spatial correlation between the ranging and imaging data.
2Measurement precision
If the light source emits light continuously to all directions, then complete coverage is achieved, but the energy consumption increases and the measurement precision for specific regions decreases
Solution Approach 1:
The drive section controls the light source to emit light in specific directions corresponding to the pixel scanning direction, rather than continuously in all directions. This localized light emission concentrates energy on the regions of interest, improving measurement precision while reducing overall energy consumption.
Solution Approach 2:
The light source emits light periodically in sync with the pixel scanning process. The drive section modulates the light emission timing and direction to match the periodic scanning of pixels, ensuring that light is emitted only when and where needed for measurement, optimizing both precision and energy efficiency.
3Area of stationary object
If the pixel array scans in one direction only, then the scanning process is simple, but the coverage area and data completeness are limited
Solution Approach 1:
The drive section controls the light source to scan in one direction (first direction) while the pixels scan in an orthogonal direction (second direction). This two-dimensional scanning approach, achieved by adding directional control to the light source, expands the coverage area without significantly increasing the complexity of individual scanning mechanisms.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances three-dimensional object recognition performance by synchronizing distance and image data, overcoming limitations of individual data types.
Implementation Method 1
a light receiver that has a specified light-receiving range, and receives the light that is emitted by the light source section to be reflected off an object
Implementation Method 2
a period-of-time measurement section that measures a period of time from the light source section emitting the light to the light receiver receiving the light reflected off the object
Data Source
AI summary
A sensor fusion system is provided that includes a ranging apparatus, an image-capturing apparatus, and a synchronization controller, the ranging apparatus including a light source module, a light source controller, and a light receiver, the light source module including a light source section, the image-capturing apparatus including a pixel section, an AD converter, and an exposure controller, the synchronization controller controlling the light source controller and the exposure controller such that a timing at which the light source section emits light to a specified region is synchronized with a timing at which a group of pixels corresponding to the specified region is exposed. The present disclosure is applicable to, for example, a sensor fusion system in which LiDAR and an imager are used in synchronization with each other.