FMCW LiDAR and Solid-State Camera Sensing System
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional camera systems face challenges in accurate detection and recognition of targets due to increased processing load, variability in luminance, and interference from external light and minute objects, while LiDAR systems struggle with resolution and accuracy at longer distances and in complex environments.
Innovation Solution
A sensing system combining a frequency modulated continuous wave LiDAR (FMCW-LiDAR) and a solid-state imaging device, where both devices acquire information from the same side of the subject, enabling stable detection and recognition by integrating speed point cloud data with captured images to enhance accuracy and robustness across various environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If high-resolution image sensor is used in camera system, then detection accuracy is improved, but calculation processing load increases
Solution Approach 1:
The system segments the detection task by dividing the field of view into multiple regions and assigning different detection strategies to different regions. High-resolution camera data is processed only for regions containing target objects, while other regions use lower-resolution data or LiDAR information, thereby reducing overall calculation load while maintaining detection accuracy where needed.
Solution Approach 2:
The system merges data from multiple sensing devices (camera and LiDAR) to achieve accurate detection. By combining high-resolution image data with depth information and processing results from LiDAR, the system can perform detection with reduced computational burden on the camera system alone, as LiDAR provides complementary information that reduces the need for intensive image processing.
2Measurement precision
If LiDAR resolution is increased, then detection accuracy is improved, but frame rate decreases
Solution Approach 1:
The system dynamically adjusts the operating mode of the LiDAR device, switching between high-resolution and low-resolution measurement modes depending on the detection requirements and environmental conditions. This dynamic adjustment allows the system to maintain high frame rates during normal operation while achieving high detection accuracy when needed by temporarily increasing LiDAR resolution.
Solution Approach 2:
The system applies different resolution levels to different spatial regions and detection scenarios. High LiDAR resolution is applied only to regions containing target objects or regions of interest, while other regions use lower resolution settings. This local quality approach maintains overall frame rate while achieving high detection accuracy where required.
3Reliability
If camera processing is performed under low-illuminance conditions, then detection capability is maintained, but luminance variation affects accuracy
Solution Approach 1:
The system introduces LiDAR as an intermediary sensing device that operates independently of visible light conditions. LiDAR uses active illumination with its own light source, providing reliable depth and distance information under low-illuminance conditions where camera-based detection would fail or be inaccurate. This intermediary device compensates for the camera's limitations in low-light environments.
Solution Approach 2:
The system creates a composite sensing approach by combining data from optical camera sensors and LiDAR sensors. This composite sensing system leverages the strengths of both technologies: the camera provides high-resolution visual information under good lighting conditions, while LiDAR provides reliable geometric information under all lighting conditions, together achieving robust detection across varying illuminance.
4Area of stationary object
If camera captures entire field of view, then monitoring coverage is improved, but processing time increases
Solution Approach 1:
The system segments the field of view into multiple regions and processes only those regions containing target objects or regions of interest. By dividing the monitoring coverage into manageable segments and applying selective processing to each segment rather than processing the entire field of view uniformly, the system maintains comprehensive monitoring coverage while significantly reducing overall processing time.
Solution Approach 2:
The system applies partial processing action by focusing computational resources only on portions of the field of view where target objects are detected or where detection is critical. Rather than performing full detection processing on the entire field of view at all times, the system dynamically adjusts processing intensity based on detected object locations, achieving effective monitoring with reduced processing time.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system achieves stable, high-speed, and high-accuracy detection and recognition of targets by leveraging the strengths of both technologies, mitigating the limitations of each, such as reduced processing load, improved accuracy under varying light conditions, and increased resolution through combined data processing.
Implementation Method 1
a light detection and ranging device that outputs a speed image based on speed point cloud information based on a reception signal reflected and received by a subject as information of the subject, the light detection and ranging device using a frequency modulated continuous wave
Implementation Method 2
a reception signal reflected and received by a subject
Implementation Method 3
a solid-state imaging device that outputs a captured image obtained by capturing an image of the subject
Data Source
AI summary
A sensing system (1) according to an embodiment includes: a light detection and ranging device (11) that outputs a speed image based on speed point cloud information based on a reception signal reflected and received by a subject as information of the subject, the light detection and ranging device using a frequency modulated continuous wave; and a solid-state imaging device (12) that outputs a captured image obtained by capturing an image of the subject as information of the subject, and the light detection and ranging device and the solid-state imaging device are arranged to acquire information from the same side of the subject.