Intersection 3D Sensor Fusion for Occlusion-Aware Hazard Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems face challenges in securing high-density 3D data due to occlusion phenomena between objects, leading to reduced recognition accuracy and delayed prediction of moving objects, which can cause accidents in complex urban environments.
Innovation Solution
An interaction system that integrates multiple 3D data through sensor fusion to create a precise 3D space, using infrastructure image sensors to restore 3D cloud points, generate real-time 3D maps, estimate objects, and recognize dangerous situations, enabling accurate object tracking and interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If unidirectional sensors are used for object detection, then device complexity is reduced, but measurement precision deteriorates due to occlusion by structures and parked vehicles
Solution Approach 1:
The patent combines multiple unidirectional sensors (Lidar, cameras, infrared sensors) arranged at different locations around the intersection to form a sensor fusion system. This merging approach allows the system to overcome individual sensor occlusions by aggregating data from multiple perspectives, thereby maintaining detection accuracy without requiring complex omnidirectional sensors.
Solution Approach 2:
The patent introduces a central server as an intermediary that receives data from multiple unidirectional sensors and performs sensor fusion processing. This intermediary consolidates information from various sensor sources, reconstructs occluded object positions, and provides comprehensive spatial awareness, effectively mediating between simple sensor hardware and accurate detection requirements.
2Measurement precision
If sensor fusion based 3D space creation is implemented, then measurement precision is improved through occlusion restoration, but device complexity increases due to multiple sensors and processing modules
Solution Approach 1:
The patent segments the complex sensor fusion system into distinct functional modules: infrastructure image sensor-based 3D cloud restoration module, real-time 3D map creation and learning update module, object estimation module, and dangerous situation recognition module. Each module performs a specific function, making the overall complex system more manageable and maintainable while achieving high precision 3D reconstruction.
3Reliability
If real-time 3D map updates are performed continuously, then reliability is improved for accident prevention, but use of energy increases due to continuous sensor operation and data processing
Solution Approach 1:
The patent implements periodic updates of the 3D map and object tracking at strategically determined intervals rather than continuous updates. The system monitors changes in the environment and updates the 3D representation when significant changes occur, such as when new objects enter the intersection or when occlusion patterns change, thereby reducing energy consumption while maintaining safety reliability.
Data Source
AI summary
The interaction system includes: an infrastructure image sensor-based 3D cloud restoration module configured to create a 3D cloud point using a multi-view image received from an infrastructure sensor; a real-time 3D map creation and learning update module configured to generate subset data composed of point clouds into a 3D map using 3D point information received from the infrastructure image sensor-based 3D cloud restoration module; an object estimation module in a 3D space configured to recognize and track an object existing in a 3D space based on the 3D map received from the real-time 3D map creation and learning update module; and a dangerous situation recognition and interaction module in space configured to receive information on an object existing in the 3D space from the object estimation module in the 3D space, recognize a dangerous situation, and provide dangerous situation related information.