In-Cabin Camera-Radar Fusion for Child Presence and Occupancy Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing vehicle cabin sensor systems rely on separate camera and radar technologies, which are limited in their ability to detect passengers and conditions within the vehicle cabin, particularly in non-line of sight scenarios, and require significant power and external processing, leading to inefficiencies and increased system complexity and cost.
Innovation Solution
An integrated camera and radar subsystem within a single hardware unit that processes radar point cloud and video data using AI for enhanced detection and fusion, enabling applications like child presence, passenger classification, and airbag activation with reduced power consumption and cost.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If separate camera and radar systems are used for inside cabin sensing, then detection coverage is improved, but device complexity and system cost increase
Solution Approach 1:
The patent combines camera and radar sensing capabilities into a single integrated sensor unit, merging two separate detection systems into one cohesive device that provides both visual and electromagnetic detection functions simultaneously
Solution Approach 2:
The integrated sensor unit performs multiple detection functions including child presence detection, seat occupancy detection, intrusion detection, and passenger classification through a single device that incorporates both camera and radar subsystems
2Productivity
If external processing units are used for sensor data processing, then processing capability is improved, but power consumption and system cost increase
Solution Approach 1:
The integrated sensor unit incorporates embedded processing capabilities within the sensor itself, enabling the device to process its own detection data independently without requiring external processing units, thereby reducing overall system power consumption
Solution Approach 2:
The patent extracts the processing function from external separate units and integrates it directly into the sensor hardware, allowing the sensor to perform local data processing and only transmit essential results rather than raw data
3Measurement precision
If multiple sensors are deployed for comprehensive detection, then detection accuracy is improved, but system cost and complexity increase
Solution Approach 1:
The patent merges camera and radar sensing into a single integrated unit that provides multi-modal detection capabilities, achieving the detection accuracy of multiple separate sensors while reducing the overall number of discrete sensor components
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The integrated system provides improved detection accuracy and reduced system cost by fusing camera and radar data, eliminating the need for additional sensors and external processing, thereby enhancing passenger classification and airbag control.
Implementation Method 1
A new generation of inside cabin sensors having radar-based solutions in mm-waves has been introduced recently
Implementation Method 2
a camera sub-system and an integrated radar sub-system
Data Source
Figure 1a~1b
Figure 2a~2b
Figure 3
AI summary
An inside cabin sensor system, having an integrated, single hardware part comprising a camera sub-system and an integrated radar sub-system is proposed. A proposed system provides related information for covering the following applications inside a vehicle: Child Presence Detection (CPD), Driver Drowsiness & Fatigue (F), Driver Distraction (DD) as a safety-relevant function, complemented by Intrusion & Proximity Alert (IPA), Seat Occupancy Detection (SOD), Face Recognition (FR), and optional applications such as Driver Emotion (ES), Passenger Classification (PC), Airbag Suppression (AS), Airbag Activation (AA), Mobile Phone Detection (MP), Gesture Detection (GD) and Vital Signs Detection (VS). A proposed system utilizes Artificial Intelligence (AI)-related data processing for data processing, using radar point cloud data, calculated by said radar sensors. The proposed system utilizes Artificial Intelligence (AI)-related data processing for data processing, using video-captured data. The proposed system utilizes Artificial Intelligence (AI)-related data processing for sensor data fusion, using radar sensor and video sensor data.