Vehicle Occupant State Detection Using Camera and Millimeter-Wave Radar
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing occupant monitoring systems are ineffective in accurately detecting the physical states of vehicle occupants, particularly when the vehicle is in a stopped state, due to obstacles and varying seated positions, which hinders accurate detection of occupants hidden from view or in non-traveling states.
Innovation Solution
An occupant state detection system comprising a first occupant monitoring apparatus using cameras for external data, a second occupant monitoring apparatus employing millimeter-wave radar for biological data, and a determination apparatus to differentiate between traveling and stopped states, allowing the system to assign monitoring parameters and detect physical states based on combined data from both apparatuses.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a single occupant monitoring apparatus is used, then device complexity is reduced, but measurement precision of occupant physical state deteriorates
Solution Approach 1:
The patent combines camera-based monitoring and radar-based monitoring into a single integrated occupant state detection system. The camera captures visual information about occupant position and posture, while the radar simultaneously measures physical states such as breathing and heartbeat. By merging these two monitoring approaches, the system achieves comprehensive detection accuracy without requiring multiple separate apparatus installations.
Solution Approach 2:
The integrated monitoring system performs multiple functions simultaneously: it detects both visual occupant state information via camera and physiological physical state information via radar. This multi-functional approach allows a single system to replace what would traditionally require separate monitoring devices, thereby improving measurement precision while avoiding increased device complexity.
2Reliability
If monitoring is performed only during traveling state, then energy consumption is reduced, but reliability of occupant state detection deteriorates
Solution Approach 1:
The system dynamically adjusts its monitoring operations based on vehicle state. During traveling, the system performs full monitoring with both camera and radar active. During stopped state, the system transitions to a lower-power mode where the camera continues to monitor occupant position while radar operation is reduced or suspended. This dynamic adaptation ensures detection reliability during critical traveling periods while reducing energy consumption during stopped periods when monitoring urgency is lower.
3Measurement precision
If camera-only monitoring is used, then device complexity is reduced, but measurement precision of physical state deteriorates
Solution Approach 1:
The system replaces purely optical/mechanical camera-based detection with a combination that includes radar technology. The radar component uses electromagnetic wave reflection to detect physiological movements related to breathing and heartbeat, providing physical state measurement capabilities that cameras cannot achieve. This substitution enhances measurement precision by adding a complementary detection modality that operates on different physical principles.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate detection of physical states of occupants in stopped vehicle states by complementing camera and radar data, enhancing accuracy and reliability compared to systems operating only during traveling states.
Implementation Method 1
a second occupant monitoring apparatus employing millimeter-wave radar for biological data
Data Source
AI summary
An occupant state detection system includes first and second occupant monitoring apparatuses, a determination apparatus, and an occupant state detection apparatus. The first and second occupant monitoring apparatuses monitor a physical state of an occupant in a vehicle in different methods. The occupant state detection apparatus includes one or more first processors and one or more first memories. Upon receiving data indicating that the vehicle is in a stopped state from the determination apparatus, the one or more first processors cooperate with one or more programs in the one or more first memories to: make assignment of a part to be monitored and data to be acquired, of the occupant in the vehicle, to be detected by the first and second occupant monitoring apparatuses; and detect the physical state of the occupant on the basis of first and second occupant monitoring data from the first and second occupant monitoring apparatuses.