Passenger State Detection Using Camera-Sensor Cross-Verification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing passenger state determination devices face challenges in accurately determining the state of vehicle passengers due to erroneous determinations by cameras and sensors, leading to inconsistent and unreliable outcomes.

Innovation Solution

A passenger state determination device utilizing multiple methods (camera and sensor) to determine passenger states, with a third determination part to verify and correct inconsistencies between the first and second determination results, ensuring accurate final determinations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If camera-based determination is used to assess passenger state, then the system can detect facial expressions and visual cues, but it may erroneously determine state when other objects or passengers obstruct the camera view

Engineering Contradiction:
Improvepassenger state detection accuracyVSAvoiddetermination reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent combines camera-based determination and sensor-based determination into a unified passenger state determination system. The determination result generation unit integrates results from both methods, using sensor data to validate and correct camera-based determinations, thereby resolving the contradiction between measurement precision and reliability.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The sensor acts as an intermediary to verify camera-based determination results. When the camera determines abnormal state, the sensor provides additional verification data about passenger posture and position, serving as a mediator to confirm or correct the camera's assessment, thus improving reliability without sacrificing detection accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If sensor-based determination is used to assess passenger state, then the system can detect posture and position accurately, but it may erroneously determine state when passenger position changes normally (e.g., leaning forward to read newspaper)

Engineering Contradiction:
Improveposture detection accuracyVSAvoidstate determination reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent merges sensor-based determination with camera-based determination to create a complementary system. The camera provides contextual information about passenger intent and environment, which helps distinguish between abnormal postures (indicating distress) and normal postures (such as leaning to read), thereby improving reliability while maintaining precise posture detection.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system implements feedback mechanisms where the camera continuously monitors passenger state and provides corrective information to validate sensor-based determinations. When sensor data suggests abnormal state but camera observations indicate normal activity (like reading), the camera feedback corrects the determination, preventing false alarms while maintaining accurate posture monitoring.

Inventive Principle:
Principle #23Feedback

3Reliability

If multiple determination methods are used to improve accuracy, then the system can cross-verify results, but it increases device complexity and processing requirements

Engineering Contradiction:
Improvedetermination reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the determination system into distinct functional modules: camera-based determination unit, sensor-based determination unit, and determination result generation unit. Each module operates independently with specific responsibilities, and the result generation unit selectively integrates their outputs based on pre-established criteria, thereby managing complexity through structured division of labor.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies different determination strategies based on local conditions and data quality. The determination result generation unit selectively weights and integrates results from camera and sensor based on their respective strengths in specific situations, rather than uniformly processing all data through complex algorithms, thus improving reliability while controlling overall system complexity.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12423996B2Passenger state determination device and passenger state determination method
Publication Date: 2025.09.23 MITSUBISHI ELECTRIC CORP
  • US12423996B2 patent drawing
  • US12423996B2 patent drawing
  • US12423996B2 patent drawing

AI summary

A passenger state determination device includes: a third determination part finally determining a state of a passenger based on a first determination result as a determination result of the state of the passenger by the first determination part and a second determination result as a determination result of the state of the passenger by the second determination part. The third determination part determines the first determination result to be a final determination result of the state of the passenger in a normal state, and when the first determination result is changed and the third determination part determines that the first determination result after the change is not appropriate, the third determination part determines the second determination result or the first determination result before the change to be a final determination result of the state of the passenger.