In-Cabin Facial Expression Monitoring for Child Safety Response

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing vehicle safety systems fail to account for individual differences among living beings, leading to insufficient safety measures for individuals left in vehicles, even when temperature and elapsed time fall within a reference range.

Innovation Solution

An information processing apparatus that determines the safety of a living being by analyzing facial expressions, including emotions and face states, to activate safety functions such as alarms, notifications, and air conditioner adjustments, ensuring safety in consideration of individual differences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If temperature and elapsed time monitoring is used to determine living body safety, then the safety assessment can be performed with simple reference ranges, but individual differences among living bodies cannot be accounted for

Engineering Contradiction:
ImproveIndividual difference considerationVSAvoidSystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system dynamically adjusts the safety assessment by transitioning from static temperature/time thresholds to dynamic facial expression analysis. The facial expression recognition unit continuously monitors and adapts the safety determination based on real-time emotional states, allowing the system to respond to individual differences in how living bodies react to thermal stress.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The invention changes the assessment parameters from physical measurements (temperature, time) to physiological indicators (facial expressions, emotions). By monitoring changes in facial muscle states and emotional expressions, the system captures individual physiological responses to heat stress, enabling personalized safety assessment without requiring complex individual calibration.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If facial expression analysis is added to assess living body safety, then individual differences can be considered, but the system complexity and processing requirements increase

Engineering Contradiction:
ImproveSafety assessment accuracyVSAvoidSystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The facial expression recognition unit serves multiple functions: it detects emotional states, assesses safety levels, and provides the basis for activating safety functions. This multi-functionality reduces the need for separate dedicated sensors and processing units for each assessment dimension, thereby limiting the increase in system complexity while improving reliability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The control unit acts as an intermediary that integrates facial expression analysis results with existing temperature and time data. It synthesizes multiple input sources to make the final safety determination, allowing the system to leverage simple reference ranges while incorporating sophisticated facial expression analysis without requiring complete system redesign.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Loss of time

If real-time facial expression monitoring is implemented, then timely safety interventions can be activated, but the processing time and computational load increase

Engineering Contradiction:
ImproveResponse timeVSAvoidProcessing efficiency
Core Design Contradiction:
Loss of timeVSProductivity

Solution Approach 1:

The system performs preliminary classification of facial expressions into safety-related categories (normal, distressed, critical) using pre-trained recognition models. This preliminary action filters out non-critical variations and focuses computational resources on identifying expressions that indicate safety concerns, reducing processing time for timely interventions.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

When facial expressions indicate potential safety issues, the system skips detailed analysis steps and directly activates safety functions. The control unit is configured to bypass further processing and immediately trigger appropriate safety responses when critical expressions are detected, ensuring rapid response time when it matters most.

Inventive Principle:
Principle #21Skipping (Rushing through)

Data Source

PatentUS11830343B2Information processing apparatus, information processing method, and non-transitory storage medium
Publication Date: 2023.11.28 TOYOTA JIDOSHA KK
  • US11830343B2 patent drawing
  • US11830343B2 patent drawing
  • US11830343B2 patent drawing

AI summary

A control apparatus includes a living body presence/absence determination unit configured to determine whether a predetermined living body is left in a vehicle cabin, a cabin camera configured to acquire image data containing a face of the predetermined living body left in the cabin, a facial expression analysis information acquisition unit configured to acquire information on facial expression of the predetermined living body based on the image data, a determination unit configured to determine whether a safety of a life of the predetermined living body is a predetermined reference or lower based on the information on the facial expression, and a control unit configured to, when the determination unit determines that the safety of the life of the predetermined living body is the predetermined reference or lower, activate a safety function for ensuring the safety of the life of the predetermined living body.