In-Vehicle User State Detection for Proactive Comfort Response

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing vehicle agent systems lack improvements in user experience, particularly in actively responding to user states such as stress or drowsiness without requiring user input.

Innovation Solution

An information processing device that estimates user states based on voice, image, and biometric data, and executes predetermined processes in the vehicle to mitigate adverse effects, such as fragrance spraying, music reproduction, or seat vibration, when certain conditions are met.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the agent system passively waits for user instructions, then the system complexity is low, but the user experience is insufficient

Engineering Contradiction:
Improveuser experienceVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by proactively estimating user state (stress, drowsiness) before the user explicitly requests assistance. The control unit continuously monitors user information and executes predetermined processes in advance based on estimated state, rather than waiting for user instructions. This transforms the passive agent system into an active one that anticipates user needs.

Inventive Principle:
Principle #10Preliminary action

2Ease of operation

If the system proactively monitors and responds to user state, then the user experience is improved, but the measurement and detection difficulty increases

Engineering Contradiction:
Improveuser experienceVSAvoiduser state detection
Core Design Contradiction:
Ease of operationVSDifficulty of detecting and measuring

Solution Approach 1:

The system segments user state detection into multiple independent channels: voice data analysis, image data analysis, and biometric data analysis. Each channel independently estimates specific aspects of user state (stress, drowsiness), and the control unit integrates these segmented estimates to form a comprehensive user state assessment. This segmentation makes the complex detection task more manageable and accurate.

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If the system uses multiple data types (voice, image, biometric) for state estimation, then the state estimation accuracy is improved, but the device complexity increases

Engineering Contradiction:
Improvestate estimation accuracyVSAvoiddata processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The control unit serves multiple functions: it estimates user state from diverse data types (voice, image, biometric), determines whether the estimated state satisfies predetermined conditions, and executes appropriate predetermined processes. This multi-functional design consolidates complex operations into a single control unit, managing device complexity while maintaining high measurement precision through multi-source data integration.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12611912B2Information processing device
Publication Date: 2026.04.28 TOYOTA JIDOSHA KK
  • US12611912B2 patent drawing
  • US12611912B2 patent drawing
  • US12611912B2 patent drawing

AI summary

An information processing device including a control unit, wherein the control unit estimates a state of a user based on user information including at least one of voice data, image data, or biometric data of a user of the vehicle, and when it is determined that the estimated state satisfies a predetermined condition, executes a predetermined process selected in accordance with the estimated state in the vehicle.