Vehicle User Assistance via Pre-Entry Voice Mood Inference

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Inferring the mental state of a vehicle user at the start of travel is challenging due to fluctuations in posture, heart rate, and silence upon entering the vehicle, making it difficult for existing systems to provide timely assistance based on the user's mental state.

Innovation Solution

A vehicle user-assistance system that infers the mental state from the user's voice acquired before entering the vehicle, using a smartphone and server to analyze the voice data and provide assistance through navigation, scent, light, and voice adjustments to promote relaxation or alertness, and generates data for insurance premium calculations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the user's mental state is inferred from posture, viewpoint, or heart rate information, then the system can provide user assistance, but the inference accuracy deteriorates because the user's posture, viewpoint, and heart rate fluctuate before and after entering the vehicle

Engineering Contradiction:
Improvemental state inference accuracyVSAvoidmeasurement stability
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system performs mental state inference before the user enters the vehicle, when the user is in a relatively stable state. By acquiring voice information before entry and performing inference at this timing, the system avoids the fluctuations that occur during and after entry, thereby maintaining high inference accuracy without requiring complex stabilization mechanisms

Inventive Principle:
Principle #10Preliminary action

2Loss of time

If the system waits to acquire the user's voice after the user enters the vehicle, then the assistance can be provided inside the vehicle, but the mental state inference cannot be performed promptly because users do not always talk after entering

Engineering Contradiction:
Improveassistance start timeVSAvoidvoice acquisition reliability
Core Design Contradiction:
Loss of timeVSLoss of information

Solution Approach 1:

The system acquires voice information before the user enters the vehicle and performs mental state inference at this timing. This preliminary action ensures that assistance can start immediately upon entry without waiting for the user to speak inside the vehicle, thereby reducing time loss while maintaining reliable information acquisition

Inventive Principle:
Principle #10Preliminary action

3Productivity

If the system provides assistance based on mental state inferred after vehicle entry, then the assistance can address the user's current state, but the response time is delayed due to posture and physiological fluctuations during entry

Engineering Contradiction:
Improveassistance response speedVSAvoidmental state measurement accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system performs mental state inference before the user enters the vehicle when physiological parameters are stable. This preliminary inference allows the system to prepare assistance measures in advance and start providing assistance immediately upon entry, thereby improving response speed while maintaining measurement precision by avoiding entry-related fluctuations

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11872992B2Vehicle user-assistance system, vehicle user-assistance device, and vehicle user-assistance server
Publication Date: 2024.01.16 TOYOTA JIDOSHA KK
  • US11872992B2 patent drawing
  • US11872992B2 patent drawing
  • US11872992B2 patent drawing

AI summary

In a vehicle user-assistance system, a user's voice is acquired before the user enters a vehicle, and the mental state of the user is inferred based on the acquired voice. Then, it is determined whether the inferred mental state is an irritated state compared with a criterial value. When the mental state is an irritated state, navigation that relieves irritation is proposed to the user having entered the vehicle. Thus, the user starts to travel with his or her irritation reduced or relieved.