Automated Driving Control Using Occupant Emotion Sensing

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing partially automated driving systems fail to adequately adjust to the preferences and emotional states of vehicle occupants, leading to discomfort and reduced acceptance of automated driving features.

Innovation Solution

A method that utilizes interior sensors and temperature sensors to determine occupant information, including emotional states and preferences, to adjust vehicle parameters such as driving style, lighting, and ambient settings for enhanced comfort and emotional well-being.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If manual selection of preferences is implemented for automated driving, then user customization capability is improved, but user effort and system complexity increase

Engineering Contradiction:

Improveuser customization capabilityVSAvoiduser effort

Core Design Contradiction:

Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system automatically detects occupant information using interior sensors (cameras, microphones, temperature sensors) and autonomously determines emotional states and preferences without requiring manual user input. The automated driving control then self-adjusts parameters based on this detected information, making the system serve itself rather than requiring continuous user configuration.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical selection interfaces with automated sensor-based detection systems. Instead of users physically selecting preferences through menus or buttons, the system uses interior sensors to detect emotional states (facial expressions, voice tone, body temperature) and automatically translates these into driving parameter adjustments.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Device complexity

If limited driving styles are provided, then system complexity is reduced, but ability to optimize for user preferences deteriorates

Engineering Contradiction:

Improvesystem complexityVSAvoidability to optimize for user preferences

Core Design Contradiction:

Device complexityVSAdaptability or versatility

Solution Approach 1:

The system dynamically adjusts driving parameters in real-time based on continuously detected occupant information rather than selecting from static pre-defined driving styles. The automated control system modifies acceleration, deceleration, lane changing, and other parameters dynamically according to the detected emotional state, enabling fine-grained optimization without requiring complex pre-programmed driving style categories.

Inventive Principle:

Principle #15Dynamics

3Adaptability or versatility

If automated detection of emotional states is implemented, then driving parameter optimization is improved, but measurement and detection difficulty increases

Engineering Contradiction:

Improvedriving parameter optimizationVSAvoidemotional state detection difficulty

Core Design Contradiction:

Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The system segments emotional state detection into multiple independent sensor modalities: visual detection of facial expressions and eye movements via cameras, auditory detection of voice tone and speech patterns via microphones, and thermal detection of body temperature via temperature sensors. Each sensor type independently measures specific indicators, and the system integrates these segmented measurements to determine overall emotional state, reducing the complexity of any single detection task.

Inventive Principle:

Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances the user experience by tailoring automated driving to individual preferences and emotional states, reducing discomfort and increasing acceptance of automated driving systems.

Implementation Method 1

at least one temperature sensor which senses a body temperature of the vehicle occupant and/or a temperature of the interior

Methodology Applied

Scientific EffectThermal sensing: Thermography

Implementation Method 2

sensor data of at least one interior sensor which at least partially images the vehicle occupant of the motor vehicle

Methodology Applied

Scientific EffectImage sensing: Photography

Data Source

PatentUS12576860B2Method for guiding a motor vehicle in an at least partially automated manner, and motor vehicle

Publication Date: 2026.03.17 AUDI AG

AI summary

Method for guiding a motor vehicle in an at least partially automated manner, wherein the parameter value of at least one parameter of the at least partially automated guidance depends on occupant information relating to a vehicle occupant, wherein the item of occupant information is determined on the basis of sensor data from at least one interior sensor at least partially representing the vehicle occupant of the motor vehicle and/or from at least one temperature sensor recording a body temperature of the vehicle occupant and/or a temperature of the interior.