Facial Emotion Detection Using Neutral-Image Correction Values

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing emotion determination devices face challenges in precision due to individual differences in facial expressions and potential errors from image detection, leading to incorrect emotion outputs.

Innovation Solution

An emotion determination device that acquires a facial image, sets evaluation values for emotion classifications based on a neutral state, computes correction values using a neutral facial image, and applies these values to determine emotions, accounting for individual differences and divergences from a general model.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If correction processing is performed to increase uniformity of evaluation values, then slight changes in facial expression are reflected in emotions, but image detection errors may cause incorrect emotions to be output

Engineering Contradiction:
Improveemotion determination precisionVSAvoidemotion output reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system performs preliminary action by acquiring a neutral facial image before emotion detection and using it to generate correction values that compensate for individual differences. This preliminary correction value generation prevents detection errors from causing incorrect emotion outputs while maintaining sensitivity to actual emotional changes.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system changes parameters by adjusting evaluation values based on correction values derived from neutral facial images. These correction values modify the threshold and baseline parameters for emotion detection, allowing the system to account for individual facial expression characteristics while maintaining reliable emotion determination.

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If general emotion detection models are used, then processing is simplified, but individual differences in facial expressions cause determination errors

Engineering Contradiction:
Improvedetection system complexityVSAvoidemotion determination precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The system applies local quality by generating individual-specific correction values based on each user's neutral facial image. This allows the general detection model to be locally adjusted for each user's facial characteristics, improving precision without requiring completely different detection models for each individual.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The neutral facial image serves as an intermediary that bridges the general emotion detection model and individual user characteristics. By extracting correction values from the neutral image, the system creates a mediator that adapts the general model to individual users without increasing overall system complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11804075B2Emotion determination device, emotion determination method, and non-transitory storage medium
Publication Date: 2023.10.31 TOYOTA JIDOSHA KK
  • US11804075B2 patent drawing
  • US11804075B2 patent drawing
  • US11804075B2 patent drawing

AI summary

An emotion determination device includes a memory and a processor connected to the memory. The processor is configured to acquire a facial image of a user, set an evaluation value for each of plural emotion classifications including a neutral state based on the acquired facial image, compute a correction value using an evaluation value set based on a neutral facial image acquired at a timing corresponding to a neutral state, and determine an emotion of the user by applying the computed correction value to the set evaluation values.