Voice-Based Emotion Tagging for Real-Time Event Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems fail to accurately assign emotion tags to content based on the user's current emotions during an event, as they rely on past emotion information from facial expressions rather than real-time user interactions.

Innovation Solution

An emotion tag assigning system that utilizes a voice detector to capture user emotions during an event, employing machine learning to recognize and assign emotion ranks to content based on voice data, allowing for real-time emotion tagging.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If emotion information is estimated from facial expressions of persons in captured images, then tag information can be assigned to content data, but the emotion information reflects past emotions at the time of capture rather than current emotions during event execution

Engineering Contradiction:
Improveemotion tag accuracyVSAvoidtime lag in emotion detection
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces the optical-based facial expression analysis system with an acoustic-based voice emotion recognition system. By detecting voice data and analyzing emotional characteristics through acoustic signals, the system achieves real-time emotion detection during event execution, eliminating the time lag inherent in capturing and analyzing static facial expressions from captured images.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If fixed-point observation cameras are used to capture viewing environment images, then person recognition and emotion estimation can be performed, but the system cannot capture dynamic emotional responses during content execution

Engineering Contradiction:
Improvereal-time emotion detection capabilityVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent extracts the emotion detection function from the complex fixed-point observation camera system and implements it through a dedicated voice detection unit. By separating the voice detection and emotion recognition components, the system achieves real-time emotion detection during content execution without requiring complex camera systems, thus improving productivity while managing device complexity.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS12444432B2Emotion tag assigning system, method, and program
Publication Date: 2025.10.14 FUJIFILM CORP
  • US12444432B2 patent drawing
  • US12444432B2 patent drawing
  • US12444432B2 patent drawing

AI summary

Provided are an emotion tag assigning system, method, and program for assigning, to a content, an emotion tag indicating an emotion of a user in execution of an event using the content.An emotion tag assigning method includes a step of detecting, by a voice detector, voice data indicating a voice uttered by a person who participates in an event using a content during execution of the event; a step of recognizing, by an emotion recognizer, an emotion of the person based on the voice data; a step of acquiring, by a processor, emotion information indicating the recognized emotion of the person during the execution of the event using the content; and a step of assigning, by the emotion recognizer, an emotion rank calculated from the acquired emotion information to the content as an emotion tag.