Emotion Metadata Integration in Chat Transcripts

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current instant messaging technologies cannot accurately record the emotional states of participants during chat sessions, especially when audio is involved, as emoticons are subjective and fail to capture the emotional nuances conveyed through voice.

Innovation Solution

A method and system that initializes a chat session, collects emotion metadata using biometric detection, maps it to emoticons, and combines speech-recognized audio with text and emoticons into a transcript, incorporating the emotional milieu for a comprehensive chat transcript.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If emoticons are used to represent emotional states in chat transcripts, then emotional information can be recorded, but the emotional state recording is subjective and inaccurate because it depends solely on participant judgment

Engineering Contradiction:

Improveemotional informationVSAvoidemotional state accuracy

Core Design Contradiction:

Loss of informationVSMeasurement precision

Solution Approach 1:

The patent introduces an intermediary system consisting of audio analysis and biometric detection components that objectively measure emotional states from voice characteristics and physiological signals, rather than relying directly on participant self-reporting through emoticons alone

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the manual, subjective emoticon selection mechanism with an automated system using speech recognition, audio analysis, and biometric detection to objectively detect and record emotional states from voice and physiological data

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If audio is included in chat sessions to convey emotional nuances, then emotional expression is enhanced, but the emotional state is lost when audio is not present or when only text is recorded

Engineering Contradiction:

Improveemotional expression capabilityVSAvoidemotional state

Core Design Contradiction:

Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent extracts emotional state information from audio conversations through speech recognition and audio analysis, separating the emotional data from the raw audio so it can be independently stored and referenced in the chat transcript without requiring the original audio to be present

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent creates a textual copy of the audio conversation combined with emoticon representations of emotional states, allowing the emotional information to be preserved in text format that can be stored and reviewed without the original audio

Inventive Principle:

Principle #26Copying

3Ease of manufacture

If only text and emoticons are recorded in chat transcripts, then the transcript is easy to store and retrieve, but the emotional nuances and tone of voice are lost

Engineering Contradiction:

Improvetranscript storage and retrievalVSAvoidemotional nuances

Core Design Contradiction:

Ease of manufactureVSLoss of information

Solution Approach 1:

The patent creates a composite chat transcript that integrates multiple data types including text, speech-recognized audio content, and biometrically-detected emotional states represented as emoticons, combining these elements into a unified transcript format that preserves both the ease of text storage and the richness of emotional information

Inventive Principle:

Principle #40Composite materials

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate recording of emotional states during chat sessions, including audio conversations, by merging emotional metadata with textual transcripts, providing a more nuanced and objective representation of participants' feelings.

Implementation Method 1

collects emotion metadata using biometric detection

Methodology Applied

Scientific EffectBiometric detection:

Implementation Method 2

combines speech recognized form of the audio conversation

Methodology Applied

Scientific EffectSpeech recognition:

Data Source

PatentUS8170872B2Incorporating user emotion in a chat transcript

Publication Date: 2012.05.01 INTERNATIONAL BUSINESS MACHINE CORPORATION

AI summary

Embodiments of the present invention address deficiencies of the art in respect to chat transcript generation for instant messaging and provide a method, system and computer program product for emotional state transcription for chat sessions. In an embodiment of the invention, a method for emotional state transcription for chat sessions can be provided. The method can include initializing a chat session in an instant messenger, engaging in an audio conversation through the instant messenger, collecting emotion meta-data for the audio conversation and mapping the emotion meta-data to emoticons, and combining a speech recognized form of the audio conversation with the emoticons and text from the chat session into a chat transcript. The method further can include computing a milleau for the chat session from the emotion meta-data and incorporating the milleau for the chat session in the transcript.