Emotion-Aware Chat Message Rewriting via Facial Photo Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for conveying emotions in text messages, such as emoticons and automatic font modifications, fail to accurately represent the emotional state of the sender and are often ambiguous, leading to misinterpretation in multi-party chat sessions.

Innovation Solution

An electronic chat session monitoring device intercepts text messages and associated photos to determine the emotional state of the sender, rewriting the message to match the depicted emotion and transmitting the rewritten message with the photo to ensure accurate emotional representation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If emoticons are used to convey emotions in text messages, then the emotional expression capability is improved, but the accuracy of emotional representation deteriorates due to trivialization and limited predefined options

Engineering Contradiction:
Improveemotional expression capabilityVSAvoidemotional representation accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system captures actual photographs of the sender's face at the moment of message creation, creating a real visual copy of their emotional state. This photograph is then transmitted with the message, replacing the need for emoticons and providing an accurate, unfiltered representation of the sender's emotions.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the manual selection mechanism of emoticons with an automated photograph capture and analysis system. The camera automatically captures the sender's facial expression, and the system processes this visual data to convey emotions without requiring user intervention or selection from predefined options.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If automatic font modifications are applied to convey emotions, then the effort required from the user is reduced, but the clarity of emotional conveyance deteriorates due to ambiguous font interpretations

Engineering Contradiction:
Improveuser effort in emotional expressionVSAvoidemotional conveyance clarity
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

Instead of using font modifications to represent emotions, the system captures an actual visual copy (photograph) of the sender's emotional state. This photograph provides unambiguous evidence of the sender's feelings, eliminating the interpretation issues inherent in font-based emotional indicators.

Inventive Principle:
Principle #26Copying

3Loss of information

If text messages are enhanced with emotional indicators, then the emotional information content is improved, but the ambiguity and potential for misinterpretation increases

Engineering Contradiction:
Improveemotional information contentVSAvoidinterpretation accuracy
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The system transmits an actual photograph of the sender's face as an objective record of their emotional state at the time of messaging. This visual copy serves as reliable evidence that reduces misinterpretation, as recipients can directly observe the sender's genuine emotions rather than relying on potentially misleading textual or graphical indicators.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The photograph provides immediate visual feedback about the sender's emotional state, allowing recipients to accurately interpret the intended meaning behind the message. This feedback mechanism eliminates the ambiguity present in traditional text-based emotional indicators.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10904183B2Point in time expression of emotion data gathered from a chat session
Publication Date: 2021.01.26 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10904183B2 patent drawing
  • US10904183B2 patent drawing
  • US10904183B2 patent drawing

AI summary

A method rewrites a text message according to an emotional state of a sender of the text message while originally writing the text message. An electronic chat session monitoring device intercepts a current text message from an electronic chat session, where the current text message is generated by an initial sender at a sending device. The electronic chat session monitoring device receives a current photo, of the initial sender of the current text message, that depicts the initial sender while generating the current text message. The electronic chat session monitoring device determines that the emotional state of the initial sender, as evidenced by the current photo, is incongruous with a content of the current text message, and rewrites text in the current text message to comport with the emotional state of the initial sender while generating the current text message.