Emotion-Aware Emoji Generation via Facial Expression Analysis

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional text messaging lacks the richness of emotional expression due to the absence of contextual information, leading to misinterpretation and potential miscommunication, as it relies solely on text-based inputs without considering the user's actual emotional state.

Innovation Solution

A system that utilizes a computing device to determine a user's emotional state through non-text inputs, such as facial expressions, and provides a template-based approach to produce unique emojis or emoticons that accurately reflect the user's mood, allowing for more thoughtful and accurate emotional expression in digital communication.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If text-based messaging is used for digital communication, then communication efficiency and reach are improved, but emotional expression accuracy and contextual information are lost

Engineering Contradiction:

Improvecommunication efficiencyVSAvoidemotional information

Core Design Contradiction:

ProductivityVSLoss of information

Solution Approach 1:

The patent introduces an intermediary system that captures facial expressions and emotional states, then translates them into visual indicators (emojis/emoticons) that mediate between the user's internal emotional state and the text-based communication channel, thereby recovering lost emotional information without compromising communication efficiency

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent merges multiple information sources (text input, facial expressions, physiological signals) into a unified communication output that includes both textual content and emotional indicators, creating a hybrid communication form that preserves both efficiency and emotional richness

Inventive Principle:

Principle #5Merging (Combining)

2Ease of operation

If traditional emoji selection from predefined lists is used, then ease of operation is improved, but accuracy of emotional expression deteriorates because users may select emojis without awareness of their actual emotion

Engineering Contradiction:

Improveemoji selection easeVSAvoidemotion expression accuracy

Core Design Contradiction:

Ease of operationVSMeasurement precision

Solution Approach 1:

The patent implements a feedback mechanism where the system continuously monitors the user's facial expressions and emotional state, providing real-time feedback that influences emoji selection. This feedback loop ensures users are aware of their actual emotional state, improving selection accuracy while maintaining ease of operation through automated assistance

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The system performs self-service by automatically detecting and analyzing the user's emotional state without requiring manual input, then suggesting or selecting appropriate emojis autonomously, thereby maintaining ease of operation while improving emotional expression accuracy

Inventive Principle:

Principle #25Self-service

3Measurement precision

If facial expression analysis is incorporated to improve emoji selection accuracy, then measurement precision of emotional state is improved, but device complexity increases

Engineering Contradiction:

Improveemotional state detection accuracyVSAvoidsystem complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent leverages the smartphone's existing multi-functional camera and sensor system, which already serve photography, video, and various applications, to also perform facial expression analysis. This universal use of existing components improves emotional state detection without significantly increasing device complexity

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent replaces complex mechanical or hardware-based emotion detection systems with software-based image processing and machine learning algorithms that analyze facial expressions from the camera feed, thereby achieving high measurement precision while minimizing additional hardware complexity

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11573679B2Integration of user emotions for a smartphone or other communication device environment

Publication Date: 2023.02.07 TRUSTEES OF THE CALIFORNIA STATE UNIV

AI summary

Methods of real-time emoji and emoticon production are disclosed that include: determining, by a computing device, at least one first emotional state of a user from information, wherein the at least one first emotional state is a presently-identified emotional state of the user; providing an emoji or emoticon production template system, wherein the template system includes at least one physical attribute of the user; and utilizing the emoji or emoticon production template system to: analyze the presently-identified emotional state of the user; determine a suitable map of the presently-identified state of the user; map the presently-identified state of the user on an emoji or emoticon production template; produce at least one unique emoji or emoticon based on the map; provide the at least one unique emoji or emoticon to the user, wherein the user selects the at least one unique emoji or emoticon and includes the at least one unique emoji or emoticon in a text message, a direct message, an electronic mail message, or a combination thereof.