Automated Emoticon Generation via Facial Expression Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for generating emoticons, especially for portraits of babies, require manual operation and lack automation, leading to a low degree of automation in conveying emotions across different social groups.

Innovation Solution

A method and device that utilize an expression recognition model to acquire a first expression tag list from a face image, determine corresponding label text based on a preset text and second expression tag list, and generate an emoticon by labeling an expression image, allowing for personalized and automated emoticon creation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If manual operation is used for emoticon generation, then customization and accuracy can be maintained, but automation level and efficiency deteriorate

Engineering Contradiction:
Improveautomation levelVSAvoidmanual operation requirement
Core Design Contradiction:
Extent of automationVSEase of operation

Solution Approach 1:

The system performs self-service by automatically recognizing facial expressions, selecting appropriate emoticons, and generating personalized emoticons without requiring manual user intervention. The expression recognition model autonomously analyzes the input portrait and generates suitable emoticons based on the detected facial expressions.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical operations with an automated information processing system. Instead of manual selection and creation, the system uses expression recognition models, text classification algorithms, and automated image processing to generate emoticons, substituting human cognitive and manual tasks with computational processes.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If automated emoticon generation is implemented, then efficiency and automation level improve, but accuracy and customization may deteriorate

Engineering Contradiction:
Improvegeneration efficiencyVSAvoidexpression accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system incorporates feedback mechanisms where the expression recognition model continuously refines its analysis of facial expressions, and the text classification model adjusts its selections based on the recognized expressions. This iterative feedback process ensures high accuracy in automated generation while maintaining expression precision.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent employs parameter changes by adjusting the sensitivity and threshold parameters of the expression recognition model to optimize both speed and accuracy. The system can modify classification parameters and recognition thresholds to balance between generation efficiency and expression accuracy based on different application requirements.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If personalized emoticons are generated based on facial expressions, then customization and emotional accuracy improve, but processing complexity and time consumption increase

Engineering Contradiction:
Improvepersonalization capabilityVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the complex personalization process into independent modules: facial expression recognition, text classification, emoticon selection, and image generation. Each module processes specific tasks separately, reducing overall processing complexity while maintaining high personalization capability through coordinated operation of these segmented functions.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11922725B2Method and device for generating emoticon, and storage medium
Publication Date: 2024.03.05 BEIJING XIAOMI PINECONE ELECTRONICS CO LTD
  • US11922725B2 patent drawing
  • US11922725B2 patent drawing
  • US11922725B2 patent drawing

AI summary

A method and a device for generating an emoticon are provided. A first expression tag list corresponding to a face image in a portrait is acquired by inputting the face image into an expression recognition model. Additionally, at least one label text corresponding to the face image is determined based on the first expression tag list and a correspondence between a preset text and a second expression tag list. Furthermore, an expression image corresponding to the portrait is determined, where the face image is a part of the expression image. Moreover, an emoticon is generated by labelling the expression image with the at least one label text.