Gated Convolutional Encoder-Decoder for Text Affect Labeling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for analyzing affective characteristics in human expressions are unreliable and inefficient due to subjective manual tagging and limited ground-truth datasets, leading to inconsistent and inaccurate characterizations.

Innovation Solution

A gated convolutional encoder-decoder framework is used to automatically identify and assign affective characteristic labels to input text by concatenating linguistic features with latent representations, providing a consistent and efficient characterization of non-factual components for targeted audiences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual tagging and curation of affective characteristics is used, then ground-truth datasets can be created, but the process is tedious and limits the amount of available training data

Engineering Contradiction:
Improveaccuracy of affective characteristic labelingVSAvoidamount of training data available
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system uses self-supervised learning where the model trains on unlabeled data by predicting affective characteristics itself, rather than requiring manual annotation. The encoder-decoder architecture automatically generates training labels from the input text, enabling the system to create its own ground-truth datasets without human intervention.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The model performs preliminary encoding of text into latent representations before final classification. This intermediate representation is used to predict affective characteristics, allowing the system to process large volumes of data efficiently and generate training labels in advance without requiring manual curation.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If manual identification of affective characteristics is used, then labeled data can be obtained, but the subjective nature of individuals leads to inconsistency and inaccuracy

Engineering Contradiction:
Improveconsistency of affective characteristic characterizationVSAvoidsubjectivity in manual tagging
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent replaces the mechanical process of manual human annotation with an automated machine learning system. The encoder-decoder model objectively processes text through learned representations, eliminating human subjectivity and ensuring consistent, reproducible affective characteristic identification across all inputs.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system transforms the problem from subjective human judgment to objective parameter prediction. By encoding text into latent representations and predicting affective characteristics as measurable parameters, the system converts qualitative human perception into quantitative, consistent outputs that can be reliably reproduced.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If a team of individuals manually monitors human expressions, then fine-grained affective characteristics can be identified, but the process amplifies reliability and inaccuracy issues

Engineering Contradiction:
Improvefine-grained affective characteristic detectionVSAvoidconsistency across different individuals
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system segments the affective characteristic detection task into distinct functional components: encoding text into latent representations, predicting affective characteristics from these representations, and generating final labels. This segmentation allows each component to be optimized independently and ensures consistent application of the same processing logic across all inputs.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The latent representation serves as an intermediary between the input text and the final affective characteristic labels. This intermediate layer standardizes the information representation, ensuring that all inputs are processed through the same learned transformations before classification, thereby eliminating variability introduced by different annotators.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Productivity

If supervised learning algorithms are trained with limited ground-truth datasets, then the models can be trained, but the effectiveness and accuracy of the algorithms are limited

Engineering Contradiction:
Improvetraining efficiencyVSAvoidaccuracy of affective characteristic prediction
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system performs preliminary encoding of all input text into latent representations before classification. This pre-processing step creates a standardized representation space that can be used for both training and inference, allowing the model to efficiently learn patterns from the encoded representations rather than processing raw text during training.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The encoder-decoder architecture serves multiple functions: it encodes text into latent representations, decodes these representations into affective characteristic predictions, and generates training labels from unlabeled data. This multi-functionality allows a single model to handle both training and inference tasks, maximizing the utility of available data.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11886480B2Detecting affective characteristics of text with gated convolutional encoder-decoder framework
Publication Date: 2024.01.30 ADOBE INC
  • US11886480B2 patent drawing
  • US11886480B2 patent drawing
  • US11886480B2 patent drawing

AI summary

Certain embodiments involve using a gated convolutional encoder-decoder framework for applying affective characteristic labels to input text. For example, a method for identifying an affect label of text with a gated convolutional encoder-decoder model includes receiving, at a supervised classification engine, extracted linguistic features of an input text and a latent representation of an input text. The method also includes predicting, by the supervised classification engine, an affect characterization of the input text using the extracted linguistic features and the latent representation. Predicting the affect characterization includes normalizing and concatenating a linguistic feature representation generated from the extracted linguistic features with the latent representation to generate an appended latent representation. The method also includes identifying, by a gated convolutional encoder-decoder model, an affect label of the input text using the predicted affect characterization.