Automatic Tag Identification for Color Themes Using Neural Embeddings

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Designers face difficulties in identifying sets of colors that create a desired visual effect, as there are numerous shades and combinations, making it time-consuming to generate designs with the intended theme.

Innovation Solution

An automatic tag identification system using a computing device, employing a convolutional neural network to generate a color theme embedding and a recurrent neural network to determine descriptive tags, allowing for quick identification and retrieval of color themes based on user input.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a designer manually identifies and selects color combinations to create a desired visual effect, then the designer can achieve the desired design effect, but the process becomes time-consuming and inefficient

Engineering Contradiction:
Improvespeed of identifying color themesVSAvoidtime required to generate designs
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system pre-generates and stores multiple color themes with their associated visual effect tags in advance. When a user needs a color theme for a specific effect, the pre-computed themes are quickly retrieved and presented, eliminating the time-consuming manual search and selection process while maintaining design quality

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates digital representations (embeddings) of color themes and their visual effects, allowing for rapid copying, storage, and retrieval of theme information. This enables efficient searching and selection of color themes based on desired effects without manually analyzing each color combination

Inventive Principle:
Principle #26Copying

2Measurement precision

If the system uses a simple color selection method, then the system is easy to implement, but it cannot accurately identify color themes that create specific visual effects

Engineering Contradiction:
Improveaccuracy of tag identificationVSAvoidcomplexity of neural network system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system divides the complex task of color theme analysis into two separate specialized components: a convolutional neural network that processes color data and generates embeddings, and a recurrent neural network that generates tags from embeddings. This segmentation allows each component to be optimized for its specific function, achieving high accuracy while managing system complexity through modular design

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces color theme embeddings as an intermediary representation between the input colors and the output tags. This intermediate layer transforms raw color data into a feature space that captures visual effect characteristics, enabling the recurrent network to accurately generate descriptive tags without directly processing complex color combinations

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11809984B2Automatic tag identification for color themes
Publication Date: 2023.11.07 ADOBE INC
  • US11809984B2 patent drawing
  • US11809984B2 patent drawing
  • US11809984B2 patent drawing

AI summary

An automatic tag identification system identifies tags for color themes, a color theme referring to a set of multiple colors that work well together to create (e.g., are visually appropriate for creating) a desired effect, and a tag referring to one or more words that describe a color theme. The automatic tag identification system receives an indication of the multiple colors (e.g., five colors) for a color theme. A first machine learning system uses the indicated multiple colors to generate a color theme embedding for the color theme, which is a vector encoding or embedding of the color theme. The second machine learning system uses the color theme embedding generated by the first machine learning system to generate one or more tags that label the color theme. These one or more tags can then be saved as associated with or corresponding to the multiple colors for the color theme.