ML Iconography Recommendation System for Contextual Visual Retrieval

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Organizations face computational inefficiencies and resource-intensive keyword searches when retrieving visual components from large iconography databases for use in communications, as existing methods do not effectively leverage contextual information to recommend relevant images, colors, and logos.

Innovation Solution

A machine learning model trained using organization-specific and portion-specific data, employing natural language processing and sentiment detection to recommend visual components from a database, while ensuring equal representation and compliance with constraints, thereby reducing memory and processing requirements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If keyword search methods are used to retrieve visual components from large iconography databases, then the system can access and retrieve visual components, but the computational efficiency is poor and resource consumption is high

Engineering Contradiction:
Improvevisual component retrieval efficiencyVSAvoidcomputational resource consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary action by pre-processing text inputs through NLP and sentiment analysis before the actual visual component retrieval. The machine learning model is trained in advance on organization-specific data to learn patterns and relationships, enabling it to quickly generate recommendations without performing exhaustive keyword searches during runtime. This pre-computation and pre-training approach significantly reduces computational resource consumption during the actual retrieval operation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The machine learning model acts as an intermediary between the text input and the visual component database. Instead of directly searching the large iconography database using keyword methods, the system uses the ML model to process the text, understand its meaning and sentiment, and generate targeted recommendations. This intermediary layer transforms the retrieval process from a brute-force search into a smart, context-aware recommendation system, improving efficiency while reducing resource consumption.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If existing retrieval methods are used, then visual components can be accessed from the database, but the system does not effectively leverage contextual information to recommend relevant images, colors, and logos

Engineering Contradiction:
Improvecontextual relevance of visual component recommendationsVSAvoidvisual content generation efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The system applies parameter changes by transforming the retrieval approach from simple keyword matching to a multi-dimensional analysis that incorporates NLP processing, sentiment detection, and contextual understanding. The machine learning model adjusts its recommendations based on multiple parameters including text semantics, emotional tone, organization-specific style guidelines, and portion-specific requirements. This multi-parameter approach significantly improves contextual relevance while maintaining high productivity through efficient model-based predictions.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The machine learning model is trained in advance on organization-specific content and portion-specific data to learn contextual patterns and preferences. This preliminary training enables the system to leverage contextual information effectively during runtime without requiring complex real-time analysis, thus improving adaptability while maintaining productivity. The model internalizes contextual relationships during training, allowing for fast and relevant recommendations during actual use.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If a machine learning model trained with organization-specific and portion-specific data is used, then contextual relevance and compliance are improved, but the training and processing requirements increase

Engineering Contradiction:
Improvecompliance with organizational constraints and equal representationVSAvoidmodel training and processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system performs preliminary action by conducting all model training and constraint integration in advance. The machine learning model is trained on organization-specific data and configured with compliance constraints (such as equal representation requirements) during the training phase. Once trained, the model can generate compliant recommendations without requiring complex real-time processing or repeated constraint checks, thus improving reliability while reducing operational complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The machine learning model is designed to self-enforce compliance constraints through its training and architecture. The model learns organizational guidelines, style requirements, and equal representation constraints during training, enabling it to autonomously generate compliant recommendations without requiring external validation or complex processing during runtime. This self-service approach improves reliability while minimizing the complexity of the retrieval process.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20240161367A1Using machine learning for iconography recommendations
Publication Date: 2024.05.16 CAPITAL ONE SERVICES LLC
  • US20240161367A1 patent drawing
  • US20240161367A1 patent drawing
  • US20240161367A1 patent drawing

AI summary

In some implementations, a recommendation system may input text into a machine learning model that was trained using input specific to an organization associated with the text and was refined using input specific to a portion of the organization. The recommendation system may receive, from the machine learning model, a recommendation indicating one or more visual components, stored in a database associated with the organization, to use with the text. The machine learning model may use natural language processing and sentiment detection to parse the text. Accordingly, the recommendation system may receive the one or more visual components from the database and generate an initial draft including the text and the one or more visual components.