Entropy-Based Data Labeling for Lower-Cost AI Training

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Artificial intelligence implementations are hindered by the scarcity and variable quality of labeled data, which is complex and time-consuming to obtain, and require specialized knowledge, creating a bottleneck in resource availability.

Innovation Solution

Systems and methods for propagating labels through a sparsely labeled dataset using supervised projections of semantic embeddings, quality filters based on consistency scores, and entropy scores to improve label quality and training efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If labeled data is obtained through manual annotation, then label quality is improved, but time consumption and cost increase

Engineering Contradiction:
Improvelabel qualityVSAvoidtime consumption
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system enables self-service labeling by training an AI model to automatically generate labels for new data. The model learns from the initially labeled dataset and independently annotates subsequent data points, eliminating the need for continuous manual intervention while maintaining label quality.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

A small initial dataset is manually labeled in advance to create a training foundation. This preliminary labeling action enables the AI model to learn and subsequently perform automatic labeling, reducing time consumption for future labeling tasks while preserving quality through the model's learned patterns.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If more labeled data is collected, then model training quality is improved, but resource requirements and cost increase

Engineering Contradiction:
Improvemodel training qualityVSAvoidresource requirements
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The AI model performs self-service by automatically generating labels for expanding the dataset. This enables continuous data augmentation without proportionally increasing manual resource requirements, as the model independently creates labeled examples for training.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system creates copies of the labeling capability through the trained AI model. Instead of requiring additional human annotators for each new data point, the model replicates the labeling function automatically, reducing resource requirements while improving model training quality through more data.

Inventive Principle:
Principle #26Copying

3Measurement precision

If specialized knowledge is required for data labeling, then label accuracy is improved, but ease of operation deteriorates

Engineering Contradiction:
Improvelabel accuracyVSAvoidease of operation
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system captures specialized knowledge within the AI model during the initial training phase. Once trained, the model performs self-service labeling without requiring operators to possess specialized domain knowledge, thereby maintaining label accuracy while dramatically improving ease of operation.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The AI model acts as an intermediary between the initially labeled dataset and new data points. It internalizes specialized knowledge from the training data and mediates the labeling process, allowing users without specialized knowledge to achieve accurate labels through the model's learned expertise.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Measurement precision

If manual labeling processes are used, then label quality is improved, but productivity decreases

Engineering Contradiction:
Improvelabel qualityVSAvoidproductivity
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The AI model performs self-service labeling at scale, automatically annotating large volumes of data without the bottlenecks of manual processes. This maintains label quality through consistent application of learned patterns while dramatically improving productivity by processing data in parallel without human intervention limits.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system replicates the manual labeling capability across multiple data points simultaneously through the trained AI model. Instead of one annotator processing one data point at a time, the model copies the labeling function to process entire datasets in parallel, improving productivity while preserving quality.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS12499325B2Systems and methods for optimizing data labeling using entropy scores
Publication Date: 2025.12.16 CAPITAL ONE SERVICES LLC
  • US12499325B2 patent drawing
  • US12499325B2 patent drawing
  • US12499325B2 patent drawing

AI summary

Systems and methods for improving training efficiency while reducing total labeling cost for downstream modeling using entropy scores for labeling predictions. The system may receive a first text string, process the first text string in an artificial intelligence model, and determine: a first likelihood that the first text string has a first label component; a second likelihood that the first text string has a second label component; a composite likelihood for the first text string based on the first likelihood and the second likelihood; and a first entropy score from the composite likelihood. It may compare the first entropy score to a first threshold entropy score and generate a recommendation to review a first label being assigned to the first text string.