Image Recognition Model Retraining via Feature Clustering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The challenge lies in reliably gathering labeled data for real-world images, particularly for facial recognition, due to the difficulty in obtaining large, accurately labeled datasets that include diverse and representative images, especially those with imperfect representations such as partial occlusion, low lighting, or different viewpoints.

Innovation Solution

The method involves generating a labeled dataset using a convolutional neural network (CNN) to extract feature vectors from images, clustering them to identify feature clusters, and then retraining the model based on user input to associate identities with images, utilizing a user's library of images to personalize the model and increase annotation accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual annotation of images is performed to create labeled datasets, then labeling accuracy can be maintained, but the time and resources required increase significantly

Engineering Contradiction:
Improvelabeling accuracyVSAvoidannotation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system enables semi-automated annotation where the model extracts feature vectors and performs clustering to pre-organize images, allowing users to verify and correct annotations rather than creating them from scratch. This self-service approach significantly reduces annotation time while maintaining accuracy through user verification.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary clustering of images based on feature vectors before user annotation. By pre-organizing images into clusters with high probability of containing images of the same individual, the system reduces the annotation workload and time required while maintaining accuracy through subsequent user verification.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If a large diverse dataset is gathered for training, then model accuracy improves, but the difficulty and cost of data collection increase

Engineering Contradiction:
Improvemodel accuracyVSAvoiddata collection complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system leverages the user's existing photo library as training data, eliminating the need for complex external data collection processes. The model is retrained using images already available on the user's device, which are naturally diverse and representative of the user's needs.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system personalizes the training dataset by using only the specific user's photo library rather than requiring a generic large-scale diverse dataset. This local approach creates a tailored training set that is optimally suited for recognizing that specific user's images while simplifying data collection.

Inventive Principle:
Principle #3Local quality

3Productivity

If feature clustering is performed to organize images, then annotation efficiency increases, but computational requirements increase

Engineering Contradiction:
Improveannotation efficiencyVSAvoidcomputational energy
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The system performs clustering on a subset of the user's photo library rather than the entire dataset. By selecting representative images for clustering and using those to train the model, the system achieves good annotation efficiency while reducing computational energy requirements compared to processing all images.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10025950B1Systems and methods for image recognition
Publication Date: 2018.07.17 EVERALBUM INC
  • US10025950B1 patent drawing
  • US10025950B1 patent drawing
  • US10025950B1 patent drawing

AI summary

Systems and methods that utilize an image processing model to analyze features of an image to identify individuals within a set of images are disclosed. Feature vectors for the images are extracted and clustered based on a distance between the feature vectors in a feature space. The clusters are used to identify individuals within the images with the aid of human annotators. The identified individuals and images can be used to retrain the image processing model.