Neural Network Training via Cluster-Based Data Weighting

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current neural network training methods lack effective mechanisms to determine the reliability of recognition results and optimize training processes based on feature vectors and clusters, leading to suboptimal recognition accuracy.

Innovation Solution

A method that involves obtaining feature vectors from a hidden layer of a neural network, determining the reliability of recognition results by calculating distances or similarities to clusters, and adjusting training data weights to focus on clusters with lower recognition accuracy, thereby improving training efficiency and accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional neural network training methods are used, then training can be performed without complex mechanisms, but recognition accuracy and training efficiency remain suboptimal

Engineering Contradiction:
Improverecognition accuracyVSAvoidtraining mechanism complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The training data is segmented into multiple clusters based on feature vectors from the hidden layer. Each cluster represents a distinct group of data with similar characteristics, allowing the training process to focus on specific segments rather than treating all data uniformly. This segmentation enables more precise recognition accuracy improvement while maintaining manageable complexity through localized training adjustments.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by assigning different weights to different clusters based on their recognition accuracy. Clusters with lower accuracy receive higher weights, directing more training attention to problematic areas. This localized quality adjustment improves overall recognition accuracy without requiring complex global modifications to the training mechanism.

Inventive Principle:
Principle #3Local quality

2Productivity

If all training data is used uniformly, then training process is simple, but training efficiency and accuracy optimization is limited

Engineering Contradiction:
Improvetraining efficiencyVSAvoiddata selection mechanism complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent performs preliminary clustering of training data based on feature vectors before the actual training process. By pre-organizing data into clusters and identifying which clusters need more attention, the system prepares the training data in advance, enabling more efficient training execution without requiring complex real-time decision-making mechanisms during training.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback by evaluating recognition accuracy for each cluster and using this information to adjust training weights. Clusters with lower accuracy receive higher weights in subsequent training iterations, creating a feedback loop that continuously optimizes training efficiency. This feedback mechanism improves productivity without excessive complexity because it uses simple weight adjustment based on measured performance.

Inventive Principle:
Principle #23Feedback

3Reliability

If feature vectors are not utilized for reliability determination, then processing is simpler, but recognition result reliability cannot be enhanced

Engineering Contradiction:
Improverecognition result reliabilityVSAvoidfeature vector processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent introduces feature vectors as an intermediary between the hidden layer and the clustering process. These feature vectors serve as mediators that capture essential characteristics of the data, enabling reliable cluster formation and subsequent accuracy assessment. The feature vectors provide a compact representation that enhances recognition reliability without requiring complex direct analysis of raw data.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11829858B2Method of training neural network by selecting data to be used in a subsequent training process and identifying a cluster corresponding to a feature vector
Publication Date: 2023.11.28 SAMSUNG ELECTRONICS CO LTD
  • US11829858B2 patent drawing
  • US11829858B2 patent drawing
  • US11829858B2 patent drawing

AI summary

A training method of a neural network, and a recognition method and apparatus using the neural network are disclosed. The recognition method using the neural network includes obtaining a feature vector generated from a hidden layer of the neural network, in response to data being entered to an input layer of the neural network, and determining a reliability of a recognition result for the data using the feature vector and clusters.