Neural Network Training via Cluster-Based Data Weighting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current neural network training methods lack effective mechanisms to determine the reliability of recognition results and optimize training processes based on feature vectors and clusters, leading to suboptimal recognition accuracy.
Innovation Solution
A method that involves obtaining feature vectors from a hidden layer of a neural network, determining the reliability of recognition results by calculating distances or similarities to clusters, and adjusting training data weights to focus on clusters with lower recognition accuracy, thereby improving training efficiency and accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional neural network training methods are used, then training can be performed without complex mechanisms, but recognition accuracy and training efficiency remain suboptimal
Solution Approach 1:
The training data is segmented into multiple clusters based on feature vectors from the hidden layer. Each cluster represents a distinct group of data with similar characteristics, allowing the training process to focus on specific segments rather than treating all data uniformly. This segmentation enables more precise recognition accuracy improvement while maintaining manageable complexity through localized training adjustments.
Solution Approach 2:
The patent applies local quality by assigning different weights to different clusters based on their recognition accuracy. Clusters with lower accuracy receive higher weights, directing more training attention to problematic areas. This localized quality adjustment improves overall recognition accuracy without requiring complex global modifications to the training mechanism.
2Productivity
If all training data is used uniformly, then training process is simple, but training efficiency and accuracy optimization is limited
Solution Approach 1:
The patent performs preliminary clustering of training data based on feature vectors before the actual training process. By pre-organizing data into clusters and identifying which clusters need more attention, the system prepares the training data in advance, enabling more efficient training execution without requiring complex real-time decision-making mechanisms during training.
Solution Approach 2:
The system implements feedback by evaluating recognition accuracy for each cluster and using this information to adjust training weights. Clusters with lower accuracy receive higher weights in subsequent training iterations, creating a feedback loop that continuously optimizes training efficiency. This feedback mechanism improves productivity without excessive complexity because it uses simple weight adjustment based on measured performance.
3Reliability
If feature vectors are not utilized for reliability determination, then processing is simpler, but recognition result reliability cannot be enhanced
Solution Approach 1:
The patent introduces feature vectors as an intermediary between the hidden layer and the clustering process. These feature vectors serve as mediators that capture essential characteristics of the data, enabling reliable cluster formation and subsequent accuracy assessment. The feature vectors provide a compact representation that enhances recognition reliability without requiring complex direct analysis of raw data.
Data Source
AI summary
A training method of a neural network, and a recognition method and apparatus using the neural network are disclosed. The recognition method using the neural network includes obtaining a feature vector generated from a hidden layer of the neural network, in response to data being entered to an input layer of the neural network, and determining a reliability of a recognition result for the data using the feature vector and clusters.


