Pattern Recognition Using GAN-Based Feature Denoising
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing pattern recognition systems face challenges in maintaining small within-class covariance relative to between-class covariance due to noise distortion, leading to sub-optimal classification accuracy, as existing feature transformation methods focus on overall error averaging rather than class-based similarity optimization.
Innovation Solution
A pattern recognition apparatus and method utilizing a generator and discriminator in a GAN framework, with an objective function calculator and parameter updater, to transform noisy features into denoised features, emphasizing class-oriented dissimilarity and probabilistic distribution preservation through GAN-based, classification, and PLDA-based losses, and KL divergence regularization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If feature transformation is applied to handle noise distortion, then within-class covariance can be reduced, but class-oriented similarity optimization is insufficient due to overall error averaging
Solution Approach 1:
The patent applies local quality by introducing class-oriented dissimilarity loss that treats different classes differently in the feature transformation process. Instead of uniform error averaging, the loss function applies specific penalties for each class pair, making the transformation locally optimized for each class relationship. This resolves the contradiction by maintaining low within-class covariance while simultaneously optimizing class-oriented similarity through class-specific transformation criteria.
Solution Approach 2:
The patent changes parameters by introducing multiple loss components (GAN loss, classification loss, PLDA-based dissimilarity loss) that transform the feature space with different objectives. By adjusting the weights and combinations of these loss parameters, the system achieves both within-class compactness and between-class separation, resolving the contradiction through multi-parameter optimization rather than single-objective transformation.
2Reliability
If existing feature transformation methods are used, then noise robustness can be improved, but classification accuracy deteriorates due to sub-optimal class separation
Solution Approach 1:
The patent merges multiple transformation objectives into a unified framework by combining GAN-based noise robustness learning with classification-based separation learning and PLDA-based dissimilarity learning. This merging allows the feature transformation to simultaneously achieve noise robustness and optimal class separation, resolving the contradiction by integrating rather than prioritizing one objective over the other.
Solution Approach 2:
The patent implements feedback through the discriminator that provides classification feedback to the generator during training. The discriminator evaluates whether transformed features maintain class separability, and this feedback guides the generator to adjust transformations. This feedback mechanism ensures that noise robustness improvements do not compromise classification accuracy, as the transformation is continuously refined based on classification performance.
3Device complexity
If feature transformation emphasizes overall error minimization, then computational simplicity is maintained, but discriminative ability of features deteriorates
Solution Approach 1:
The patent segments the feature transformation objective into distinct loss components: GAN loss for noise modeling, classification loss for class separation, and PLDA-based dissimilarity loss for within-class compactness. Each segment addresses a specific aspect of feature quality, and their combination achieves high discriminative ability without excessive complexity, as each segment can be computed using established algorithms.
Solution Approach 2:
The patent creates a multi-functional transformation framework where the same transformation process simultaneously achieves noise removal, class separation, and within-class compactness. By making the transformation universal across multiple objectives rather than requiring separate transformations for each goal, the system maintains computational efficiency while achieving high feature discriminative ability through the synergistic effect of multiple loss functions.
Data Source
AI summary
An apparatus for pattern recognition includes a generator which transforms noisy feature vectors into denoised feature vectors, a discriminator which takes the denoised feature vectors and the original clean feature vectors corresponding to the denoised feature vectors as input and predicts probability for both of the input features of being an original clean feature, classifies the input feature vectors into its corresponding classes, an objective function calculator which calculates generator and discriminator losses using the denoised feature vectors, the clean feature vectors from which the noisy feature vectors have been made, the estimated classes and their true classes, and a Parameter updater which updates parameters of the generator and the discriminator according to loss minimization.


