Pattern Recognition Using GAN-Based Feature Denoising

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing pattern recognition systems face challenges in maintaining small within-class covariance relative to between-class covariance due to noise distortion, leading to sub-optimal classification accuracy, as existing feature transformation methods focus on overall error averaging rather than class-based similarity optimization.

Innovation Solution

A pattern recognition apparatus and method utilizing a generator and discriminator in a GAN framework, with an objective function calculator and parameter updater, to transform noisy features into denoised features, emphasizing class-oriented dissimilarity and probabilistic distribution preservation through GAN-based, classification, and PLDA-based losses, and KL divergence regularization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If feature transformation is applied to handle noise distortion, then within-class covariance can be reduced, but class-oriented similarity optimization is insufficient due to overall error averaging

Engineering Contradiction:
Improvewithin-class covarianceVSAvoidclass-oriented similarity
Core Design Contradiction:
Manufacturing precisionVSMeasurement precision

Solution Approach 1:

The patent applies local quality by introducing class-oriented dissimilarity loss that treats different classes differently in the feature transformation process. Instead of uniform error averaging, the loss function applies specific penalties for each class pair, making the transformation locally optimized for each class relationship. This resolves the contradiction by maintaining low within-class covariance while simultaneously optimizing class-oriented similarity through class-specific transformation criteria.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent changes parameters by introducing multiple loss components (GAN loss, classification loss, PLDA-based dissimilarity loss) that transform the feature space with different objectives. By adjusting the weights and combinations of these loss parameters, the system achieves both within-class compactness and between-class separation, resolving the contradiction through multi-parameter optimization rather than single-objective transformation.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If existing feature transformation methods are used, then noise robustness can be improved, but classification accuracy deteriorates due to sub-optimal class separation

Engineering Contradiction:
Improvenoise robustnessVSAvoidclassification accuracy
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent merges multiple transformation objectives into a unified framework by combining GAN-based noise robustness learning with classification-based separation learning and PLDA-based dissimilarity learning. This merging allows the feature transformation to simultaneously achieve noise robustness and optimal class separation, resolving the contradiction by integrating rather than prioritizing one objective over the other.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent implements feedback through the discriminator that provides classification feedback to the generator during training. The discriminator evaluates whether transformed features maintain class separability, and this feedback guides the generator to adjust transformations. This feedback mechanism ensures that noise robustness improvements do not compromise classification accuracy, as the transformation is continuously refined based on classification performance.

Inventive Principle:
Principle #23Feedback

3Device complexity

If feature transformation emphasizes overall error minimization, then computational simplicity is maintained, but discriminative ability of features deteriorates

Engineering Contradiction:
Improvetransformation complexityVSAvoidfeature discriminative ability
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent segments the feature transformation objective into distinct loss components: GAN loss for noise modeling, classification loss for class separation, and PLDA-based dissimilarity loss for within-class compactness. Each segment addresses a specific aspect of feature quality, and their combination achieves high discriminative ability without excessive complexity, as each segment can be computed using established algorithms.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a multi-functional transformation framework where the same transformation process simultaneously achieves noise removal, class separation, and within-class compactness. By making the transformation universal across multiple objectives rather than requiring separate transformations for each goal, the system maintains computational efficiency while achieving high feature discriminative ability through the synergistic effect of multiple loss functions.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12182720B2Pattern recognition apparatus, pattern recognition method, and computer-readable recording medium
Publication Date: 2024.12.31 NEC CORP
  • US12182720B2 patent drawing
  • US12182720B2 patent drawing
  • US12182720B2 patent drawing

AI summary

An apparatus for pattern recognition includes a generator which transforms noisy feature vectors into denoised feature vectors, a discriminator which takes the denoised feature vectors and the original clean feature vectors corresponding to the denoised feature vectors as input and predicts probability for both of the input features of being an original clean feature, classifies the input feature vectors into its corresponding classes, an objective function calculator which calculates generator and discriminator losses using the denoised feature vectors, the clean feature vectors from which the noisy feature vectors have been made, the estimated classes and their true classes, and a Parameter updater which updates parameters of the generator and the discriminator according to loss minimization.