SVM Recognition Accuracy Optimization via Support Vector Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional machine learning methods, such as Support Vector Machines (SVM), face challenges in achieving high recognition accuracy when the sample set is small, leading to data overfitting and resulting in false positives and false negatives due to a large number of support vectors.

Innovation Solution

The method involves optimizing the ratio of sample number to support vector number in an SVM model by selecting appropriate kernel parameters and iteratively refining the feature matrix to ensure this ratio exceeds a threshold, thereby reducing false negatives and improving recognition accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional SVM methods are used with small sample sets, then the model can be trained quickly, but recognition accuracy deteriorates due to data overfitting and large number of support vectors

Engineering Contradiction:
Improverecognition accuracyVSAvoidnumber of support vectors
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts and removes redundant support vectors from the SVM model through iterative optimization. By identifying and eliminating support vectors that contribute minimally to the decision boundary, the method reduces the total number of support vectors while preserving recognition accuracy, directly resolving the contradiction between model complexity and reliability

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent changes key SVM parameters including kernel function selection, kernel parameters, and regularization parameters through systematic optimization. These parameter adjustments enable the model to achieve better generalization with fewer support vectors, improving recognition accuracy while reducing model complexity

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If more support vectors are used to improve coverage, then the model can handle more cases, but false positives and false negatives increase due to overfitting

Engineering Contradiction:
Improvemodel coverageVSAvoidclassification precision
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent implements iterative feedback loops where the SVM model is trained, evaluated for overfitting, and then refined by removing redundant support vectors. This feedback mechanism continuously optimizes the balance between model coverage and classification precision, ensuring the model generalizes well without overfitting to the training data

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent applies partial action by using only the necessary subset of support vectors rather than all possible vectors. By selectively retaining only the most important support vectors that contribute significantly to correct classification, the method achieves adequate model coverage with reduced false positives and false negatives

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If the sample set size is increased to improve accuracy, then recognition precision improves, but the processing time and computational resources increase

Engineering Contradiction:
Improverecognition precisionVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent extracts the essential information from a small sample set by identifying and retaining only the critical support vectors that capture the most important decision boundaries. This extraction process achieves high recognition precision without requiring large amounts of training data, thereby reducing processing time and computational resources

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent optimizes SVM parameters including kernel selection and regularization strength to maximize recognition precision with minimal training data. These parameter adjustments enable the model to achieve high precision efficiently, avoiding the need for time-consuming processing of large datasets

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10891522B2System for support vector machine prediction
Publication Date: 2021.01.12 SHUTTERFLY LLC
  • US10891522B2 patent drawing
  • US10891522B2 patent drawing
  • US10891522B2 patent drawing

AI summary

A computer-implemented method is disclosed for image recognition and other applications. The method employs an SVM model and can reduce false negatives and increase recognition accuracies by raising the sample-to-support-vector ratio.