Incremental learning-fused support vector machine multi-class classification method

A support vector machine and incremental learning technology, applied in the field of support vector machine multi-category classification, can solve problems such as hindering application, poor anti-interference ability, and high training data requirements, so as to achieve good generalization, save test time, and improve growth rate. The effect on the ability to quantify learning

Inactive Publication Date: 2011-01-12
ZHEJIANG GONGSHANG UNIVERSITY
View PDF1 Cites 35 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Ying w et al. (2006) proposed a binary tree-based support vector machine multi-classification algorithm (BTSVM for short) on the basis of overcoming the shortcomings of the above algorithms, which has better classification effect and classification efficiency, but the algorithm's anti-interference ability is poor , has high requirements for training data, which hinders its application to a certain extent.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Incremental learning-fused support vector machine multi-class classification method
  • Incremental learning-fused support vector machine multi-class classification method
  • Incremental learning-fused support vector machine multi-class classification method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0068] Example 1: Experimental results of BTMSVM without incremental learning training

[0069] Step 1: Pre-extract the training sample set to obtain a pre-extracted training sample set PTS consisting of 80 records;

[0070] The second step is to use PTS to train the iterative support vector machine to obtain the multi-class classification model M-SVM;

[0071] The third step is to perform binary tree processing on the M-SVM to obtain the support vector machine multi-class classification model BTMSVM based on the binary tree 0 , The training time is 10.92 seconds, 680 test samples are extracted to test the classification model, and the classification accuracy rate is 70.49%;

[0072] Step 4, add 20 training samples, merge them with 80 original training samples, total 100 records, and enter BTMSVM 0 For training, the training time is 23.75 seconds. Because the already trained classifier cannot be used (when the training sample is 80 hours), retraining is required, so the actual time sp...

Embodiment 2

[0078] Example 2: Experimental results of BTMSVM using incremental learning training

[0079] Step 1: Pre-extract the training sample set D to obtain the pre-extracted training sample set PTS consisting of 80 records;

[0080] The second step is to use PTS to train the iterative support vector machine to obtain the multi-class classification model M-SVM;

[0081] The third step is to perform binary tree processing on the M-SVM to obtain the support vector machine multi-class classification model BTMSVM based on the binary tree 0 , Training time 10.92 seconds;

[0082] The fourth step is to extract 680 test sample sets T through the multi-class classification model BTMSVM 0 Classification, the classification accuracy rate is 70.49%;

[0083] Step 5, add 20 records to the incremental sample set B 0 Input BTMSVM with 80 initial training samples PTS 0 Carry out incremental training, the incremental training time is 2.56 seconds, after the elimination rule of density method, a total of 5 rec...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an incremental learning-fused support vector machine multi-class classification method, and aims to reduce sample training time and improve classification precision and anti-interference performance of a classifier. The technical scheme comprises the following steps of: 1, extracting partial samples from total samples at random to serve as a training sample set D, and using the other part of samples as a testing sample set T; 2, pre-extracting support vectors from the training sample set D; 3, performing support vector machine training on a pre-extracted training sample set PTS by using a cyclic iterative method so as to obtain a multi-class classification model M-SVM; 4, performing binary tree processing on the multi-class classification model M-SVM to obtain a support vector machine multi-class classification model BTMSVM0; 5, performing incremental learning training on the multi-class classification model BTMSVM0 to obtain a model BTMSVM1; and 6, inputting the testing sample set T in the step 1 into the multi-class classification model BTMSVM1 for classification. The incremental learning-fused support vector machine multi-class classification method is used for performing high-efficiency multi-class classification on massive information through incremental learning.

Description

Technical field [0001] The invention relates to the technical field of intelligent information processing and machine learning, in particular to a support vector machine multi-class classification method incorporating incremental learning. It is suitable for efficient multi-class classification of massive information through incremental learning under complex attribute conditions. Background technique [0002] Support Vector Machine (Support Vector Machine) is a machine learning method developed in recent years. It is constructed based on the principle of structural risk minimization. It has strong learning ability and generalization performance, and can solve small samples, High dimensionality, nonlinearity, local minima and other problems are widely used in pattern classification and nonlinear regression. The traditional support vector machine is proposed for the two-class classification problem and cannot be directly used for multi-class classification, but in practical appli...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 琚春华郑丽丽梅铮
Owner ZHEJIANG GONGSHANG UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products