High-efficiency SVM active half-supervision learning algorithm

Abstract

The invention discloses a high-efficiency SVM active half-supervision learning algorithm. The algorithm comprises: (1), training an initial SVM classifier f<SVM><0>; (2), determining whether the f<SVM><0> satisfies a learning termination condition, and if not, skipping to step (3); (3), performing prediction marking on unmarked samples Us by use of the f<SVM><0>; (4), performing Tri-learning based half-supervision learning/QBC-based active learning on samples whose prediction mark confidence are greater than/smaller than a threshold in the Us, and adding the samples selected in the half-supervision learning/active learning to a marked training sample set; (5), training a f<SVM><k> on the updated marked training sample; and (6), repeating step (2) until the SVM classifier satisfies the termination condition of the active learning. The algorithm provided by the invention has the following advantages: during an SVM training learning process, according to the learning process, the samples which best facilitate classifier performance are autonomously selected for training the classifier, after these samples are added to the tainting set, the accuracy of classifying the unmarked samples through the semi-supervision learning is improved to the maximum degree, and the SVM classification precision is enhanced.

Description

technical field [0001] The invention relates to an algorithm, in particular to an efficient SVM active semi-supervised learning algorithm, and belongs to the technical field of machine learning algorithms. Background technique [0002] SVM (Support Vector Machines, Support Vector Machines) is a new pattern recognition method developed on the basis of the VC dimension theory of statistical learning theory and the principle of structural risk minimization. It can seek the best compromise between the complexity of the model (i.e., the learning accuracy for a specific training sample) and the learning ability (i.e., the ability to identify any sample without error) based on limited sample information, in order to obtain the best generalization ability. It largely solves the problems of model selection and over-learning, nonlinear and dimension disasters, local minimum points and other problems existing in traditional pattern recognition technology. Many unique advantages have ...

AI Technical Summary

Problems solved by technology

For example, the active learning method based on error reduction needs to search the entire sample space before selecting samples. For a large amount of unlabeled sample sets, this sample selection strategy directly calculates the classifier on the test data set after adding samples. Classification error, the complexity of its calculation is quite high, it is not feasible in practice;

[0028] 2. Sensitive to label noise and unbalanced data distribution, etc., easy to sample repeated, similar, and meaningless samples

For example, active learning based on uncertainty sampling may sample isolated points, and it is difficult to distinguish samples with a large amount of information from abnormal samples;

[0029] 3. The influence of error propagation

That is, if the learner trained in the initial stage of active learning is inaccurate, the sample selected during the active learning process may not be the "most beneficial" sample for the learner training, which will affect the performance of a

Images