An SVM classification method based on a hybrid kernel function

A technology of hybrid kernel function and classification method, applied in the field of SVM classification based on hybrid kernel function, can solve the problems of large confidence range, small experience risk, over-learning, etc., and achieve high classification accuracy, strong learning ability, and good extrapolation effect of ability

Inactive Publication Date: 2019-03-08
HUAIBEI NORMAL UNIVERSITY
View PDF2 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

If the spatial dimension of the data projection is large, the obtained model is more complex, the empirical risk is small but the confidence range is large, and over-learning is prone to occur; vice versa
[0005] At present, there is no unified rule for the selection or construction of kernel functions. Generally, empirical methods are used to select kernel functions. As long as functions that meet the Mercer conditions can be selected as kernel functions in theory

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An SVM classification method based on a hybrid kernel function
  • An SVM classification method based on a hybrid kernel function
  • An SVM classification method based on a hybrid kernel function

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0031] A kind of SVM classification method based on mixed kernel function, the steps are as follows:

[0032] 1. Collect data sets, analyze each sample in the collected data set records, distinguish different attributes of samples, and determine input and output samples;

[0033] 2. Select and construct the kernel function, and mix the exponential distribution kernel function with the radial basis kernel function;

[0034] 3. Optimize the parameters in the mixed kernel function, and adopt the particle swarm optimization algorithm that introduces Gaussian variation;

[0035] 4. Select the C-SVC model and establish a support vector machine classification model based on a new hybrid kernel function;

[0036] 5. Carry out classification prediction through the support vector machine classification model established.

[0037] The basis for the generation of the new hybrid kernel function is as follows:

[0038] The concept of kernel function, assuming m training samples {x 1 , x...

Embodiment 2

[0068] The chemical composition analysis of three different wine varieties in the same region of Italy is recorded to form a Wine dataset. There are 178 samples in the dataset, and each sample contains 13 attributes.

[0069] To verify the effectiveness of the novel hybrid kernel function of the present invention, the Wine data set was randomly grouped 10 times, and a support vector machine classification model based on the hybrid kernel function was established. The parameters involved were all optimized by PSO, and classification prediction experiments were carried out. Random grouping is used to reflect the adaptability of the new hybrid kernel function.

[0070] Compare the obtained results with the classification results of the support vector machine classification model constructed by other kernel functions, as shown in Table 1 below.

[0071] Table 1 The classification accuracy of random grouping of different kernel functions in the Wine dataset

[0072]

[0073] ...

Embodiment 3

[0076] This embodiment is an Iris data set verification example. In order to more comprehensively compare various kernel functions or single or mixed SVM classification effects, the experimental object is the Iris data set provided by the UCI database website.

[0077] The Iris dataset contains 150 samples, which are equally divided into 3 categories, and each sample contains 4 attributes. In the present invention, 50% of each type of samples in the data set is used as a training set, and the other 50% is used as a test set. The parameters are optimized by PSO respectively, and the SVM classification model is established. The classification accuracy of the test set is shown in Table 2 below.

[0078] Table 2 Classification results under different kernel functions of the Iris dataset

[0079]

[0080] As can be seen from Table 2, for using a single kernel function, the classification accuracy rate of the kernel function proposed by the present invention is higher than linea...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an SVM classification method based on a mixed kernel function, and the method comprises the steps of 1 collecting a data set, analyzing each sample in a collected data set record, distinguishing different attributes of the samples, and determining input and output samples; 2 selecting and constructing a kernel function, and mixing the exponential distribution kernel function with the radial basis kernel function; 3 optimizing parameters in the mixed kernel function; 4 selecting C-SVC model, establishing a support vector machine classification model based on a novel mixed kernel function; and 5 performing classification prediction through the established support vector machine classification model. According to the method, the global performance of an exponential function and the local performance of a radial basis function are fully utilized, the model parameters are optimized by adopting a particle swarm optimization algorithm with Gaussian variation, and the overall performance of the support vector machine is improved. The learning and generalization performance of the global index distribution kernel function is higher than that of other single kernel functions, and the performance of the support vector machine of the novel hybrid kernel function is obviously better than that of the support vector machines of other hybrid kernel functions.

Description

technical field [0001] The invention relates to an SVM classification method, in particular to an SVM classification method based on a mixed kernel function. Background technique [0002] SVM (Support Vector Machine) refers to a support vector machine, which is a common discriminant method. In the field of machine learning, it is a supervised learning model, usually used for pattern recognition, classification and regression analysis. The SVM method maps the sample space to a high-dimensional or even infinite-dimensional feature space (Hilbert space) through a nonlinear mapping p, so that the non-linearly separable problem in the original sample space is transformed into a feature space in the feature space. linearly separable problems. Simply put, it is dimensionality enhancement and linearization. Ascending the dimension is to map the sample to a high-dimensional space. In general, this will increase the complexity of the calculation and even cause the "curse of dimensi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62
CPCG06F18/2411
Inventor 朱芳陈得宝纵海宝
Owner HUAIBEI NORMAL UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products