Weighted KNN classification method and system based on support vector machine

A technology of support vector machine and classification method, which is applied in the field of support vector machine-based weighted KNN classification method and its system, which can solve the problems of poor distribution effect of data sets and increase of algorithm complexity, etc.

Inactive Publication Date: 2020-01-03
HANGZHOU VOCATIONAL & TECHN COLLEGE
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The traditional KNN classification method becomes worse when the data set is unevenly distributed. If the accuracy is improved, the complexity of the algorithm will be greatly increased.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Weighted KNN classification method and system based on support vector machine
  • Weighted KNN classification method and system based on support vector machine
  • Weighted KNN classification method and system based on support vector machine

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0077] The present invention will be further described in detail in conjunction with the accompanying drawings and specific embodiments.

[0078] A kind of weighted KNN classification method based on support vector machine of the present invention, comprises the following steps:

[0079] 1) First calculate the weight, because the optimal decision function of the support vector machine is formula (1):

[0080]

[0081] Therefore, the optimal weight vector is formula (2):

[0082]

[0083] Suppose the training set is linearly separable, any sample x i With m feature vectors, according to the linear support vector machine method to classify the training set, the weight vector w=(w 1 ,w 2 ,...,w m )

[0084] 2) For any x=(x 1 ,x 2 ,...,x m ), m represents the mth feature attribute in x, and the weight vector w=(w 1 ,w 2 ,...,w m ), w m Indicates the weight of the mth feature attribute of sample x. Based on this, the distance between connecting points can be chan...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a weighted KNN classification method based on a support vector machine, and the method comprises the steps: carrying out classification of an original training set through thesupport vector machine, obtaining a weight factor related to each attribute in a feature vector, and enabling the weight factor to represent the correlation between the feature attribute and the classification; introducing the weight factor into the calculation of the distance between the input point and the training set, calculating the most suitable neighbor number and the weight factor of eachinput point by using a KNN method, and finally judging the category of the input point by using a local weighting method. When more feature attributes irrelevant to classification exist in the feature vectors, the dimensionality of the data can be effectively reduced, and the classification precision can be improved. The method is particularly suitable for classification of complex data and massdata, and compared with other classification algorithms, the time complexity is reduced while the classification accuracy is improved. The invention further comprises a system for implementing the weighted KNN classification method based on the support vector machine. The problem that the effect becomes poor when a traditional KNN algorithm faces uneven data set distribution is solved.

Description

technical field [0001] The invention relates to knowledge in the field of data mining such as support vector machines and KNN algorithms, in particular to a support vector machine-based weighted KNN classification method and a system thereof. [0002] technical background [0003] With the further acceleration of the development of information technology, the desire for informatization in all walks of life is becoming increasingly urgent, and informatization construction is in full swing. In the context of informatization, the amount of data generated by the country or enterprises is constantly expanding, and effective data analysis and data mining methods will bring great benefits to the country, society and enterprises. In the era of data explosion, machine learning and artificial intelligence have attracted great attention from the whole society. A large number of data mining technologies have been applied to user analysis, financial investment, medical and health industri...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62
CPCG06F18/214G06F18/24147G06F18/2411
Inventor 车菊燕袁江军王杰石佳文
Owner HANGZHOU VOCATIONAL & TECHN COLLEGE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products