Integrated learning method and device based on interval optimization

A technology of integrated learning and optimization method, applied in the field of integrated learning, which can solve the problems of diversity and interval affecting the effect of integrated learning, and insufficient elaboration of connections.

Inactive Publication Date: 2018-05-29
PEKING UNIV +1
View PDF0 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0027] Although both diversity and spacing are considered to be key to the effectiven

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Integrated learning method and device based on interval optimization
  • Integrated learning method and device based on interval optimization
  • Integrated learning method and device based on interval optimization

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0084] The principles and properties of the present invention are described below in conjunction with the accompanying drawings, and the examples given are only used to explain the present invention and are not intended to limit the scope of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0085] The present invention provides an interval-based ensemble learning method for classification errors, such as figure 1 As shown, the detailed process is as follows:

[0086] 1) As shown in step S101, use the training data to train the base classifier;

[0087] 2) As shown in step S102, obtain the predicted value of each base classifier for all samples;

[0088] 3) As shown in step S103, initialize the weights of all base classifiers;

[0089] 4) As shown in step S104, a training sample is randomly ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an integrated learning method and device based on interval optimization. The method comprises: step one, one group of trained base classifiers is obtained; step two, predictionvalues of all training samples by the base classifiers are obtained; step three, a weight of each base classifier is optimized by optimized integrated model interval distribution; and step four, weighted average processing is carried out on the prediction values of the samples by using the optimized weights to obtain a final prediction value and mark. In addition, the invention also discloses anintegrated learning device based on interval optimization. According to the invention, dependence on the specific base classification algorithm is avoided; and optimization is carried out based on theclassification error or AUC. Moreover, the whole model is easy to solve; and the applicability is high. During weight optimization, the accuracy and diversity are balanced by introducing the interval, so that the overfitting problem is solved and the prediction effect of the final integrated model is improved.

Description

technical field [0001] The invention belongs to the field of integrated learning in machine learning, and in particular relates to a weight optimization method and device for base classifiers in integrated learning. Background technique [0002] Integrated Learning: [0003] Among many machine learning methods, ensemble learning is the most successful type of method, among which methods such as random forest and gradient boosting are typical representatives of ensemble learning. The basic idea of ​​ensemble learning is to combine the results of many basic machine learning models to achieve the purpose of improving the learning effect. [0004] The two core steps of ensemble learning methods are the generation and integration of basic learning models. [0005] The generation of the model needs to complete the training task of the base classifier. For the input training data set, several different machine learning models are trained, and each of these models can predict the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/62
CPCG06F18/285G06F18/214
Inventor 刘宏志姜正申张涛宋洋赵鹏吴中海张兴
Owner PEKING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products