An unbalanced classification method based on deep reinforcement learning

A technology for enhancing learning and classification methods, applied in special data processing applications, instruments, electrical digital data processing, etc. Effect

Inactive Publication Date: 2018-12-11
SOUTH CHINA UNIV OF TECH
View PDF0 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to overcome the deficiencies in the prior art, and proposes an effective, scientific and reasonable imbalanced classification method based on deep reinforcement learning, using deep reinforcement learning to solve the imbalanced classification problem in supervised learning, Give a highe

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An unbalanced classification method based on deep reinforcement learning
  • An unbalanced classification method based on deep reinforcement learning
  • An unbalanced classification method based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] The present invention will be further described below in conjunction with specific examples.

[0044] Such as figure 1 As shown, the unbalanced classification method based on deep reinforcement learning provided in this embodiment includes the following steps:

[0045] 1) Construct classification tasks and interaction rules for agents

[0046] The classification task constructed is: the agent classifies each training sample in the environment in turn. When the classification is correct, the agent obtains a positive return value from the environment, otherwise the agent obtains a negative return value; the goal of the agent is to be in the classification task Get the most cumulative returns;

[0047]In the imbalance classification task, in order to guide the agent to learn the strategy of classifying the imbalanced data, the interaction rules between the agent and the environment are formulated: if the agent classifies the minority samples correctly, the environment re...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an unbalanced classification method based on deep reinforcement learning, which comprises the following steps: 1) constructing classification tasks and interaction rules of anagent; 2) constructing the action space of the agent; 3) constructing an external environment; 4) constructing a depth neural network model; 5) training the unbalanced classification model based on depth reinforcement learning, that is to say, learning a Q function with the deep neural network model. The present invention applies deep reinforcement learning to the problem of unbalanced classification in supervised learning, to improve the role of minority sample features in classification modeling by giving higher rewards and punishments to minority sample classification actions through rewardfunction. The method makes the agent learn the correct classification strategy in different types of data environment and data of different unbalanced degree, and is applicable to unbalanced binary classification and multi-classification problems. Therefore, the method has practical application values and is worth popularizing.

Description

technical field [0001] The invention relates to the technical field of deep learning, enhanced learning, and unbalanced classification in machine learning, in particular to an unbalanced classification method based on deep enhanced learning. Background technique [0002] For the unbalanced classification problem, the usual solution is to improve it from the perspective of data layer and algorithm layer. However, the improvement method of the data layer will change the original distribution characteristics of the training data, and the resampled data often cannot reflect the distribution characteristics of the real data. For example, the simple copying or interpolation of the minority class samples by the upsampling method will cause the training model to overfit the minority class samples, while the downsampling method will cause the loss of data information due to the deletion of the majority class samples. There are also problems with the method at the algorithm level. Th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/62G06F17/30
CPCG06F18/24G06F18/214
Inventor 陈琼戚潇明林恩禄
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products