Meta-learning method and device, initialization method, computing equipment and storage medium

A meta-learning and computer technology, applied in the fields of computing equipment and computer-readable storage media, meta-learning methods and devices, and initialization methods, can solve problems such as model overfitting

Active Publication Date: 2020-02-28
TENCENT CLOUD COMPUTING BEIJING CO LTD
View PDF7 Cites 21 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, it is often difficult to collect enough labeled samples for traditional machine learning to extract risk control-related pattern features from the data, which is prone to model overfitting

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Meta-learning method and device, initialization method, computing equipment and storage medium
  • Meta-learning method and device, initialization method, computing equipment and storage medium
  • Meta-learning method and device, initialization method, computing equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] In order to make the features and advantages of the embodiments of the present application more obvious, the following briefly introduces concepts related to the meta-learning method proposed in the present application, including model-independent meta-learning (MAML) and transfer learning.

[0050] MAML is one of the currently popular meta-learning algorithms. Its core idea is to learn the initial parameters of the neural network from a large number of training tasks, that is, meta-parameters, which can enable new machine learning tasks to converge quickly under small-sample conditions. to a better solution. The training process of MAML mainly includes two parts: meta-learner, the training process is to seek the initial parameters; and the base learner (Base-learner), which is the prediction model used by the target task, is given initialization parameters by the meta-learner and then trained after a small number of gradient iterations. Since MAML's meta-learner is ba...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a meta-learning method and device of a risk prediction model, an initialization method, computing equipment and a computer readable storage medium. The meta-learning method includes: generating a training task set including a plurality of training tasks, wherein the plurality of training tasks are provided with respective different category predictors; initializing networkweights of a meta-learner, a feature extractor and a task discriminator, the category predictor, the meta-learner, the feature extractor and the task discriminator being an artificial neural network,and the category predictor having the same network structure as the meta-learner; dividing the training tasks in the training task set into a plurality of batches, and updating the network weights ofthe meta-learner, the feature extractor and the task discriminator on the basis of each batch, the updating being carried out according to the category prediction loss and the task discrimination loss. According to the method, the generalization ability of the meta-learner can be improved, so that an optimal risk prediction model can be quickly obtained in small sample training in a financial risk control scene.

Description

technical field [0001] The present invention relates to the technical field of machine learning, in particular to a meta-learning method and device, an initialization method, a computing device, and a computer-readable storage medium. Background technique [0002] Machine learning, especially deep learning, has been successfully applied in many fields such as computer vision, natural language processing, and data mining since its rise. An important factor for its good performance in these fields is the ease of obtaining massive labeled data in these fields. However, in financial risk control scenarios, such as risk control in financial business links such as payment, lending, and wealth management, the data distribution of different customer groups varies greatly, and there are many customer groups with small sample characteristics. Therefore, it is often difficult to collect enough labeled samples for traditional machine learning to extract risk control-related pattern fea...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N20/00
CPCG06N20/00
Inventor 柳玉豹蓝利君李超
Owner TENCENT CLOUD COMPUTING BEIJING CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products