Training method of reinforced learning model, node, system and storage medium

A training method and reinforcement learning technology, applied in the field of machine learning, can solve the problems of direct leakage of training data, data leakage, and hidden worries of training data leakage, and achieve the effect of simplifying the training process and improving the training speed.

Active Publication Date: 2019-06-28
BCM SOCIAL CORP +1
View PDF3 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, a large amount of data is required to train the reinforcement learning algorithm model, which also brings hidden dangers to data leakage.
Especially in the training of reinforcement learning algorithms in open network clusters, the direct leakage of training data and the leakage of training data indirectly derived from the trained model are even more worrying.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Training method of reinforced learning model, node, system and storage medium
  • Training method of reinforced learning model, node, system and storage medium
  • Training method of reinforced learning model, node, system and storage medium

Examples

Experimental program
Comparison scheme
Effect test

no. 1 example

[0026] Such as figure 2 As shown, the first embodiment of a training method for a reinforcement learning model of the present application, this embodiment includes:

[0027] S11: The training node acquires local data, and inputs the local data as a sample into the first neural network for training, so as to obtain the first optimal sub-objective function.

[0028] Wherein, the local data is the training data that the training node itself can obtain, and the training data may include the training state of the environment, training actions from the set of actions performed by the training node in response to receiving the training state, due to the training node The training reward received for performing the training action, and the next training state of the environment.

[0029] Specifically, in an application example, the first neural network is a deep neural network, the deep neural network has a first sub-objective function determined by parameters, and the first neural ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a training method of a reinforced learning model, a node, a system and a storage medium. The training method comprises the steps of acquiring local data by a training node, andinputting the local data as a sample into a first neural network for training, thereby obtaining a first optimal sub-objective function; receiving a parameter from a second optimal sub-objective function of a neighboring node; introducing the parameter of the second optimal sub-objective function into the first optimal sub-objective function for obtaining a second optimal sub-objective function;and performing weighted averaging operation on the first optimal sub-objective function and the second sub-objective function, thereby obtaining an optimal objective function. Through the method, a data leakage problem in the training process of the reinforced leaning model can be settled.

Description

technical field [0001] The present application relates to the technical field of machine learning, in particular to a training method, node, system and storage medium of a reinforcement learning model. Background technique [0002] Reinforcement learning algorithm is a machine learning algorithm that maps from the state of the environment to actions, so that the cumulative reward value obtained by the action from the environment is the largest. With the evolution of computing power and algorithms, reinforcement learning has been widely used in robot control, cluster management, and network traffic control. [0003] However, a large amount of data is required to train the reinforcement learning algorithm model, which also brings hidden dangers to data leakage. Especially in the training of reinforcement learning algorithms in open network clusters, there are even more hidden concerns about the direct leakage of training data and the leakage of training data indirectly derive...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/04G06N3/08
CPCG06N3/04G06N3/08G06N99/00G06Q30/02G06F21/62Y02D30/70
Inventor 袁振南朱鹏新
Owner BCM SOCIAL CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products