一种面向种群训练的分布式深度强化学习训练模型

By designing a distributed deep reinforcement learning training model oriented towards population training and optimizing data exchange using a cache pool, the problems of uneven network bandwidth usage and insufficient agent interaction are solved, thus achieving efficient agent network parameter training.

CN115496206BActive Publication Date: 2026-07-17INST OF AUTOMATION CHINESE ACAD OF SCI

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
INST OF AUTOMATION CHINESE ACAD OF SCI
Filing Date
2022-10-25
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing technologies suffer from uneven network bandwidth usage in distributed deep reinforcement learning training, resulting in low training efficiency. Furthermore, agents cannot interact during parallel training, failing to meet the needs of population training.

Method used

Design a distributed deep reinforcement learning training model for population training, which includes a training module, a data cache pool, a policy update module, and a weight cache pool. The cache pool alleviates network transmission pressure, optimizes the data exchange process, and supports training of a variable number of agent network parameters.

Benefits of technology

It significantly accelerates the network parameter training process of agents, solves the network congestion problem, realizes effective interaction and independent training between agents, and improves training efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115496206B_ABST
    Figure CN115496206B_ABST
Patent Text Reader

Abstract

本公开是关于一种面向种群训练的分布式深度强化学习训练模型。其中,该模型包括训练模块及评估模块,所述训练模块用于智能体面向种群训练的网络权重训练,生成参数指针并发送至所述评估模块;所述评估模块用于在工作模式为参数存储模式时,接收所述训练模块发送的参数指针并存储,在工作模式为参数评估模式时,依据存储参数指针获取参数并评估。本公开支持分布式数据生成、计算调度、模型训练以及性能评估,显著加速智能体的网络参数训练过程;依据需求支持可变数量的智能体网络参数可对其进行相对独立的训练;构建缓存池缓解网络传输压力,解决网络拥堵的问题;有效避免各个模块同时上传与申请数据造成的网络拥堵问题。
Need to check novelty before this filing date? Find Prior Art