基于系统解耦的多阶段Q-学习最优控制方法、设备及介质

By employing a multi-stage Q-learning method for system decoupling, the optimal control of high-dimensional discrete-time systems is optimized, solving the problems of low solution efficiency and high complexity in traditional methods. This enables efficient and real-time control strategy decision-making, and is applicable to fields such as automated production and distributed energy management.

CN120507989BActive Publication Date: 2026-07-17BEIHANG UNIV

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
BEIHANG UNIV
Filing Date
2025-06-19
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing technologies are inefficient and difficult to solve optimal control problems in high-dimensional discrete-time systems. Traditional methods are prone to getting trapped in local optima and have high computational complexity.

Method used

A multi-stage Q-learning optimal control method based on system decoupling is adopted. Through a non-cooperative game framework and dynamic decoupling calculation, multiple value functions are optimized, a feedback control strategy is designed, and the least squares method is used to iterate the approximate value function to realize the dynamic trade-off of the control strategy.

Benefits of technology

It significantly reduces computational complexity, improves the real-time performance and robustness of control decisions, and reduces computational resource consumption, making it suitable for complex control systems such as automated production, intelligent scheduling, and distributed energy management.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120507989B_ABST
    Figure CN120507989B_ABST
Patent Text Reader

Abstract

本发明的一种基于系统解耦的多阶段Q‑学习最优控制方法、设备及介质,通过不同控制目标分配不同的权重,利用非合作博弈框架优化多个值函数,使控制策略能够在多个约束条件下实现动态权衡。这种方法不仅能避免传统单一值函数方法容易陷入局部最优的问题,还能灵活调整策略,使其更符合系统整体优化需求。相比于传统深度Q‑learning(DQN)方法,该方法通过非合作博弈建模和动态解耦计算,有效降低计算复杂度,提高控制决策的实时性和鲁棒性,在保证最优控制策略的同时,显著减少了计算资源的消耗。
Need to check novelty before this filing date? Find Prior Art