Multi-dimensional continuous optimization variable global optimization method based on reinforcement learning

A technology of optimizing variables and reinforcement learning, which is applied in the field of optimization algorithms, can solve problems such as slow convergence speed and inability to support large-scale optimization variables, and achieve the effect of reducing manual participation

Active Publication Date: 2020-08-18
XI AN JIAOTONG UNIV
View PDF4 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In order to solve the problem that the existing global optimization algorithm cannot support large-scale optimization variables and the convergence speed is slow, the present invention proposes a multi-dimensional continuous optimization variable global optimization method based on reinforcement learning, which can be realized in the actual optimization process A higher degree of intelligent optimization, without or with less manual intervention, further improves the efficiency of optimization

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-dimensional continuous optimization variable global optimization method based on reinforcement learning
  • Multi-dimensional continuous optimization variable global optimization method based on reinforcement learning
  • Multi-dimensional continuous optimization variable global optimization method based on reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0028] The entire optimization process is as follows figure 1 The overall flow of the global optimization algorithm shown is performed. First select the aircraft wing airfoil in aeronautics as the object, and optimize its aerodynamic shape. The optimization goal is to increase its lift coefficient while keeping the drag coefficient constant, and use the free-form deformation technology (FFD) method to parameterize it .

[0029] Then build a reinforcement learning environment based on Bayesian optimization algorithm and optimization effect evaluation algorithm. For Bayesian optimization algorithms, use Python to write calculation files, which include optimization variables, airfoil deformation methods, aerodynamic calculations, as well as Bayesian optimization algorithm calls and optimization results output; for optimization evaluation algorithms, use Python language According to the objective function and constraint conditions of the specific optimization problem, a suitable qu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-dimensional continuous optimization variable global optimization method based on reinforcement learning, wherein the method comprises the steps of establishing a reinforcement learning environment; selecting a specified number of optimization variables in the specified optimization variable set by using a reinforcement learning method, and then performing optimization on values of the optimization variables by using a continuous optimization variable optimization algorithm in a sequence optimization strategy; and optimizing an overall process and a constraint introduction method. According to the method, for the global optimization problem of the multi-dimensional continuous optimization variables, the purpose of intelligent optimization is achieved; the limitation of a traditional global optimization method on the number of the optimization variables can be broken through; and wide application of the artificial intelligence technology in the aspect of optimization becomes possible. The method can be applied to industrial design, manufacturing and processing, control optimization, investment decision, system engineering and other occasions with large-scale design variables; benefited from the strong intelligent combination optimization capability of deep reinforcement learning, the method also has a good global optimization effect on a system with a complex coupling relationship among variables.

Description

Technical field [0001] The present invention belongs to the field of optimization algorithms, and particularly relates to a global optimization method for large-scale continuous value optimization variables. Background technique [0002] Optimization methods can be basically divided into two categories: gradient-based optimization methods and global optimization methods. Gradient-based methods are highly efficient in optimizing single-extreme problems, but most complex multi-extreme problems need to be dealt with in engineering practice and other occasions, and gradient-based methods are prone to fall into local optimality and cannot meet the optimization requirements well. Traditional global optimization methods mainly include genetic algorithms, particle swarm optimization, etc. These methods have good global optimization capabilities and can be applied to complex multi-extreme optimization problems. However, traditional global optimization algorithms have limitations on the n...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F30/27G06K9/62G06F111/06
CPCG06F30/27G06F2111/06G06F18/24155
Inventor 陈刚王怡星韩仁坤张扬
Owner XI AN JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products