Double-loss value network deep reinforcement learning KVFD model mechanical parameter global optimization method and system

A technology of reinforcement learning and mechanical parameters, applied in neural learning methods, biological neural network models, design optimization/simulation, etc., can solve problems such as difficulty in approaching global parameters, poor performance, and poor reliability

Active Publication Date: 2021-07-06
XI AN JIAOTONG UNIV
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method is fast and effective for fitting simple functions, but it often performs poorly for complex functions and multi-parameter functions.
[0003] For the multi-parameter optimization of complex functions of the KVFD model, the common greedy algorithm, gradient descent algorithm, and simulated annealing algorithm cannot obtain a better global optimal solution; among them, the greedy algorithm and gradient descent algorithm can find The local optimal solution of , has certain applicability to the multi-parameter optimization of complex functions, but whether to find the global parameters has a lot to do with the given initial value, and it is difficult to approach the global parameters; the simulated annealing algorithm adopts a certain probability to accept new The parameter solution of , has the ability to jump out of the local optimal trap. For optimization problems with many local optimal solutions, it shows better optimization capabilities. There is a certain probability that a solution near the global parameter solution can be found, but simulated annealing The probabilistic nature of the algorithm also makes it unable to approach the global parameter solution every time, and the reliability is poor
[0004] To sum up, at present, for the KVFD model complex function multi-parameter optimization problem, it is difficult to effectively approach the global optimal solution

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Double-loss value network deep reinforcement learning KVFD model mechanical parameter global optimization method and system
  • Double-loss value network deep reinforcement learning KVFD model mechanical parameter global optimization method and system
  • Double-loss value network deep reinforcement learning KVFD model mechanical parameter global optimization method and system

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment

[0065] In the embodiment of the present invention, the nano-indentation equation of the circular probe of the KVFD model (hereinafter referred to as the KVFD equation) is selected to implement the strategy of the present invention. The equation is divided into three loading protocols: Ramp-relaxation, Load-unload, and Ramp-creep (hereinafter referred to as relaxation, load-unload, and creep). The equation system is shown in Table 1.

[0066] Table 1. Nanoindentation equation of KVFD model under circular probe

[0067]

[0068] The mechanical parameters to be optimized are [E 0 , α, τ]. R is the probe radius, v is the indentation depth increasing speed during loading, k is the pressure increasing speed during loading, T r is the turning time, Γ( ) is the gamma function, is the complete beta function, is an incomplete beta function, is the Mittag-Leffler (M-L) function.

[0069] Construction of CF-DQN algorithm examples for three loading protocols for KVFD equations...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a double-loss value network deep reinforcement learning KVFD model mechanical parameter global optimization method and system, and the method comprises the following steps: S1, inputting a pre-obtained nanoindentation measurement curve into a trained prediction value obtaining network, and obtaining a parameter prediction value of the nanoindentation measurement curve; and s2, performing iteration by taking the parameter prediction value as an iteration initial value of a deep reinforcement learning algorithm to obtain approximation of a global parameter solution of a pre-obtained nanoindentation measurement curve; and when the approximation of the global parameter solution reaches a preset convergence condition, outputting the approximation of the global parameter solution as a mechanical parameter of the KVFD model. According to the method, the parameter prediction value is introduced in iteration for parameter guidance, and the global optimal solution can be better approached.

Description

technical field [0001] The invention belongs to the technical field of mechanical parameters of nano-indentation measurement data, relates to the field of KVFD model multi-parameter function fitting and global parameter approximation, and in particular relates to a method and system for global optimization of mechanical parameters of a KVFD model with double-loss value network deep reinforcement learning. Background technique [0002] At present, in the process of obtaining the mechanical parameters of the measured material through the nanoindentation measurement data, for simple function fitting, the least square method is mostly used, and the function parameters are adjusted iteratively one by one to reduce the least mean square between the fitted curve and the real curve. error. This method is fast and effective for fitting simple functions, but it often performs poorly for complex functions and multi-parameter functions. [0003] For the multi-parameter optimization of ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G16C60/00G06F30/27G06N3/04G06N3/08G06F111/14G06F119/14
CPCG16C60/00G06F30/27G06N3/08G06F2111/14G06F2119/14G06N3/044G06N3/045
Inventor 张红梅周衍王凯李文彬张可浩王炯万明习
Owner XI AN JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products