Large-scale self-adaptive composite service optimization method based on multi-agent reinforced learning

A technology of reinforcement learning and service combination, applied in the direction of electrical components, transmission systems, etc., can solve unrealizable problems, achieve effective monitoring and management, and solve the effects of uncertain and unpredictable environmental changes
CN103248693AInactive Publication Date: 2013-08-14SOUTHEAST UNIV
3 Cites 50 Cited by

Patent Information

Authority / Receiving Office
CN ยท China
Current Assignee / Owner
SOUTHEAST UNIV
Publication Date
2013-08-14
Estimated Expiration
Not applicable ยท inactive patent

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a self-adaptive composite service optimization method based on multi-agent reinforced learning. The method combines conceptions of the reinforced learning and agents, and defines the state set of reinforced learning to be the precondition and postcondition of the service, and the action set to be the Web service; parameters for Q learning including the learning rate, discount factors and Q value in reinforced learning are initialized; each agent is used for performing one composite optimizing task, and can perceive the current state, and select the optimal action under the current state as per the action selection strategy; the Q value is calculated and updated as per the Q learning algorithm; before the Q value is converged, the next round learning is performed after one learning round is finished, and finally the optimal strategy is obtained. According to the method, the corresponding self-adaptive action strategy is worked out on line as per the environment change at the time, so that higher flexibility, self-adaptability and practical value are realized.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention belongs to the field of artificial intelligence and relates to a method for self-adaptive optimization of Web service composition by using a computer. Background technique

[0002] Facing the complex and changeable market environment and fierce competition, enterprises urgently need the support of application integration and e-commerce technology in order to improve their competitiveness and adaptability in the market. Due to the characteristics of Web services, it is very suitable for the integration of cross-enterprise business applications. Both the industry and academia hope to create new service functions by combining existing Web services. In order to realize application interoperability and application integration of information systems among enterprises, a service-oriented framework system can be established by encapsulating enterprise application systems with Web services, providing a Web access interface, and integrating applica...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More