Unlock instant, AI-driven research and patent intelligence for your innovation.

Reinforcement learning-based service combination method and system in uncertain environment

A technology of reinforcement learning and service composition, applied in the field of service composition methods and systems based on reinforcement learning, can solve the problems of low service composition success rate and slow learning speed

Inactive Publication Date: 2015-11-11
INNER MONGOLIA UNIVERSITY
View PDF3 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] Aiming at the defects in the prior art, the present invention provides a service combination method and system based on reinforcement learning in an uncertain environment, which solves the problems of slow learning speed and low success rate of service combination in the existing service combination method

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Reinforcement learning-based service combination method and system in uncertain environment
  • Reinforcement learning-based service combination method and system in uncertain environment
  • Reinforcement learning-based service combination method and system in uncertain environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0102]In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0103] The invention proposes a service combination method based on reinforcement learning in an uncertain environment. Aiming at the two kinds of uncertainties in Web service composition, the uncertainty of service invocation result and the uncertainty of QoS, this method uses the discrete-time Markov decision process to model the service composit...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a reinforcement learning-based service combination method and system in an uncertain environment. The method includes: S1. receiving a service request; S2. obtaining an optimal strategy according to a learning algorithm which is trained in advance; and S3. calling a service according to the optimal strategy. The reinforcement learning-based service combination method in the uncertain environment solves the problem that an existing service combination method is slow in learning speed and low in service combination success rate.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a service combination method and system based on reinforcement learning in an uncertain environment. Background technique [0002] The Internet environment is characterized by openness and dynamics, and Web services are characterized by distribution, heterogeneity, autonomy, and dynamic changes, which together lead to two aspects of uncertainty in services, the uncertainty of Web service call results and service quality QoS uncertainty. On the one hand, the behavior of Web services is uncertain, that is, the execution results of Web services cannot be determined. On the other hand, the QoS indicators of Web services, such as response time, availability, etc., are related to some external factors of Web services such as network delays. Uncontrollable network delays make the QoS of services also uncertain. Even for the seemingly controllable QoS index values ​​inside the servic...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06Q10/04G06N7/00
Inventor 于磊
Owner INNER MONGOLIA UNIVERSITY