Dynamic Service Request Rerouting for Composite Web Services

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Integrating multiple levels of hosted services offered by different service providers into composite services is challenging due to difficulties in ensuring consistent performance and resource allocation across various service endpoints.

Innovation Solution

Implementing a dynamic rerouting mechanism that assigns service requests to initial service endpoints meeting minimum performance thresholds defined by Service Level Agreements (SLAs), with continuous monitoring and rerouting to alternate endpoints as necessary to maintain SLA compliance, thereby minimizing costs and maximizing efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If service requests are assigned to initial service endpoints based on minimum performance thresholds, then SLA compliance is maintained, but system complexity increases due to continuous monitoring and dynamic rerouting requirements

Engineering Contradiction:
ImproveSLA complianceVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent introduces a service endpoint management system that acts as an intermediary between service requests and multiple service endpoints. This mediator continuously monitors performance metrics, evaluates SLA compliance, and dynamically reroutes requests without requiring individual endpoints to implement complex monitoring logic, thus centralizing complexity in a dedicated management layer

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements dynamic rerouting where service requests are continuously reassigned between service endpoints based on real-time performance monitoring. When endpoints fail to meet SLA thresholds, the system automatically transitions requests to alternative endpoints, creating a flexible, adaptive routing mechanism that maintains reliability while distributing load dynamically

Inventive Principle:
Principle #15Dynamics

2Productivity

If multiple service endpoints are used to handle service requests, then resource utilization efficiency improves, but difficulty in ensuring consistent performance across endpoints increases

Engineering Contradiction:
Improveresource utilization efficiencyVSAvoiddifficulty in ensuring consistent performance
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements continuous performance monitoring of service endpoints with feedback loops that track metrics such as response time, throughput, and error rates. This feedback mechanism enables the system to identify underperforming endpoints and automatically reroute requests to maintain consistent service quality across multiple endpoints, ensuring uniform performance standards are met

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system dynamically changes routing parameters based on monitored performance metrics. By adjusting which endpoints receive requests based on real-time parameter evaluation (performance thresholds, SLA compliance), the system maintains consistent service quality while efficiently utilizing multiple endpoints with varying capabilities

Inventive Principle:
Principle #35Parameter changes

3Reliability

If dynamic rerouting is implemented to maintain SLA compliance, then service reliability improves, but loss of time due to monitoring and rerouting operations increases

Engineering Contradiction:
Improveservice reliabilityVSAvoidtime for monitoring and rerouting
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary evaluation of service endpoints against SLA thresholds before assigning requests. By pre-assessing endpoint capability and performance status, the system can make faster routing decisions and avoid time-consuming evaluations during request handling, thus reducing the time overhead of dynamic rerouting while maintaining reliability

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9979631B2Dynamic rerouting of service requests between service endpoints for web services in a composite service
Publication Date: 2018.05.22 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9979631B2 patent drawing
  • US9979631B2 patent drawing
  • US9979631B2 patent drawing

AI summary

Technologies are described herein for rerouting a service request between service endpoints. The service request is received, at a first web service, from a second web service. The first web service and the second web service may be components of a composite service. The service request is routed to an initial service endpoint configured to respond to the service request according to a service level agreement between the first web service and the second web service. Service criteria associated with the initial service endpoint are monitored. A determination is made as to whether the service criteria meet a performance threshold specified by the service level agreement. If the service criteria do not meet the performance threshold specified by the service level agreement, then the service request is rerouted from the initial service endpoint to an alternate service endpoint.