Dynamic Service Endpoint Selection for Microservice Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional microservices in cloud environments face inefficiencies due to excess computation time, memory, and resources required for HTTP REST function calls, which can degrade performance and lead to maintenance challenges when users manually select service endpoints at deployment time.
Innovation Solution
A computer-implemented method dynamically determines and selects the optimal service endpoints to fulfill user requests using an optimization system, such as particle swarm optimization, to achieve the best overall solution by evaluating and optimizing service chains and machine learning models based on user requirements, resource usage, and performance metrics.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If HTTP REST function calls are used for microservice communication, then service interoperability is achieved, but computation time and processing overhead increase
Solution Approach 1:
The system pre-generates multiple candidate service endpoint combinations and evaluates their performance characteristics in advance. By preparing these options beforehand, the system avoids real-time computation overhead when processing actual requests, thus reducing computation time while maintaining service interoperability.
Solution Approach 2:
The system dynamically selects service endpoints based on real-time conditions and performance metrics rather than using static pre-configured endpoints. This dynamic adaptation allows the system to optimize computation time by choosing the fastest available endpoint while preserving interoperability across different services.
2Ease of operation
If manual endpoint selection is performed at deployment time, then system configuration is simplified, but system adaptability and performance optimization are reduced
Solution Approach 1:
The system separates configuration concerns from runtime decision-making. Configuration simplicity is maintained by defining endpoint options at deployment time, while system adaptability is achieved by enabling runtime selection among these predefined options based on performance metrics and conditions.
Solution Approach 2:
The system autonomously selects optimal service endpoints at runtime without requiring manual intervention or complex configuration changes. This self-service capability maintains configuration simplicity while achieving high adaptability through automated endpoint selection based on real-time performance evaluation.
3Productivity
If multiple service endpoints are implemented for optimal performance, then performance optimization is improved, but device complexity and maintenance difficulty increase
Solution Approach 1:
The system implements a universal endpoint selection mechanism that works across multiple service endpoints with different performance characteristics. This single multi-functional selection system manages multiple endpoints uniformly, achieving performance optimization without proportionally increasing system complexity or maintenance burden.
Data Source
AI summary
Embodiments of the present invention provide methods, computer program products, and systems. Embodiments of the present invention can dynamically determine one or more endpoints to fulfill a user request. Embodiments of the present invention can select the dynamically determined one or more endpoints as the one or more endpoints that fulfill the user request. Embodiments of the present invention can execute the selected one or more endpoints to fulfill the user request.