QoS-Aware Microservice Messaging for Response Time and Bandwidth
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing inter-microservice communication technologies face challenges in ensuring quality of service (QoS) guarantees, such as response time and bandwidth, due to the use of synchronization methods like REST API and message queue methods that are not integrated with the application and networking layers, leading to performance and scalability issues in distributed architectures.
Innovation Solution
A QoS-aware message highway & queue (QMHQ) system that integrates network and application layers, using a network control unit to generate QoS-aware paths, a service registration unit to manage service information, and a communication processing unit to process messages through these paths, ensuring QoS-aware networking and asynchronous communication between microservices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If message queue method is used for inter-microservice communication, then independence and asynchrony between microservices is ensured, but QoS guarantees such as response time and bandwidth are not supported
Solution Approach 1:
The system segments communication paths into multiple QoS-aware paths with different service levels. Each path is independently managed with specific QoS parameters, allowing different microservice communications to be routed through appropriate paths based on their requirements while maintaining asynchrony through the message queue architecture.
Solution Approach 2:
The system changes network parameters dynamically by establishing QoS-aware paths with differentiated bandwidth, latency, and reliability parameters. The network control unit adjusts routing parameters based on microservice communication requirements, enabling QoS guarantees while preserving the asynchronous message queue operation mode.
2Device complexity
If synchronous communication method like REST API or gRPC is used, then simple integration is achieved, but processing performance and scalability are degraded
Solution Approach 1:
The system inverts the traditional synchronous communication model by using asynchronous message queue communication as the base, while adding QoS path selection mechanisms to achieve the desired performance. This inversion allows the system to maintain operational simplicity through standardized message queues while dramatically improving processing performance and scalability through asynchronous operations.
3Adaptability or versatility
If centralized TCP/IP connection model is used, then network layer connectivity is provided, but differentiated QoS support for multiple applications is not available
Solution Approach 1:
The system applies local quality by assigning different QoS characteristics to different communication paths between microservices. Each path is configured with specific bandwidth, latency, and reliability parameters tailored to the application requirements, while the underlying TCP/IP infrastructure remains unchanged. This allows differentiated QoS support without increasing overall system complexity.
Data Source
AI summary
A system for differentiating quality of service (QoS) in inter-microservice communication according to an embodiment of the present disclosure includes a network control unit generating a QoS-aware path for guaranteeing QoS between microservices; a service registration unit registering information about the QoS-aware path between the microservices; and when it is necessary to guarantee the quality of service of messages received from a sending microservice, a communication processing unit identifying the QoS-aware path between the sending microservice and a receiving microservice from the information on the registered QoS-aware path, and processing the inter-microservice communication to allow the message to be transferred to the receiving microservice through the identified QoS path.