NIC-Based Microservice Invocation to Cut Proxy Call Delays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The use of conventional microservice architectures leads to increased service call delays and reduced application performance due to contention for system resources by multiple proxies, causing process context switching and resource contention.
Innovation Solution
Implementing service call functions by a network interface card (NIC) to replace proxies, enabling centralized processing of service requests and governance logic, thereby decoupling service discovery, load balancing, encryption, and other functions, and reducing resource contention.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a service mesh with independent proxies is configured for each microservice, then service governance and control functions are achieved, but service call delay increases sharply and application performance deteriorates
Solution Approach 1:
The patent merges multiple independent proxies into a single shared proxy that serves multiple microservices. This shared proxy consolidates service governance functions while eliminating the resource contention and context switching that occur when multiple proxies operate simultaneously, thereby reducing service call delay while maintaining governance capabilities.
Solution Approach 2:
The shared proxy is designed to perform multiple functions including service discovery, load balancing, encryption, and governance control for multiple different microservices. This multi-functional design eliminates the need for separate proxies for each service, reducing overall system resource consumption and improving performance.
2Adaptability or versatility
If multiple proxies are deployed for different services, then each service can be governed independently, but resource contention causes process context switching and increases service call delay
Solution Approach 1:
The patent combines multiple proxy instances into a single shared proxy that handles governance tasks for multiple services. This consolidation eliminates resource contention and process context switching between multiple proxies, thereby improving service call throughput while maintaining the ability to govern different services independently through software configuration.
3Reliability
If independent proxies are configured for each microservice, then service control functions are achieved, but a large quantity of system resources are consumed
Solution Approach 1:
The patent merges multiple proxy instances into a single shared proxy, dramatically reducing the quantity of system resources required for service governance. The shared proxy consolidates CPU, memory, and other resources that would otherwise be duplicated across multiple independent proxies, while maintaining full service control capabilities through unified governance logic.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
This application provides a microservice call method. The method includes: A network interface card receives service call requests separately generated by a plurality of first services deployed on a first device, where each of the plurality of first services is corresponding to one second service, and the second service is used to process first data of a service call request generated by the first service corresponding to the second service; and the network interface card sends the service call request to the second service based on service governance logic related to the first data. In this way, a problem that contention of a plurality of proxies for a system resource causes process context switching and further causes a sharp increase in a service delay is resolved, and application performance is improved.