Data Mover Accelerator Offloading for Service Mesh Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Service meshes experience latency and high CPU utilization due to delays in data copy operations, which hinder efficient communication between microservices in a distributed system.
Innovation Solution
Offloading data copy operations to a data mover accelerator, such as a direct memory access (DMA) circuitry, and utilizing user interrupts to reduce latency and CPU usage by batching work requests and polling for completion status.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If data copy operations are performed by the service mesh using traditional CPU-based methods, then the operations can be completed, but latency increases and CPU utilization becomes high
Solution Approach 1:
The patent extracts data copy operations from the service mesh CPU and offloads them to a dedicated data mover accelerator. This separation allows the CPU to focus on higher-level service mesh logic while the accelerator handles memory copy tasks, reducing both latency and CPU utilization.
Solution Approach 2:
The patent introduces a data mover accelerator as an intermediary component between the service mesh and memory systems. This accelerator acts as a mediator that performs data copy operations independently, preventing the CPU from being blocked by these operations and reducing overall system latency.
2Reliability
If the service mesh waits for completion notices of data copy operations, then operation correctness is maintained, but the service mesh stalls while waiting
Solution Approach 1:
The patent implements a feedback mechanism where the data mover accelerator sends completion notices to the service mesh. This allows the service mesh to be notified asynchronously when data copy operations are complete, maintaining reliability while eliminating stalling behavior.
Solution Approach 2:
The service mesh initiates data copy operations in advance and continues with other tasks. The completion notice mechanism allows the service mesh to proceed without waiting, and only checks completion status when necessary, reducing waiting time while maintaining operational correctness.
Data Source
AI summary
Examples described herein relate to a system for accelerating data operations of a service mesh using a data mover accelerator.