Hardware-Assisted Datacenter Atomics With Single-Packet Operations
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Remote atomic operations in distributed systems expose network round-trip latency, leading to performance loss and preventing optimizations such as network aggregation.
Innovation Solution
A computing system that generates a relaxed range for data operations, combines atomic and data operations into a packet, and transmits this packet over a network, allowing for atomic operations to be performed at either the destination node or a centralized network switch.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If remote atomic operations are performed using traditional network protocols, then locks can be established without remote host intervention, but network round-trip latency is exposed to the application causing performance loss
Solution Approach 1:
The patent combines atomic operations with data operations into a single packet transmission. Instead of sending separate packets for atomic operations and data operations, the system merges them into one unified packet that is transmitted over the network in a single round-trip, thereby eliminating the latency penalty of multiple network exchanges while maintaining automated lock establishment.
2Reliability
If remote atomics are relied upon at the application level, then locks can be established, but network aggregation optimizations are prevented
Solution Approach 1:
By combining multiple operations (atomic operations and data operations) into a single packet, the system enables network aggregation optimizations. The unified packet structure allows the network infrastructure to process and aggregate multiple operations together, improving overall network efficiency while still providing reliable lock establishment through the atomic operation component.
Data Source
AI summary
Embodiments herein describe generating packets that combine an atomic operation (e.g., an atomic fetch) with a data operation (e.g., a put). Previous remote atomics first transmit a packet to a remote node that provides a lock for the data. If the lock is granted, the node transmits another packet containing a data operation which can read or write data. However, the embodiments herein can use a relax range-based atomics where the packet uses a range to reserve space in a dataset (e.g., a buffer) at the destination node for the data operation.