Unified Send Queue for Low-Latency Small Packet Transmission
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data communication technologies face challenges in achieving low-latency and high-bandwidth transmission, particularly for small data packets, due to significant overhead time in network operations, which affects network performance and efficiency.
Innovation Solution
The intermixing of Bulk Data Send (BDS) and Direct Packet Push (DPP) techniques allows for flexible and efficient transmission of both small and large data packets by utilizing the same send queue, with BDS minimizing overhead for large packets and DPP reducing latency for small packets, thereby optimizing network performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If Bulk Data Send (BDS) is used for data transmission, then bandwidth efficiency is improved for large packets, but latency increases for small packets due to overhead time
Solution Approach 1:
The system dynamically selects between BDS and DPP transmission methods based on packet size characteristics. Small packets utilize DPP for low latency, while large packets use BDS for high bandwidth efficiency, making the transmission approach adaptive rather than static
Solution Approach 2:
The patent changes the transmission parameter (method selection) based on the data packet size parameter. By monitoring packet size, the system switches between two transmission modes: BDS for large packets and DPP for small packets, optimizing performance for each case
2Loss of time
If Direct Packet Push (DPP) is used for data transmission, then latency is reduced for small packets, but bandwidth efficiency decreases for large packets
Solution Approach 1:
The system dynamically adjusts the transmission method based on real-time packet size conditions. When small packets are detected, DPP is activated for low latency; when large packets are detected, the system switches to BDS for better bandwidth utilization
Solution Approach 2:
The transmission approach parameter is changed based on packet size. The system transitions from DPP to BDS or vice versa depending on whether the current packet is small or large, optimizing the balance between latency and bandwidth
3Adaptability or versatility
If separate queues are used for BDS and DPP operations, then operation flexibility is improved, but device complexity increases
Solution Approach 1:
The patent merges BDS and DPP operations into a single unified send queue. The networking device reads from this single queue and determines whether to execute BDS or DPP based on the specific packet characteristics, eliminating the need for separate queues while maintaining operational flexibility
Solution Approach 2:
The single send queue is designed to handle both BDS and DPP operations universally. The queue structure and management logic are made multi-functional to support different transmission methods without requiring separate dedicated queues for each operation type
Data Source
Figure 1
Figure 2
Figure 3
AI summary
When interfacing with a host, a networking device can handle a first data like Bulk Data Send. In response to a first doorbell ring, the networking device can read a first queue entry from a send queue in the host. Based on the first queue entry, the networking device can read the first data from a first memory in the host and then output the read first data. The networking device can also handle a second data like Direct Packet Push. The networking device can store a second data received from the host. In response to a second doorbell ring, the networking device can output the second data. The first data and the second data can be associated with first and second queue entries, both on the same send queue in the host. High-throughput and low-latency can be achieved. Small and large data packets can be accommodated.