Adaptive Packet Formatting for Low-Overhead Network Transmission
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing computing systems face inefficiencies in packet transmission due to excessive header overhead, particularly in high-performance computing (HPC) and artificial intelligence (AI) environments, which can degrade network goodput and increase latency.
Innovation Solution
The system optimizes packet formats by reducing header overhead through context-indexed tables and byte-by-byte construction, utilizing different header formats based on network type, and employing forward error correction to differentiate frame types, ensuring compatibility with various switch vendors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If standard packet headers are used for transmission, then compatibility with various network devices is maintained, but header overhead increases and network goodput decreases
Solution Approach 1:
The patent extracts and removes redundant information from packet headers, keeping only the essential fields needed for transmission. By taking out unnecessary header components, the system reduces header overhead while maintaining sufficient functionality for network communication, directly improving network goodput.
Solution Approach 2:
The patent applies different header formats tailored to specific network contexts and transmission requirements. Instead of using a uniform header structure, the system adapts the header content and length to local network conditions, device types, and traffic patterns, optimizing goodput for each specific scenario while maintaining compatibility where needed.
2Productivity
If packet headers are minimized to reduce overhead, then network goodput improves, but compatibility with different switch vendors may be compromised
Solution Approach 1:
The patent designs packet headers with universal fields that can be interpreted by different switch vendors while allowing for optimized reduced-size variants. The header structure incorporates multi-functional elements that serve both standard compatibility purposes and optimized transmission purposes, enabling a single packet format to work across diverse network equipment from different vendors.
Solution Approach 2:
The patent changes header parameters such as field length, presence/absence of certain fields, and encoding schemes based on the specific transmission context and target network device. By dynamically adjusting header parameters, the system maintains compatibility with various switch vendors while optimizing for reduced overhead in appropriate scenarios.
3Loss of substance
If context-indexed tables are used to reduce header size, then header overhead decreases, but device complexity increases
Solution Approach 1:
The patent pre-computes and stores optimized header configurations in context-indexed tables before transmission occurs. By performing the complex header optimization work in advance and storing the results in lookup tables, the system eliminates the need for complex real-time calculations during packet transmission, reducing runtime complexity while maintaining small header sizes.
Solution Approach 2:
The patent uses context-indexed tables that contain pre-fabricated header templates and configurations. Instead of generating optimized headers from scratch for each packet, the system copies and retrieves pre-optimized header patterns from the tables based on the transmission context, significantly reducing the computational complexity of packet formatting while maintaining small header overhead.
Data Source
AI summary
Examples described herein relate to a network interface device that includes circuitry to decide packet format of a packet including data to be transmitted based on network utilized to transmit the packet and circuitry to form the packet based on the decided packet format. In some examples, the network utilized to transmit the packet is based on an egress port of the packet. In some examples, the network utilized to transmit the packet comprises one or more of: direct interconnect, small scale-up network, or large scale-out network. In some examples, to decide packet format, the circuitry is to form the packet byte by byte to reduce overhead caused by preamble and number of header fields.