Packet Payload Accelerator Context Reconstruction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Computational accelerators face challenges in handling packet retransmissions and out-of-order packets due to the complexity of connection-oriented transport protocols like TCP, leading to a burden on the host CPU and inefficiencies in cryptographic operations.

Innovation Solution

The accelerator maintains and reconstructs flow state and context information independently using protocol information from packet headers and payloads, enabling autonomous reconstruction of context data for retransmitted or out-of-order packets, reducing CPU burden and conserving communication bandwidth.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the accelerator implements packet header processing and communication protocol logic in addition to its intended computational function, then it can process packet payloads independently without CPU intervention, but the device complexity increases significantly

Engineering Contradiction:
Improvepacket processing throughputVSAvoidaccelerator complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the protocol processing functionality into distinct modules: a packet processing unit that handles TCP/IP protocol logic, a cryptographic processing unit that handles encryption/decryption, and a context management unit that maintains flow state information. This segmentation allows each unit to specialize in specific tasks while working together to achieve full packet processing capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a context information structure as an intermediary between the packet processing unit and cryptographic processing unit. This context structure stores flow state information including TCP sequence numbers, encryption keys, and protocol parameters, enabling the cryptographic unit to perform operations independently without direct CPU intervention for each packet.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of time

If the accelerator autonomously reconstructs context information for retransmitted packets, then CPU burden is reduced and communication bandwidth is conserved, but the difficulty of detecting and measuring increases

Engineering Contradiction:
ImproveCPU time for protocol processingVSAvoidcontext reconstruction complexity
Core Design Contradiction:
Loss of timeVSDifficulty of detecting and measuring

Solution Approach 1:

The patent implements preliminary action by pre-establishing context information structures that contain all necessary protocol state data (TCP sequence numbers, encryption keys, flow identifiers) before packet transmission. When retransmission is needed, the accelerator can directly reuse or adjust this pre-prepared context without requiring CPU intervention to reconstruct it from scratch.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent employs feedback mechanisms where the packet processing unit monitors packet transmission status and automatically updates context information in response to acknowledgments or retransmission requests. This feedback loop enables autonomous context management, where the accelerator adjusts its internal state based on network conditions without CPU involvement.

Inventive Principle:
Principle #23Feedback

3Reliability

If the accelerator handles connection-oriented transport protocols with sequence numbers and retransmission logic, then reliable data transmission is achieved, but the device complexity increases

Engineering Contradiction:
Improvedata transmission reliabilityVSAvoidprotocol processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges the TCP reliability functions (sequence number tracking, retransmission logic, acknowledgment handling) with the cryptographic processing functions (encryption, decryption, authentication) into a single integrated accelerator device. This combination eliminates the need for separate hardware components while achieving both reliable transmission and secure encryption in one unit.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent designs the accelerator with universal functionality to handle multiple protocol operations: packet parsing, sequence number validation, retransmission management, encryption/decryption, and authentication. The cryptographic processing unit can operate in different modes (encrypt, decrypt, authenticate) based on the same hardware resources, achieving multi-functionality without proportionally increasing complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11418454B2Computational accelerator for packet payload operations
Publication Date: 2022.08.16 MELLANOX TECHNOLOGIES LTD(IL)
  • US11418454B2 patent drawing
  • US11418454B2 patent drawing
  • US11418454B2 patent drawing

AI summary

Apparatus including a first interface to a host processor, a second interface to transmit and receive data packets having headers and payloads, to and from a packet communication network, a memory holding context information regarding a flow of the data and assigning serial numbers to the data packets in the flow, according to a session-layer protocol, and processing circuitry between the first and second interfaces and having acceleration logic, to decode the data records according to the session-layer protocol, using and updating the context information based on the serial numbers and the data records of the received packets, and processing circuitry writing the decoded data records through the first interface to a host memory. The acceleration logic, upon receiving in a given flow a data packet containing a serial number that is out of order, reconstructs the context information and applies that context information in decoding data records in subsequent data packets in the flow.