Packet Arbitration via Independent Characteristic Records

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Chiplet systems face inefficiencies in packet arbitration due to contention at output ports, particularly when considering only packets visible at the head of input buffers, leading to increased latency and reduced performance.

Innovation Solution

Implementing a packet characteristic data structure to record and consider more than just the packets at the head of input buffers, allowing the arbiter to choose packets based on size, location, and other characteristics to prevent collisions and optimize packet delivery.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the arbiter only considers packets at the head of input buffers for arbitration, then the arbitration process is simple and fast, but packet delivery efficiency is reduced due to output port contention

Engineering Contradiction:
Improvepacket delivery efficiencyVSAvoidarbitration process complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent pre-calculates and stores packet characteristics (size, location, destination) in a data structure before arbitration occurs. This preliminary preparation allows the arbiter to make informed decisions about which packets to deliver next, optimizing packet delivery efficiency by considering future arbitration needs rather than only current head-of-queue packets.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary data structure that sits between the input buffers and the arbiter. This data structure stores pre-computed packet characteristics and acts as a mediator, providing the arbiter with detailed information about multiple packets in the buffer without requiring the arbiter to directly examine each packet, thus balancing complexity and efficiency.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If the arbiter considers more packets beyond just the head of buffers, then packet delivery optimization improves, but arbitration latency increases

Engineering Contradiction:
Improvepacket delivery optimizationVSAvoidarbitration latency
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

Packet characteristics such as size, location, and destination are pre-calculated and stored in the data structure before arbitration occurs. This preliminary computation eliminates the need for real-time analysis of multiple packets during arbitration, thus reducing arbitration latency while still enabling optimized packet selection based on comprehensive buffer contents.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If packet characteristics are stored in a data structure independent of the buffer, then arbitration decision-making is improved, but memory usage increases

Engineering Contradiction:
Improvearbitration decision-makingVSAvoidmemory usage
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent creates a compact copy of essential packet characteristics (size, location, destination) in a separate data structure. Rather than storing complete packet data or examining entire packets, only the critical arbitration-relevant attributes are copied and stored, reducing memory overhead while still enabling improved arbitration decision-making.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11985078B2Packet arbitration for buffered packets in a network device
Publication Date: 2024.05.14 MICRON TECHNOLOGY INC
  • US11985078B2 patent drawing
  • US11985078B2 patent drawing
  • US11985078B2 patent drawing

AI summary

Devices and techniques for packet arbitration for buffered packets in a network device are described herein. A packet can be received at an input of the network device. The packet can be placed in a buffer for the input and a characteristic of the packet can be obtained. A record for the packet, that includes the characteristic, is written into a data structure that is independent of the buffer. Arbitration, based on the characteristic of the packet in the record, can then be performed among multiple packets to select a next packet from the buffer for delivery to an output.