Island-Based Network Flow Processor Local Event Ring

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current network processors, such as the Intel IXP2800, face limitations in scalability and efficiency due to rigid architectures that do not effectively manage packet processing and memory access across multiple processing units, leading to bottlenecks in handling high-speed packet traffic.

Innovation Solution

The island-based network flow processor (IB-NFP) integrated circuit features a configurable mesh data bus with crossbar switches and distributed credit FIFO structures, allowing for flexible partitioning of functional circuitry into rectangular islands with a staggered layout, enabling efficient communication and resource management across multiple islands.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a rigid architecture with centralized memory access is used, then memory management is simplified, but scalability and processing efficiency deteriorate due to bottlenecks in handling high-speed packet traffic across multiple processing units

Engineering Contradiction:
Improvepacket processing efficiencyVSAvoidarchitecture complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The network processor is divided into multiple independent functional islands (ingress island, egress island, microengine islands, memory islands) that can be independently configured and scaled. Each island has its own local memory and processing units, eliminating the bottleneck of centralized memory access while maintaining modular simplicity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from a centralized hierarchical memory architecture to a distributed mesh network architecture, adding spatial dimensionality to data access paths. Multiple access routes through the mesh network allow parallel data transfers between islands, dramatically improving throughput without increasing control complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Power

If more processing power is added to handle high-speed packet traffic, then processing capacity increases, but bottlenecks occur due to limited memory access bandwidth in rigid architectures

Engineering Contradiction:
Improveprocessing powerVSAvoidmemory access bandwidth
Core Design Contradiction:
PowerVSProductivity

Solution Approach 1:

Memory is segmented and distributed to each functional island rather than using a single centralized memory pool. Each island has local memory for frequently accessed packet data, while the mesh network provides access to remote memory on other islands, enabling multiple processing units to operate simultaneously without contending for the same memory bandwidth.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The mesh network acts as an intermediary between processing islands and memory islands, providing multiple parallel access paths. Instead of direct point-to-point connections that create bandwidth bottlenecks, the mesh network routes data through intermediate nodes, enabling aggregate bandwidth to scale with the number of processing units.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of manufacture

If a fixed architecture is used, then design and manufacturing are simplified, but adaptability to different packet processing requirements deteriorates

Engineering Contradiction:
Improvemanufacturing simplicityVSAvoidpacket processing adaptability
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The architecture uses dynamically reconfigurable crossbar switches in each island that can be programmed at runtime to establish different connection patterns. This allows the same physical hardware to adapt to various packet processing configurations (routing, switching, filtering) without requiring different manufactured devices, combining manufacturing simplicity with operational flexibility.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

Each island is designed as a universal module that can perform multiple functions depending on configuration. The ingress island can handle packet classification, the microengine islands can perform various processing tasks, and the egress island can implement different scheduling algorithms, all using the same basic island architecture and mesh network interface.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9619418B2Local event ring in an island-based network flow processor
Publication Date: 2017.04.11 NETRONOME SYSTEMS INC
  • US9619418B2 patent drawing
  • US9619418B2 patent drawing
  • US9619418B2 patent drawing

AI summary

An island-based network flow processor (IB-NFP) integrated circuit includes islands organized in rows. A configurable mesh event bus extends through the islands and is configured to form a local event ring. The configurable mesh event bus is configured with configuration information received via a configurable mesh control bus. The local event ring provides a communication path along which an event packet is communicated to each rectangular island along the local event ring. The local event ring involves event ring circuits and event ring segments. Upon each transition of a clock signal, an event packet moves through the ring from event ring segment to event ring segment. Event information and not packet data travels through the ring. The local event ring functions as a source-release ring in that only the event ring circuit that inserted the event packet onto the ring can delete the event packet from the ring.