Reflection Routing for Adaptive Modular Load Balancing in Multi-Hierarchy NoCs

The patent applies segmentation by dividing the interconnect network into multiple hierarchical levels (Level 0, Level 1, Level 2 networks) with different granularities. Each level handles specific routing patterns and credit flows, allowing the system to optimize for different traffic types independently rather than using a monolithic interconnect that handles all traffic uniformly, thereby improving throughput efficiency while reducing overall power consumption.

The patent introduces a hierarchical dimension to the interconnect architecture, organizing networks in multiple levels where Level 0 is the finest granularity and Level 2 is the coarsest. This dimensional organization allows credit loops to be contained at appropriate levels and enables more efficient routing decisions, improving productivity while managing power consumption through localized rather than global credit management.

The patent segments the interconnect into hierarchical levels where each level is designed to handle specific bandwidth requirements. Level 0 networks handle fine-grained traffic with lower complexity, while Level 2 networks handle coarse-grained high-bandwidth traffic. This segmentation allows the system to support high bandwidth agents like HBM without proportionally increasing overall system complexity, as each segment can be optimized independently.

The patent introduces intermediate Level 1 networks that act as mediators between Level 0 and Level 2 networks. These intermediate networks provide buffer and routing capabilities that simplify the interface between high-bandwidth agents and the rest of the system, allowing bandwidth capacity to scale without linearly increasing complexity at any single level.

The patent segments credit management and routing functions across hierarchical levels, allowing credit loops to be contained at the appropriate level rather than requiring global credit management. This segmentation enables high bandwidth capacity at Level 2 while keeping power consumption manageable by localizing credit verification and routing decisions, avoiding the need for complex power-hungry off-die interconnects.

The patent implements self-service credit management where each hierarchical level maintains and verifies credits independently. Level 0 networks manage their own credits, Level 1 networks manage intermediate credits, and Level 2 networks manage top-level credits. This self-service approach eliminates the need for centralized credit management that would require complex high-power interconnects, while still supporting high bandwidth capacity through the hierarchical structure.