Router devices and NoC systems for 2D mesh network structures

By simplifying the NoC router architecture, removing unused redirection links, and introducing pop-up and re-injection mechanisms, the power consumption and area waste problems of traditional NoC routers are solved, achieving low-power and high-efficiency packet forwarding and improving the performance and flexibility of multi-core systems.

CN118921319BActive Publication Date: 2025-12-02SHANDONG INSPUR SCI RES INST CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202410945439.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-07-15
Publication Date
2025-12-02
Estimated Expiration
2044-07-15

AI Technical Summary

Technical Problem

In traditional NoC router designs, the complex cross-switch structure leads to unnecessary power consumption and area waste. Especially under XY or YX routing algorithms, the low utilization of packet redirection links becomes a bottleneck for improving the performance of multi-core systems.

Method used

By removing underutilized redirection data links in NoC routers, introducing pop-up and re-injection mechanisms, and adopting a simplified router architecture that retains only straight-through data links and local data ports, packet redirection operations are implemented using logical control units.

Benefits of technology

It significantly reduces the power consumption and footprint of NoC systems, improves resource utilization, enhances system flexibility and scalability, and is compatible with a variety of routing algorithms, including deterministic, partially adaptive, and fully adaptive routing algorithms.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118921319B_ABST
    Figure CN118921319B_ABST
Patent Text Reader

Abstract

This application relates to the field of integrated circuit design technology and discloses a router device applied to a NoC system with a 2D mesh network structure. It includes five ports: four directional ports (east, south, west, and north) and one local data port. Non-direct data links between the east, south, west, and north ports are removed, retaining only direct data links and connections to the local port. A logic control unit is used to perform the operation of popping data packets to the local data port and re-injecting them into the target directional port when a data packet needs to be redirected. This disclosure, by removing underutilized data links and employing a pop-and-re-inject mechanism, reduces power consumption and area footprint. Although it may introduce some performance loss, the impact on the overall performance of the NoC system is small because the number of redirection hops accounts for a small proportion of the total number of hops, and it significantly improves energy efficiency. This application also discloses a NoC system for a 2D mesh network structure.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of integrated circuit design technology, such as a router device and a NoC system for 2D mesh network structures. Background Technology

[0002] With the rapid development of multi-core chip technology, NoC (No-Chip) architecture, as a highly efficient and scalable on-chip communication architecture, has become the mainstream choice for connecting multi-core processors and their peripherals. However, with the increase in integration and core count, the power consumption problem of NoC has become increasingly prominent, becoming one of the key factors restricting the performance improvement of multi-core systems. Among the many NoC components, routers, due to their complex logic and frequent communication activities, have become the main source of power consumption.

[0003] Traditional NoC routers, designed to support omnidirectional packet routing, including straight-through and redirection, require complex crossbar switch structures. These structures have low utilization rates when packets are transmitted straight through, resulting in unnecessary power consumption and wasted space. Especially when using classic routing algorithms such as XY or YX, packets require at most one redirection during transmission, further reducing the utilization of redirection data links.

[0004] It should be noted that the information disclosed in the background section above is only used to enhance the understanding of the background of this application, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention

[0005] To provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. This summary is not intended as a general commentary, nor is it intended to identify key / important components or describe the scope of protection of these embodiments, but rather as a prelude to the detailed description that follows.

[0006] This disclosure provides a router device and a NoC system for a 2D mesh network structure, which are techniques for low-power optimization design of router components in a network-on-chip (NoC) on the network. By reducing unnecessary forwarding data links in the router and introducing a pop-up and re-injection-based routing strategy, the total power consumption of the NoC is significantly reduced.

[0007] In some embodiments, the router device, applied to a NoC system with a 2D mesh network structure, includes:

[0008] Five ports, including four directional ports (east, south, west, and north) and one local data port. The non-straight data links between the east, south, west, and north ports have been removed, leaving only the straight data links and the connection to the local port.

[0009] The logic control unit is used to perform the operation of popping the data packet to the local data port and re-injecting it into the target direction port when the data packet needs to be redirected.

[0010] Optionally, the router device further includes: a 2-1 multiplexer connected to the router architecture; and a 1-2 demultiplexer connected to the router architecture.

[0011] Optionally, the logic control unit is configured to temporarily eject the data packet from the current direction port to the local data port when the data packet is transmitted in a certain direction to the inflection point router that needs to be turned; then, the data packet is re-injected from the local data port to the output port of the target direction to complete the turning operation and continue to transmit in the target direction.

[0012] Optionally, the router device further includes: at least one logical processing unit for executing routing algorithms; and at least one storage unit for storing routing tables and data packet information.

[0013] Optionally, the routing table contains routing information in the network; the data packet information includes the source address, destination address, and transmission status of the data packet to support effective management and forwarding of the data packet.

[0014] In some embodiments, a NoC system for a 2D mesh network structure includes:

[0015] The router device includes four directional ports (east, south, west, and north) and one local data port. The non-direct data links between the east, south, west, and north ports are removed, and only the direct data links and the connection to the local port are retained.

[0016] Multiple router devices are connected to each other;

[0017] When a data packet reaches a turning point, the system temporarily pops the data packet to the local data port, and the local data port immediately injects it into the routing direction of the target direction.

[0018] The router device and NoC system for 2D mesh network structures provided in this disclosure can achieve the following technical effects:

[0019] This disclosure reduces power consumption and footprint by removing underutilized data links and employing a pop-up re-injection mechanism. Although it may introduce some performance loss, the impact on the overall performance of the NoC system is small because the number of hops is a small proportion of the total number of hops, and it significantly improves energy efficiency.

[0020] The above general description and the description below are exemplary and illustrative only and are not intended to limit this application. Attached Figure Description

[0021] One or more embodiments are illustrated by way of example with reference to the accompanying drawings. These illustrations and drawings do not constitute a limitation on the embodiments. Elements having the same reference numerals in the drawings are shown as similar elements. The drawings are not to be scaled. And wherein:

[0022] Figure 1a : Schematic diagram of traditional NoC router architecture;

[0023] Figure 1b : Schematic diagram of the optimized NoC router architecture of this invention;

[0024] Figure 2 : A schematic diagram of the data packet redirection method in the 2D mesh network of this invention. Detailed Implementation

[0025] To provide a more detailed understanding of the features and technical content of the embodiments of this disclosure, the implementation of the embodiments of this disclosure will be described in detail below with reference to the accompanying drawings. The accompanying drawings are for illustrative purposes only and are not intended to limit the embodiments of this disclosure. In the following technical description, for ease of explanation, several details are used to provide a full understanding of the disclosed embodiments. However, one or more embodiments may still be implemented without these details. In other cases, well-known structures and devices may be simplified in their depiction to simplify the drawings.

[0026] The terms "first," "second," etc., used in the embodiments of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate for the embodiments of this disclosure described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion.

[0027] Unless otherwise stated, the term "multiple" means two or more.

[0028] In this embodiment of the disclosure, the character " / " indicates that the objects before and after it are in an "or" relationship. For example, A / B means: A or B.

[0029] The term "and / or" describes an association between objects, indicating that three relationships can exist. For example, A and / or B means: A or B, or A and B.

[0030] The term "correspondence" can refer to an association or binding relationship. The correspondence between A and B means that there is an association or binding relationship between A and B.

[0031] This invention proposes a low-power NoC network based on re-injection, which aims to effectively reduce the power consumption of NoC routers by removing underutilized redirection data links in routers and introducing an innovative pop-up and re-injection mechanism.

[0032] Redesigning the router architecture: This invention modifies the architecture of existing NoC routers, removing the complex crossbar switch section that supports packet redirection, and retaining only the necessary straight-through data links and local data port connections. For example... Figure 1b As shown, this design significantly reduces the complexity and power consumption of the router.

[0033] Introducing a pop-up and re-injection mechanism: When data packets need to be redirected in a NoC network, this invention employs an innovative routing strategy. Just before a data packet reaches the end of its current dimension, it is "popped" from the current path via a special mechanism and "re-injected" into the network at the start of the next dimension. This process is implemented by specially designed control logic, ensuring that data packets can seamlessly switch from one dimension to another while avoiding the power consumption overhead of traditional redirection mechanisms.

[0034] Understandably, in a 2D mesh network structure, when XY or YX routing algorithms guide data packets from source to destination, to avoid deadlock, the packets undergo at most one turn during the entire routing process. This is because XY and YX routing algorithms use a method of routing data packets along a determined direction first and then along another direction. Therefore, for the entire NoC network, especially in large-scale modern multi-core systems, the number of turning hops is much smaller than the total number of hops (turning hops + straight hops).

[0035] In a router, data transmission from one output channel to another is achieved through an internal crossbar switch. Because the proportion of hops at bends is very small, this makes the data path components designed for bends in the router (…) Figure 1a The utilization rate of the area (the part marked by the dashed line) is very low, which leads to unnecessary consumption and waste of power and area resources.

[0036] Each router has five ports: four directional ports (north, south, east, and west) and a local data port. In a traditional crossbar switch, each input should have a data path to every output port except the input direction. For a 2D mesh NoC architecture, data links between north and south and east and west are considered straight lines, while connections to other ports are considered detours, and all connections to the local port are essential.

[0037] This disclosure addresses these underutilized data links, such as... Figure 1bAs shown, this significantly improves the router's energy efficiency and reduces its footprint. By removing redirection paths, all external port multiplexers and demultiplexers are changed from 4-1 and 1-4 to 2-1 and 1-2, while local ports remain unchanged. Therefore, the overall footprint is reduced.

[0038] However, the optimized structure can only handle packets with straight-line routing, and the routing algorithm needs to be improved for packets that need to be redirected.

[0039] In the improved routing scheme, when a data packet reaches a turning point that requires a turn, the system temporarily pops the data packet to the local port, and the local port immediately injects it into the subsequent routing direction.

[0040] To help better understand the improved routing algorithm, Figure 2 It explains how the improved scheme achieves packet redirection in 2D mesh networks.

[0041] As shown in the diagram, the data packet (in bold) enters the network from the southern input port of the lower left router and needs to leave the network from the eastern port of the upper right router. Therefore, the data packet needs to complete a redirection operation on the upper left router. When the data packet reaches the redirection router, the algorithm forces the data packet to be temporarily ejected to its local port and re-injected into the eastern output port, thus completing the redirection operation.

[0042] Although popping and re-injecting will cause some performance loss, as mentioned earlier, the number of hops for turning is very small compared to the total number of hops. Therefore, for the entire system, this solution still greatly optimizes its power consumption and area.

[0043] The beneficial effects of this disclosure are as follows:

[0044] Adaptable to various routing algorithms: The low-power NoC design of this invention is inherently deadlock-free and can adapt to various deterministic, partially adaptive, and fully adaptive routing algorithms. Through flexible configuration of the control logic, packet transmission under different routing strategies can be easily implemented.

[0045] Optimized resource utilization: By eliminating unnecessary data routing links, the NoC router of this invention is more efficient in resource utilization. This not only reduces power consumption but also saves valuable chip area, providing more space for the integration of other key components.

[0046] Significantly reduced power consumption: By removing underutilized redirection data links and introducing pop-up and re-injection mechanisms, the NoC design of this invention significantly reduces the power consumption of the router, thereby reducing the total power consumption of the entire NoC system.

[0047] Improved resource utilization: The optimized router architecture is more efficient in resource utilization, reduces unnecessary area waste, and improves the overall performance of multi-core systems.

[0048] Flexibility and scalability: The low-power NoC design of this invention can adapt to a variety of routing algorithms, has high flexibility and scalability, and can meet the needs of different application scenarios.

[0049] In summary, this invention successfully reduces NoC router power consumption by redesigning the NoC router architecture and introducing pop-up and re-injection mechanisms. This design not only improves resource utilization but also enhances system flexibility and scalability, providing strong support for performance improvements in multi-core systems.

[0050] The foregoing description and accompanying drawings fully illustrate embodiments of this disclosure to enable those skilled in the art to practice them. Other embodiments may include structural, logical, electrical, procedural, and other changes. The embodiments represent only possible variations. Individual components and functions are optional unless explicitly required, and the order of operation may vary. Parts and features of some embodiments may be included in or replace parts and features of other embodiments. Moreover, the terminology used in this application is for descriptive purposes only and is not intended to limit the scope of protection. As used in the description herein, the singular forms “a,” “an,” and “the” are intended to equally include the plural forms unless the context clearly indicates otherwise. Similarly, the term “and / or” as used herein means including one or more of the associated listed items and all possible combinations thereof. Additionally, when used in this application, the term "comprise" and its variations "comprises" and / or "comprising" refer to the presence of stated features, integrals, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components, and / or groups thereof. Without further limitations, an element defined by the phrase "comprises a..." does not exclude the presence of other identical elements in the process, method, or apparatus that includes said element. In this document, each embodiment may focus on the differences from other embodiments, and similar or identical parts between embodiments can be referred to mutually. For methods, products, etc., disclosed in the embodiments, if they correspond to the method section disclosed in the embodiments, the relevant parts can be referred to the description of the method section.

[0051] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of this disclosure. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0052] The methods and products (including but not limited to devices and equipment) disclosed in the embodiments herein can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For instance, the division of units may be merely a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. In addition, the coupling or direct coupling or communication connection shown or discussed between each other may be through some interfaces, and the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to implement this embodiment according to actual needs. In addition, the functional units in the embodiments of this disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0053] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than that shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. In the descriptions corresponding to the flowcharts and block diagrams in the accompanying drawings, the operations or steps corresponding to different blocks may also occur in a different order than disclosed in the description, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. Each block in a block diagram and / or flowchart, and combinations of blocks in a block diagram and / or flowchart, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

Claims

1. A router device, characterized in that, NoC systems applied to 2D mesh network structures include: Five ports, including four directional ports (east, south, west, and north) and one local data port. The non-straight data links between the east, south, west, and north ports have been removed, leaving only the straight data links and the connection to the local port. The logic control unit is used to perform the operation of popping the data packet to the local data port and re-injecting it into the target direction port when the data packet needs to be redirected; The logic control unit is configured to temporarily pop the data packet from the current direction port to the local data port when the data packet is transmitted in a certain direction to the inflection point router that needs to be turned. Then, the data packet is re-injected from the local data port to the output port in the target direction to complete the redirection operation and continue transmission in the target direction.

2. The router device according to claim 1, characterized in that, Also includes: 2-1 Multiplexer, connected to the router architecture; 1-2 multi-way demultiplexers are connected to the router architecture.

3. The router device according to claim 1 or 2, characterized in that, Also includes: At least one logical processing unit is used to execute the routing algorithm; At least one storage unit is provided for storing routing tables and packet information.

4. The router device according to claim 3, characterized in that, The routing table contains routing information in the network; The data packet information includes the source address, destination address, and transmission status of the data packet, in order to support the effective management and forwarding of the data packet.

5. A NoC system for 2D mesh network structures, characterized in that, include: The router device includes four directional ports (east, south, west, and north) and one local data port. The non-direct data links between the east, south, west, and north ports are removed, and only the direct data links and the connection to the local port are retained. Multiple router devices are connected to each other; When a data packet reaches a turning point, the system temporarily pops the data packet to the local data port, and the local data port immediately injects it into the routing direction of the target direction.

Citation Information

Patent Citations

  • Static XY routing algorithm-oriented two-dimensional grid NoC router optimization design method

    CN101808032A

  • NoC router for high-speed data acquisition

    CN113079100A