Broadcast switch system in network-on-chip (NoC)

By introducing a broadcast switch system into an on-chip network, combining broadcast adapter and switch functions, the inefficiency problem of the master device sending transactions to multiple slave devices is solved, and efficient multicast transaction processing is achieved, reducing processing delay and design complexity is achieved. sex.

CN119071258APending Publication Date: 2024-12-03ATRIS CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411470382.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2020-12-30
Filing Date
2021-12-09
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

In an on-chip network, when the master device sends the same transaction to multiple slave devices, the prior art is limited by the rate of sequential requests, resulting in inefficiency, and broadcasting methods require multiple decoding, routing and encoding, increasing processing load and design Complexity.

Method used

The broadcast switch system is introduced, combining broadcast adapter and switch functions, through routing tables and port table searches, the broadcast and exchange of transactions are realized, multiple transaction overhead caused by physical boundaries are eliminated, links and building blocks are reduced, and exit port capacity is improved.

Benefits of technology

Improve transaction efficiency and speed, reduce processing delay and design size, achieve more efficient multicast transaction processing, and reduce NoC design complexity and resource requirements.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119071258A_ABST
    Figure CN119071258A_ABST
Patent Text Reader

Abstract

A system and method of use for a broadcast switch system, a broadcast management switch system, and a method of use in a network-on-chip are presented. The present invention generally relates to broadcasting transactions in a network-on-chip (NoC). More specifically, but not limited, the present invention provides transactional processing from a master device to a plurality of slave devices and receiving responses. The invention relates to a broadcast switch for broadcast transactions. More specifically, but not limited to, the present invention relates to a broadcast switch system, a broadcast management switching system, and a method of use in NoC.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Description of the case

[0002] This application is a divisional application of the Chinese invention patent application with application number 202111498672.6 filed on December 9, 2021 and named “Broadcast Switch System in Network on Chip (NoC)”. Technical Field

[0003] The present invention generally relates to broadcasting transactions in a network on a chip (NOC), and more particularly, to a broadcast switch for broadcasting transactions in a broadcast management switching system. Background Art

[0004] System creation, design, and development of computer processors include multi-processor systems. Multi-processor systems have been implemented in system-on-chip (SoC) that communicate and interact with a network-on-chip (NoC). The SoC generally includes instances of master (initiator) intellectual property (IP) and slave (target) IP. In some cases, one master sends transactions or requests to multiple slaves. Transactions are sent using industry standard protocols such as ARM, AMBA, AXI, AHB, or APB or OCP-IP. These protocols have strict request / response semantics and are typically treated as unicast by the NoC; a master connected to the NoC uses an address to select a slave and sends a request to the slave. The NoC decodes the address and transmits the request from the master to the slave. The slave processes the transaction and sends a response, which is transmitted back to the master by the NoC.

[0005] When the master device needs to send the same transaction and / or request to multiple slave devices, the modern and known applications utilized enable the master device to send all requests in sequence. The master device sends the transaction to the first slave device, then to the second slave device, then to the third slave device, and so on. For example, if the master device wants to write the same data to 16 different slave devices, the master device sends 16 identical write transactions in sequence, one of which is sent to each slave device. Therefore, the time spent in the total operation, that is, the time spent writing one transaction multiplied by 16, is 16 times the amount of writing a single transaction. This limits the rate at which the same request is sent to multiple slave devices. In other words, the rate is limited by the rate at which the master device sends sequential requests to all destinations (i.e., each slave device). Therefore, a system and method of use that saves time and potentially can save lines and processing, etc., is needed.

[0006] In addition, in addition to this number of transactions that occur in the above situation, the broadcast method or the method of sending transactions from the master device to the slave device also requires a switch. When sending master / slave transactions in a network or NoC, the switch acts as a gatekeeper to determine which transactions are sent through which ports. In this way, as is commonly used, the inlet port and the outlet port are connected to the switch so that the packets entering the switch must be decoded, routed and encoded before leaving the switch. In this way, in a modern and known manner, the application utilizes the master device, and all transactions sent to the slave device must be written individually and individually processed by the switch. Based on the write processing and switch availability and processing, this requires a lot of processing and limits the ability and rate at which the master device can send sequential requests to all destinations. Therefore, there is a need in the art for a system and method of use that saves time, transaction processing capabilities and improves transaction processing efficiency, etc. Summary of the invention

[0007] The present invention generally relates to broadcasting transactions in a network on chip (NoC). More specifically, but not limited to, the present invention relates to a broadcast switch for broadcasting transactions. More specifically, but not limited to, the present invention relates to a broadcast switch system, a broadcast management switching system, and a method of use in a NoC.

[0008] The present invention provides a new system and method for broadcasting transactions in a NoC. More specifically, the present invention provides a broadcast switch technology. In other words, the present invention provides a new building block for a NoC in the art.

[0009] In the illustrated arrangement and in the present invention, a broadcast switch is presented that acts as a broadcast adapter that also performs the routing functions of the switch. In the present invention, these routing functions are performed simultaneously with the transaction broadcast processing, resulting in a more efficient means of broadcasting transactions and / or sending transactions, particularly with respect to the master / slave relationships that exist in the transactions.

[0010] In other words, the present invention provides a broadcast adapter that also has a switching function to the art. In other words, the mechanism provided can perform transaction broadcast while also performing switching functions. The broadcast switch disclosed herein combines the functions of the broadcast adapter and the switch into a single unit that performs transaction broadcast and switching simultaneously. This eliminates many transactions that occur in modern processes, especially those related to crossing the physical boundaries of the adapter and the switch.

[0011] In other words, the systems and methods presented herein simplify the on-chip network because there are fewer links, fewer instances, and less building block wiring, among other advantages. In the arrangement shown herein, as an example, a broadcast switch reduces the number of links required in a broadcast adapter having a switch. In addition, the broadcast switch implements routing table lookups and port table lookups, so the broadcast switch can broadcast transactions to multiple destinations via the same egress port. For this reason and others, this new building block and its corresponding functionality greatly increases the capacity of the egress port, while fewer egress ports are required for assembly of the entire system.

[0012] According to aspects of the present invention, the system implementing the present invention is usually designed by describing their functions in a hardware description language. Therefore, the present invention is also implemented in such hardware description and the method of describing the system as such hardware description, but the scope of the present invention is not limited thereto. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] For a more complete understanding of the present invention, please refer to the accompanying drawings or diagrams. The present invention is described according to various aspects and embodiments in the following description with reference to the accompanying drawings or diagrams (FIG.), in which the same numbers represent the same or similar elements. It is understood that these drawings are not to be considered as limiting the scope of the present invention, and the presently described aspects of the present invention and the best mode currently understood are described in more detail by using the accompanying drawings.

[0014] Figure 1 A process of broadcasting a request from a master device to multiple slave devices using a broadcast switch according to various aspects and embodiments of the present invention is shown.

[0015] Figure 2 A process of broadcasting a request from a master device to multiple slave devices using a broadcast switch according to various aspects and embodiments of the present invention is shown.

[0016] Figure 3 A process of broadcasting a request from a master device to multiple slave devices using a broadcast switch according to various aspects and embodiments of the present invention is shown.

[0017] Figure 4 A network on chip having a master device and multiple slave devices according to aspects and embodiments of the present invention is shown.

[0018] Figure 5 A NoC having a master device and multiple slave devices according to aspects and embodiments of the present invention is shown.

[0019] Figure 6 A NoC having a master device and multiple slave devices is shown, which also shows the integration of multiple writers according to aspects and embodiments of the present invention.

[0020] Figure 7 An embodiment of a broadcast switch according to aspects and embodiments of the present invention is shown, showing an ingress and at least one egress.

[0021] Figure 8 An embodiment of multiple broadcast switches according to aspects and embodiments of the present invention is shown, which is arranged so that stringing multiple broadcast switches together can enhance functionality.

[0022] Fig. 9 An embodiment of multiple broadcast switches is shown, which is arranged so that stringing multiple broadcast switches together can enhance the functionality of the embodiment of the invention as shown.

[0023] Fig.10 An embodiment of a broadcast switch according to aspects and embodiments of the present invention is shown, showing an ingress and at least one egress.

[0024] Fig.11 An embodiment of a broadcast switch according to aspects and embodiments of the present invention is shown, showing an ingress and at least one egress.

[0025] Fig.12 An embodiment of a system according to aspects and embodiments of the present invention is shown, which shows a broadcast switch with integrated switching functionality.

[0026] Fig.13 An embodiment of a system according to aspects and embodiments of the present invention is shown, which includes a broadcast switch having at least one buffer integrated into the broadcast switch.

[0027] Fig.14 Systems according to aspects and embodiments of the present invention are shown, along with embodiments of broadcast switch channel ranges and specific channels for various broadcast switch addresses and target addresses. DETAILED DESCRIPTION

[0028] In the following detailed description, reference is made to the accompanying drawings which form a part hereof and in which are shown by way of illustration specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable one skilled in the art to practice the invention, and it is understood that other embodiments may be utilized and mechanical, procedural and other changes may be made without departing from the spirit and scope of the invention(s). Therefore, the following detailed description is not to be taken in a limiting sense, and the scope of the invention(s) is defined solely by the appended claims and the full range of equivalents to which such claims are entitled.

[0029] As used herein, terms such as vertical, horizontal, top, bottom, front, back, end, side, etc. are referenced according to the views, parts, and illustrations presented. However, it should be understood that these terms are used for descriptive purposes only and are not intended to be limiting. Therefore, the orientation of an object or combination of objects may be changed without departing from the scope of the present invention.

[0030] Throughout this specification, reference to "one embodiment," "an embodiment," "an example," or "an example" means that a particular feature, structure, or characteristic described in conjunction with the embodiment or example is included in at least one embodiment of the present invention. Therefore, the phrases "in one embodiment," "in an embodiment," "an example," or "an example" that appear in various places throughout this specification do not necessarily all refer to the same embodiment or example. In addition, in one or more embodiments or examples, the particular features, structures, databases, or characteristics may be combined in any suitable combination and / or sub-combination. In addition, it should be understood that the illustrations provided herein are for explanation purposes to those of ordinary skill in the art, and that the drawings are not necessarily drawn to scale.

[0031] Embodiments according to the present invention may be implemented as devices, methods or computer program products. Therefore, the present invention may take the form of an embodiment consisting entirely of hardware, an embodiment consisting entirely of software (including firmware, resident software, microcode, etc.), or a combination of software and hardware aspects collectively referred to herein as "circuit", "module" or "system". In addition, embodiments of the present invention may take the form of a computer program product implemented in any tangible medium.

[0032] Any combination of one or more computer-usable or computer-readable media may be utilized. For example, computer-readable media may include one or more of the following: a portable computer disk, a hard disk, a random access memory (RAM) device, a read-only memory (ROM) device, an erasable programmable read-only memory (EPROM or flash memory) device, a portable compact disk read-only memory (CDROM), an optical storage device, and a magnetic storage device. The computer program code for performing the operations of the present invention may be written in any combination of one or more programming languages. Code in this manner may be compiled from source code into a computer-readable assembly language or machine code suitable for the device or computer on which the code will be executed.

[0033] Embodiments may also be implemented in a cloud computing environment. In this specification and the appended claims, "cloud computing" may be defined as a model for enabling ubiquitous, convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be quickly provisioned via virtualization and released with minimal management effort or service provider interaction, and then scaled accordingly. Cloud models may consist of various features (e.g., on-demand self-service, broad network access, resource pooling, rapid elasticity, and measured services), service models (e.g., software as a service (SaaS), platform as a service (PaaS), and infrastructure as a service (IaaS)), and deployment models (e.g., private cloud, community cloud, public cloud, and hybrid cloud).

[0034] As used herein, "source", "master device" and "initiator" refer to similar intellectual property (IP) blocks, modules or units; these terms are used interchangeably within the scope and embodiments of the present invention. As used herein, "sink", "slave device" and "target" refer to similar IP modules or units, and these terms are used interchangeably within the scope and embodiments of the present invention. As used herein, a transaction can be a request transaction or a response transaction. Examples of request transactions include write requests and read requests.

[0035] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architectures, functions and operations of the systems, methods and computer program products according to various embodiments of the present invention. In this regard, each box in the flowchart or block diagram may represent a module, segment or portion of a code, which includes one or more executable instructions for implementing (multiple) specified logical functions. It should also be noted that each box of the block diagram and / or flowchart and the combination of boxes in the block diagram and / or flowchart can be implemented by a dedicated hardware-based system that performs a specified function or action, or a combination of dedicated hardware and computer instructions. These computer program instructions can also be stored in a computer-readable medium, which can instruct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable medium produce an article of instruction components including an implementation of the function / action specified in one or more boxes of the flowchart and / or block diagram.

[0036] All illustrations of the drawings are for the purpose of describing selected versions of the invention and are not intended to limit the scope of the invention.

[0037] The following description refers to Figures 1 to 14 The present invention relates to broadcasting transactions in a network on chip (NoC). More specifically, but not limited to, the present invention relates to a broadcast switch for broadcasting transactions. More specifically, but not limited to, the present invention relates to a broadcast switch system in a NoC, a broadcast management switching system, and a method of use.

[0038] According to some aspects and embodiments of the present invention, a component for a NoC is disclosed, which is a switch or broadcast switch 20 with broadcast capabilities. The broadcast switch 20 implements a new method to send transactions from a master device to multiple slave devices and / or from multiple master devices to multiple slave devices. According to various embodiments and aspects of the present invention described herein, a specific address range can be used. The NoC broadcasts transactions received at one or more specific addresses within a specific address range. The broadcasted transactions can reach multiple destinations and / or slave devices at the same time, rather than sending the broadcasted transactions to a single destination, while also providing switching functions, etc.

[0039] Among the many advantages disclosed herein is the operational efficiency gained by building the broadcast adapter functionality and the switching functionality into a single, more efficient transaction processor. Among the many advantages disclosed herein, another advantage is the efficiency of the overall operation of the broadcast network and transaction processing, which includes sending the same transaction to multiple destinations. Among the many advantages disclosed herein, another advantage includes the ability to perform functions on transactions before broadcasting the transaction. Among the many advantages disclosed herein, another advantage is the efficiency of the ability to perform switching functions on transactions before broadcasting the transaction.

[0040] According to various aspects and embodiments of the present invention, the system provides a new component that can be used in NoC, in particular a new building block in the broadcast transaction function. According to various aspects and embodiments of the present invention, the broadcast switch disclosed herein is a broadcast adapter, and performs the routing function of the switch when performing transaction broadcast. According to various aspects and embodiments of the present invention, the broadcast switch combines the functions of the broadcast adapter and the switch into one building block. The broadcast switch performs both the transaction broadcast function and the switching function. In this way, this is the first building block component provided for NoC that performs these functions simultaneously.

[0041] In addition, the broadcast switch disclosed herein eliminates multiple transaction overheads caused when crossing physical boundaries of adapters and switches. These physical boundaries can include wiring, processing, and increased NoC design size. In this way, the present invention eliminates some wiring, reduces processing delays, and reduces the size of the NoC design. These features and other features are achieved by using and implementing the new building blocks disclosed herein.

[0042] According to various aspects and embodiments of the present invention, eliminating many transaction overheads that occur due to the use of broadcast switches simplifies the NoC because fewer links and fewer building blocks are required to instantiate and wire. The broadcast switch disclosed herein reduces the number of links required when designing using a broadcast adapter with a switch by up to or at least by half. According to some aspects and embodiments of the present invention, the broadcast switch can retrieve or look up routing information and port information (for an intended target or slave device) from a lookup table based on a routing field of an incoming transaction. According to some aspects and embodiments of the present invention, the broadcast switch includes a routing calculation module that uses the routing field of an incoming transaction to determine the routing information of the transaction. Therefore, the broadcast switch implements a routing table lookup. The broadcast switch can broadcast the transaction to multiple destinations via various routes selected from the routing table by modifying the routing field of the incoming transaction using the updated routing information. According to some aspects and embodiments of the present invention, the incoming transaction is updated, modified, or changed by a modification module of the broadcast switch.

[0043] In addition, because the broadcast switch implements an egress table lookup, the broadcast switch can broadcast transactions to multiple destinations via the same egress port. This feature, as well as other features and advantages, can be useful and provide enhanced efficiency when the number of egress ports is less than the number of destinations, and in many other situations, as disclosed herein and intended for use.

[0044] According to some aspects and embodiments of the present invention, a broadcast switch is a multicast switch that uses one egress port to send transactions to multiple targets on the request side. As used herein, the term "transaction" includes and may be used interchangeably with: "incoming transaction", "arriving transaction", "leaving transaction", "outgoing transaction", "data", "data packet", and "packet".

[0045] According to aspects and embodiments of the present invention, the broadcast switch also includes a buffer sufficient to accommodate the entire packet because the broadcast switch sends out (broadcast) transactions or packets serially, especially when the broadcast switch has fewer egress ports than the number of destinations it is broadcasting to. For example, when the broadcast switch broadcasts to two or more destinations using one egress port. The advantage of this approach is that it allows the source (initiator) to send one request to the broadcast switch without having to create separate requests for each.

[0046] Although the present invention can be explained in conjunction with examples of embodiments, it should be understood that many other possible modifications and variations can be made without departing from the spirit and scope of the present invention.

[0047] According to various aspects and embodiments of the present invention, a broadcast management system 10 (hereinafter referred to as "broadcast management system", "broadcast-capable switching system" or "broadcast system" or simply "system") is shown. The broadcast management system 10 is formed of any suitable size, shape and design, and the scope of the present invention is not limited in this regard. In the illustrated arrangement, as an example, the system 10 is part of a NoC shown in accordance with an embodiment of the present invention, and may also include remote servers, databases, application servers, application databases, application programming interfaces, user databases, event databases, transmission rule databases, rule databases, data transmission components and / or features, mobile applications and / or computers, cellular transmissions, data packets, etc., which implement the functions disclosed herein.

[0048] Previous NoC technologies required multiple broadcast adapters and multiple switches at best. In these arrangements, the connection from end to end (in this case, master to slave) must pass through the switch. The switch calculates the route and modifies the routing field in the packet, and knows which port the packet is going through. Therefore, the ingress and egress ports of the broadcast adapter must be connected to the switch. Therefore, the packet passing through the system from end to end (or from master to slave / target) must be decoded, routed, and encoded at each switch level in the system. Therefore, at least two decoding, routing, and encoding must be performed before the packet reaches its destination.

[0049] According to various aspects and embodiments, the present invention provides these functions, systems and solutions in the following general manner. Figure 4 , broadcast switch (0) 20 uses a network interface unit (NIU) 14 to connect other broadcast switches (1 and 2) 20 to the host device 12. There is also a NIU 14 between the broadcast switch (1) 20 and the target 22. The broadcast switch can perform all the functions of the adapter and various switches. In addition, the target 22 communicates with the broadcast switch 20 (as shown) and other source devices (from which transactions can be received) through other network elements (not shown for clarity). Therefore, there is a route connecting the target to the broadcast switch for receiving multicast transactions, and there is a route (not shown) connected to the target for receiving normal transactions.

[0050] The master device 12 sends a transaction to a broadcast switch, such as broadcast switch 20. The transaction includes information that tells the broadcast switch whether the transaction is a multicast transaction or a normal transaction (i.e., only for one target or destination). According to some aspects and embodiments of the present invention, the broadcast switch acts as a normal switch based on information in the incoming packet (transaction) that identifies the incoming packet as a normal transaction. According to some embodiments of the present invention, the broadcast switch is directly connected to any IP block. In this way, the broadcast switch can calculate the route and modify the routing field in the packet and / or data packet. In addition, the broadcast switch is able to determine the route to the destination. Therefore, the broadcast switch includes the ability to mask any one or more targets to which the broadcast switch can broadcast based on the information contained in the transaction (incoming request).

[0051] According to some aspects and embodiments of the present invention, a broadcast switch having more than one egress port may select any one of the one or more egress ports from all egress ports to receive a broadcast of packets and / or data packets. According to some aspects and embodiments of the present invention, a broadcast switch having one egress port may select any one of the one or more destinations (targets) to receive a broadcast of packets and / or data packets from all possible targets to which it may broadcast using the egress port. Shielding is based on information provided by a request (broadcast packet) received at the broadcast switch. The request includes information about shielding. The broadcast switch uses this information to shield (prevent broadcasting to) specific (multiple) targets from a fixed set of targets associated with the broadcast tree of the broadcast switch.

[0052] In the illustrated arrangement, the system 10 provides these advantages and more in the following manner. When a packet and / or data packet is broadcast from the master device 12, the broadcast switch uses the destination identifier in the request packet to look up the destination path routing table to retrieve the route to the destination from the broadcast switch. In this way, the route for the packet is placed in the request packet to the destination (also known as a parallel lookup function, which can run independently of the transmission order).

[0053] After looking up the target path routing table, or simultaneously and in parallel, the broadcast switch 20 uses the target identifier to determine and / or look up the target path port table. This is also done in the request packet to retrieve the egress port number of the broadcast switch 20. In this way, the request packet destined for the target is sent to the egress port indicated in the target identifier of the target path port table. One advantage is that this feature allows request packets destined for multiple targets to be sent via the same egress port.

[0054] As another arrangement disclosed herein, a target path routing table and a target path port table can be set so that a broadcast switch can broadcast packets and / or transactions to multiple destinations via the same egress port. This novel feature and novel capability is advantageous for a number of reasons. One reason this novel feature is advantageous is that in some cases, the number of egress ports of a broadcast switch is less than the number of destinations. In this way, due to the organizational characteristics of the broadcast switch, the utilization and efficiency of the egress ports are greatly improved.

[0055] After looking up the target path routing table and the target path port table, or simultaneously and in parallel, the broadcast switch uses the source identifier in the response packet to determine and / or look up the source path routing table. The broadcast switch uses the source path routing table and the source identifier to determine the route from the broadcast switch to the source. In this way, the route is placed in the response packet to the source.

[0056] Once the broadcast switch determines the target path routing table, the target path port table, and the source path routing table, the broadcast switch performs the routing function of the switch for the request path and the response path.

[0057] In the illustrated arrangement, as an example, the system 10 performs the functions described in the method of this article in a novel manner, as well as various components, functions and features to perform these functions. Some of these components (as further described herein) may include a master device 12, a NIU 14, a queue, a transaction, a writer 18, a broadcast switch 20, a slave device 22 (or "target"), an inlet port 26, an outlet port 28, a switch with broadcast capability ("BCS") address range 30, a BCS address 32, a slave device address range 34 (or "target address range"), a slave device address 36 (or "target address"), a buffer 40, a target path routing table, a target path port table, a source path routing table and other various features, components and functions. In addition, according to various embodiments of the present invention, the system 10 includes various pipeline elements, some of which are shown in the arrangement of this article, and some of which are not shown in the arrangement of this article.

[0058] According to various aspects and embodiments of the present invention, as an example, the system 10 includes a master device 12. The master device 12 (also referred to as an "initiator", "source" or "sender") is formed of any suitable size, shape and design, and is configured to create and / or send packets and / or data packets and / or send data transmissions. In the illustrated arrangement, as an example, the initiator can be a computer, CPU or server, etc., which refers to an Internet protocol module or unit. As disclosed herein, the main purpose of the master device 12 is to create and / or send data packets and potentially provide other information related to the transmission being broadcast.

[0059] In the illustrated arrangement, as an example, the master device 12 communicates with the NIU 14 (discussed further herein). The NIU 14 is then connected to a plurality of slave devices (or "targets") 22 (discussed further herein). In this way, the master device 12 is able to send transactions to the plurality of slave devices 22.

[0060] Although a single master device is discussed herein as an example, many other embodiments are clearly conceivable including multiple master devices and multiple slave devices, even though for clarity; for ease of explanation, only one master device and several slave devices are shown in this example.

[0061] According to various aspects and embodiments of the present invention, one master device may send transactions or requests to multiple slave devices 22. In addition, the master device 12 may send requests to the slave device 22 using an address for selecting the slave device 22. In addition, the master device 12 may write the same data to multiple different slave devices 22.

[0062] According to various aspects and embodiments of the present invention, in the arrangement shown as an example, the system 10 includes a plurality of slave devices 22. The slave devices 22 (or "targets") are formed of any suitable size, shape, and design and are configured with a target address and / or target Internet protocol, which are arranged to receive transactions from a master device via the pipeline discussed herein (discussed further herein).

[0063] According to various aspects and embodiments of the present invention, multiple slave devices 22, each or individually, communicate with NIU 14 (discussed further herein). NIU 14 is then connected to multiple master devices 12. In this way, target 22 can receive transactions from one master device or multiple master devices 12.

[0064] Although a single target 22 is sometimes discussed herein, as an example, many other embodiments are obviously conceivable, such as two targets, three targets, four targets, any other number of targets and multiple master devices, even for the sake of clarity; for ease of explanation, only one master device and one target may be shown in this example. In other words, one master device can send transactions or requests to multiple slave devices 22. In addition, the master device 12 can use the address for selecting the slave device 22 to send a request to the slave device 22. In addition, the master device 12 can write the same data to multiple different slave devices 22. In the illustrated arrangement, as an example, the system 10 includes multiple transactions. A transaction is formed by any suitable size, shape and design, and is a term used to describe the data being broadcast by the master device 12 and / or the data being requested by the master device 12.

[0065] In the illustrated arrangement, as an example, one or more master devices 12 may send transactions and / or request transactions to or from multiple slave devices 22. In addition, the master device 12 may send a transaction request to the slave device 22 using an address for selecting the slave device 22. In addition, the master device 12 may write the same data to multiple different slave devices 22.

[0066] In the illustrated arrangement, as an example, the incoming and outgoing transactions may come from various addresses, sources with different priorities. In addition, in the illustrated arrangement, the incoming and outgoing transactions may come from AXI, ACE lite, CHI, and may carry a quality of service field and various other identifiers that may be used to determine requirements and / or targets.

[0067] According to various aspects and embodiments of the present invention, system 10 includes a network interface unit (NIU) 14 (or "network interface"). NIU 14 is formed of any suitable size, shape, and design, and is configured as an interconnection point between host device 12 (or simply a computer) and a private or public network. According to various aspects and embodiments of the present invention, the network interface can be a network interface card and need not have a physical form. In this way, the implemented software is also considered to be NIU 14 herein.

[0068] In addition, in the illustrated arrangement, the system 10 may further include a network interface unit 14 located on the side of the slave device and / or the target 22. In this way, multiple network interface units 14 may be connected to the slave device 22 and used to convert the protocol used inside the NoC into the protocol used by the target 22. In this way, the network interface unit 14 enables the master device 12 to communicate with multiple slave devices 22 through the system 10.

[0069] In other words, the network interface unit 14 converts incoming transactions formed by the master device 12 into the protocol used internally by the NoC for transmission. In the illustrated arrangement, as an example, the NIU 14 communicates with the master device 12, with the broadcast switch 20, and potentially with various other pipeline elements, according to various embodiments of the present invention, some of which are illustrated and some of which are not illustrated.

[0070] According to various aspects and embodiments of the present invention, system 10 includes a broadcast switch 20. The broadcast-capable switch 20 (also referred to as a "broadcast switch") is formed of any suitable size, shape, and design and is configured to receive transactions (and / or packets representing requests and / or request transactions). The broadcast switch 20 is configured to replicate the packets, sending a copy of the packet to each request egress port (discussed further herein). The broadcast switch 20 can process request data packets representing transactions arriving at an ingress port (discussed further herein). The broadcast switch replicates the packets as needed and according to the request type, and the copies are sent as packets through various egress ports.

[0071] According to various aspects and embodiments of the present invention, broadcast switch 20 may process packets arriving at an ingress port by duplicating, then receiving the communication through a network interface to slave device 22, and then sending additional communications through a second or third network interface similar to the second or third path.

[0072] In this way, the broadcast switch 20 handles the broadcast adapter function and the broadcast switch function within a single building block. These methods and other methods are contemplated for use. The examples discussed above are one of many processes and / or transactions that may be handled by the broadcast switch 20.

[0073] For another example, broadcast switch 20 may be directly connected to other network interfaces, other broadcast adapters, and / or other switches because the broadcast switch calculates the route and modifies the route field in the packet and can determine which port is the intended port for the relative transaction 22 .

[0074] In other words, the broadcast switch 20 can be connected to the network interfaces of the master device 12 and the slave device 22. The connection goes through the broadcast switch 20. This allows the broadcast switch 20 to calculate the route and modify the route field in the transaction, so it knows the port to which the transaction is going. In this way, the ingress and egress ports of the broadcast switch can be decoded, routed, and encoded within the broadcast switch.

[0075] Reference Figure 1 , Figure 2 and Figure 3 , according to various aspects and embodiments of the present invention, a process is shown in which the broadcast switch 20 performs the functions of both a broadcast adapter and a broadcast switch. The broadcast switch 20 uses the target identifier in the request packet to look up the target path routing table to retrieve the route (downstream path) to the target front end of the broadcast switch. This route is placed in the request packet to the target.

[0076] The broadcast switch 20 uses the target identifier in the request packet to look up the target path port table to retrieve the egress port number of the broadcast switch. The request packet outgoing from the target is sent to the egress port as indicated. In addition, this feature allows the request packet to go to multiple targets and be sent via the same egress port.

[0077] According to various aspects and embodiments of the present invention, in the arrangement shown as an example, the target path routing table and the target path port table are set so that the broadcast switch 20 can broadcast transactions to multiple destinations (or targets) via the same egress port. In the arrangement shown, as an example, this function is useful when the number of egress ports of the broadcast switch 20 is less than the number of targets 22.

[0078] The broadcast switch 20 then uses the source identifier in the response packet to look up the source path routing table to retrieve the route to the source from the broadcast switch 20. In this way, the route is placed as part of the response packet to the source. Using the target path routing table, the target path port table, and the source path routing table, the broadcast switch 20 performs the broadcast adapter function and simultaneously performs the routing functions of multiple switches for the request path and the response path.

[0079] According to various aspects and embodiments of the present invention, as an example, the broadcast switch 20 includes an ingress port 26 and an egress port 28. The ingress port 26 is formed of any suitable size, shape, and design, and is configured as a pipeline on the transaction request side. The egress port 28 is formed of any suitable size, shape, and design, and is generally configured as one or more ports through which the broadcast switch 20 will send transactions and / or replicate transactions.

[0080] In this way, and as discussed herein, the broadcast switch 20 replicates transactions received on an ingress port and sends the replicated transactions in the network using an egress port. Referring to the accompanying drawings, as an example, Fig.12 The broadcast switch 20 is shown as being configured with one ingress port 26 and three request egress ports 28. Similarly, in accordance with various aspects and embodiments of the present invention, the accompanying drawings also represent (not shown) three response ingress ports and one response egress port to handle responses from all targets connected to the request egress ports. In the illustrated arrangement, various embodiments are shown as an example, and various numbers of ingress ports and egress ports are conceivable for use. In addition, the broadcast switch 20 can use a combining function to perform response aggregation, and / or combine all responses corresponding to a replica and / or multiple replica request packets into a single response packet. The combined responses can be sent and / or requested through various ports.

[0081] According to various aspects and embodiments of the present invention, the system 10, and more specifically the broadcast switch 20, may include a buffer 40. The buffer 40 is formed of any suitable size, shape, and design, and is configured to allow independent processing of each egress port without having to implement a first-in, first-out for each egress port. In this way, the broadcast switch 20 is able to implement a complex broadcast network while avoiding deadlock, delay, or discard.

[0082] According to various aspects and embodiments of the present invention, the system 10 also includes pipelines, which may also be referred to as paths. The paths are formed of any suitable size, shape, and design and are configured as dynamically adaptable pipelines, the purpose of which is to provide on-chip transmission and networking. One or more paths may also be simply referred to as pipelines, in which arrangement, data and / or data packets are transmitted through the pipelines and interact with the system 10 of this article. In addition, the system 10 may include additional switches and / or broadcast adapters, etc.

[0083] As an example, the present invention presents a system and method for providing transmission broadcast for a single destination and a single broadcast, and for a single destination on multicast and multiple destinations on multicast, and further providing transmission broadcast by tree construction utilizing multiple broadcast switches.

[0084] according to Figures 1 to 14 In the various aspects and embodiments of the present invention shown, a first broadcast switch connects to other broadcast switches. In this way, the broadcast switch can perform all the functions previously required by the adapter and various switches. In this way, the broadcast switch can directly connect and calculate the route and modify the route field in the packet and / or data packet. In this way, the broadcast switch knows which port the packet and / or data packet is going to.

[0085] In the illustrated arrangement, the system 10 provides these advantages and more in the following manner. When a packet and / or data packet is broadcast from a master device, the broadcast switch uses the destination identifier in the request packet to look up the destination path routing table to retrieve a route from the broadcast switch to the destination. In this way, the route for the packet is placed into the request packet to the destination (also known as a parallel lookup function, which can run independently of the transmission order).

[0086] After looking up the target path routing table, or simultaneously and in parallel, the broadcast switch uses the target identification to determine and / or look up the target path port table. This is also done in the request packet to retrieve the egress port number of the broadcast switch. In this way, the request packet destined for the target is sent to the egress port as indicated in the target identification of the target path port table. As an advantage, this feature allows request packets destined for multiple targets to be sent via the same egress port.

[0087] As another arrangement disclosed herein, a target path routing table and a target path port table can be set so that a broadcast switch can broadcast packets and / or transactions to multiple destinations via the same egress port. This novel feature and novel capability is advantageous for a number of reasons. One reason this novel feature is advantageous is that in some cases, the number of egress ports of a broadcast switch is less than the number of destinations. In this way, the utilization and efficiency of the egress ports are greatly improved due to the organizational characteristics of the broadcast switch.

[0088] After looking up the target path routing table and the target path port table, or simultaneously and in parallel, the broadcast switch uses the source identifier in the response packet to determine and / or look up the source path routing table. The broadcast switch uses the source path routing table and the source identifier to determine the route from the broadcast switch to the source. In this way, the route is placed in the response packet to the source.

[0089] Once the broadcast switch determines the target path routing table, the target path port table, and the source path routing table, the broadcast switch performs the routing function of the switch for the request path and the response path.

[0090] These and other methods and processes for use are contemplated herein. For example, parallel processing can provide tremendous speedups. This is very important for applications such as deep neural network computations, which may require the same data set to be distributed to multiple nodes simultaneously. According to some aspects of the present invention, designers of neural network solutions can utilize the broadcast switch 20 to enable parallel or simultaneous completion of transactions. For example, various aspects and embodiments of the present invention can be implemented in the fields of artificial intelligence computing and deep network accelerators. When implemented in hardware and software, such a system can fully exploit the parallelism of broadcasting using a NoC including a broadcast switch 20 and run orders of magnitude faster.

[0091] Certain examples have been described herein, and it should be noted that different combinations of different components from different examples are possible. The significant features are presented to better explain the examples; however, it should be clear that certain features can be added, modified and / or omitted without modifying the functional aspects of the examples described.

[0092] Various examples are methods of using the behavior of any one or a combination of machines. No matter where in the world the most constituent steps occur, the method examples are complete. For example, and in accordance with various aspects and embodiments of the present invention, IP elements or units include: a processor (e.g., a CPU or GPU), a random access memory (RAM-e.g., off-chip dynamic RAM or DRAM), a network interface for wired or wireless connection, such as Ethernet, WiFi, 3G, 4G Long Term Evolution (LTE), 5G and other wireless interface standard radio equipment. IP can also include various I / O interface devices according to the needs of different peripheral devices, such as touch screen sensors, geolocation receivers, microphones, speakers, Bluetooth peripherals and USB devices, such as keyboards and mice. By executing instructions stored in RAM devices, the processor performs the method steps described herein.

[0093] Some examples are one or more non-transient computer-readable media arranged to store such instructions for the methods described herein. The examples can be implemented by any machine that stores the non-transient computer-readable media including any necessary code. Some examples can be implemented as: a physical device such as a semiconductor chip; a hardware description language representation of the logical or functional behavior of such a device; and one or more non-transient computer-readable media arranged to store such hardware description language representation. The description of the principles, aspects, and embodiments recorded herein includes their structural and functional equivalents. The elements described herein as coupled have an effective relationship that can be achieved by direct connection or indirect connection using one or more other intervening elements.

[0094] Those skilled in the art will appreciate that, without departing from the spirit and scope of the present invention (particularly various programmable features), other various modifications may be made to the device. All such modifications and changes fall within the scope of the claims and are intended to be covered by them. In addition, those skilled in the art will recognize many modifications and variations. Modifications and variations include any relevant combination of disclosed features. The description of the principles, aspects and embodiments described herein includes equivalent forms in structure and function. The elements described herein as "coupled" or "coupled in communication" have an effective relationship that can be realized by direct connection or indirect connection using one or more other intervening elements. The embodiments described herein as "communication" or "communication" with another device, module or element include any form of communication or link, and include an effective relationship. For example, a wired connection, wireless protocol, near field protocol or radio frequency identification (RFID) may be used to establish a communication link.

[0095] Therefore, the scope of the present invention is not intended to be limited to the exemplary embodiments shown and described herein. Rather, the scope and spirit of the present invention is embodied in the claims.

Claims

1. A method for broadcasting a transaction from a master device to multiple targets, comprising the following steps: defining a specific address range, wherein each address in the specific address range corresponds to a broadcast switch, the broadcast switch having at least one ingress port and a plurality of egress ports for communicating with the master device; receiving the transaction at an address within the particular address range; replicating the transaction at a broadcast switch located at the one address to generate a plurality of replicated transactions; sending each replicated transaction to one of the plurality of egress ports; as well as One of the replicated transactions is received at each of the plurality of targets, thereby allowing the master device to simultaneously send the transaction to each of the plurality of targets, wherein the transaction is transferred a single time to one address.

2. A method for broadcasting a transaction from an initiator to multiple targets, the method comprising the steps of: defining a specific address range, wherein each address in the specific address range corresponds to a broadcast switch, the broadcast switch having at least one ingress port that communicates with the initiator and a plurality of egress ports that communicate with a set of targets selected from the plurality of targets; receiving a transaction sent to a first address in the particular address range; replicating the transaction at the first broadcast switch to generate a plurality of replicated transactions; sending a replication transaction to one of a plurality of egress ports; as well as At each target in the set of targets selected from the plurality of targets, one replicated transaction is received, thereby allowing the initiator to send one transaction to the first broadcast switch and transmit the one transaction to the set of targets selected from the plurality of targets, thereby resulting in a single transmission from the initiator to the set of targets selected from the plurality of targets.

3. The method according to claim 2, further comprising: receiving a plurality of responses, one response at each response ingress port of a plurality of response ingress ports of the first broadcast switch, one response from each destination in the set of destinations selected from the plurality of destinations; combining, at the first broadcast switch, the plurality of responses into a first response; and The first response is sent to the initiator using a response egress port of the first broadcast switch.