Data transmission device, data transmission method, processor and electronic equipment
By using a ring link composed of multiple arbitrators in the on-chip network for data transmission, the congestion and delay problems caused by the cross-switch matrix are solved, and efficient and reliable data transmission is achieved to adapt to changes in different network environments.
Patent Information
- Application Number
- CN202411433311.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-15
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2044-10-15
AI Technical Summary
The cross switch matrix in the existing on-chip network is prone to congestion and delay problems during data transmission, resulting in reduced system performance.
Data transmission is carried out using a ring link composed of multiple arbitrators. Each arbitrator is responsible for data transmission decisions of the data sending unit and receiving unit connected to it, monitors the bandwidth margin and allocates data packets according to the traffic threshold to avoid data aggregation in the center. Node, reduce request and response time.
It effectively avoids congestion and delay problems caused by data centering, improves data transmission efficiency and reliability, and adapts to changes in different network environments.
Smart Images

Figure CN118964279A_ABST
Abstract
Description
Technical Field
[0001] Embodiments of the present disclosure relate to a data transmission device, a data transmission method, a processor, and an electronic device. Background Art
[0002] With the increasing number of computing cores, Network-on-Chip (NOC) has become an important research field and is widely used in various fields such as servers, smart phones, and the Internet of Things. Network-on-Chip is a network architecture used to achieve efficient data transmission in multi-core processors or large-scale integrated circuits. It replaces the traditional bus structure with a network structure similar to the Internet, connecting various computing cores and other components (such as caches, etc.) through routers and communication channels for data transmission. Summary of the invention
[0003] At least one embodiment of the present disclosure provides a data transmission device, comprising at least one first ring link, wherein the first ring link comprises a plurality of arbitrators connected in sequence, each of the plurality of arbitrators is connected to at least one data sending unit among a plurality of data sending units and / or at least one data receiving unit among a plurality of data receiving units, and the arbitrator is configured to: monitor whether there is a bandwidth margin on the first ring link, and in response to the existence of the bandwidth margin, allow the data sending unit connected to the arbitrator to send a first data packet to the first ring link and transmit it along the first ring link; and / or receive a second data packet from the first ring link and transmitted along a transmission direction, and determine whether to transmit the second data packet to the data receiving unit connected to the arbitrator.
[0004] In the data transmission device provided by at least one embodiment of the present disclosure, the arbitrator is further configured to determine whether to transmit the second data packet to a data receiving unit connected to the arbitrator according to a destination address of the second data packet.
[0005] In the data transmission device provided by at least one embodiment of the present disclosure, when the amount of data on a single first ring link is less than a preset traffic threshold, the single first ring link is configured to transmit all data packets.
[0006] In the data transmission device provided by at least one embodiment of the present disclosure, when the amount of data on a single first ring link is greater than a preset traffic threshold, the at least one first ring link includes multiple first ring links so that all data packets are distributed to the multiple first ring links.
[0007] In the data transmission device provided by at least one embodiment of the present disclosure, at least one arbitrator in the first ring link is connected only to one adjacent arbitrator, and the data transmission device further includes a second ring link, and the second ring link has a transmission direction opposite to that of the first ring link. The second ring link is configured to receive feedback information sent by a data sending unit connected to a downstream arbitrator in the first ring link, and transmit the feedback information to a data sending unit connected to an upstream arbitrator in the first ring link, so that the data sending unit connected to the upstream arbitrator adjusts the size of the data packet it needs to send and / or the destination data receiving unit according to the feedback information.
[0008] In the data transmission device provided by at least one embodiment of the present disclosure, the feedback information includes the amount of data that needs to be sent by the data sending unit connected to the downstream arbitrator.
[0009] In the data transmission device provided in at least one embodiment of the present disclosure, the data sending unit is a computing unit, and the data receiving unit is a cache unit.
[0010] In the data transmission device provided in at least one embodiment of the present disclosure, the data sending unit is a cache unit, and the data receiving unit is a calculation unit.
[0011] In the data transmission device provided in at least one embodiment of the present disclosure, the data transmission device is arranged in an on-chip network.
[0012] At least one embodiment of the present disclosure provides a processor, comprising: the data transmission device provided by at least one embodiment above; a plurality of computing units, serving as the plurality of data sending units or the plurality of data receiving units; and a plurality of cache units, serving as the plurality of data receiving units or the plurality of data sending units.
[0013] At least one embodiment of the present disclosure provides an electronic device, including: the processor provided by at least one embodiment above.
[0014] At least one embodiment of the present disclosure provides a data transmission method implemented by the data transmission device provided by at least one of the above-mentioned embodiments, including: each arbitrator monitors whether there is a bandwidth margin on the first ring link where it is located, and in response to the existence of the bandwidth margin, allows the data sending unit connected to the arbitrator to send the first data packet to the first ring link and transmit it along the first ring link; and each arbitrator receives the second data packet from the first ring link and transmitted along the transmission direction, and determines whether to transmit the second data packet to the data receiving unit connected to the arbitrator. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings of the embodiments will be briefly introduced below. Obviously, the drawings in the following description only relate to some embodiments of the present disclosure, but are not intended to limit the present disclosure.
[0016] Figure 1A is a schematic diagram of a crossbar switch matrix; Figure 1B A schematic diagram of realizing data transmission through a crossbar switch matrix; Figure 2 A schematic block diagram of a data transmission device provided by at least one embodiment of the present disclosure; Figure 3 A schematic diagram of a data transmission device implementing data transmission according to at least one embodiment of the present disclosure; Figure 4 A schematic diagram of a data transmission device implementing data transmission according to at least one embodiment of the present disclosure; Figure 5 A schematic diagram of a data transmission device implementing data transmission according to at least one embodiment of the present disclosure; Figure 6 A flowchart of a data transmission method provided by at least one embodiment of the present disclosure; Figure 7 A schematic block diagram of a processor provided for at least one embodiment of the present disclosure; Figure 8 A schematic block diagram of an electronic device provided for at least one embodiment of the present disclosure; Fig. 9 A schematic block diagram of another electronic device provided for at least one embodiment of the present disclosure. DETAILED DESCRIPTION
[0017] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution of the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings of the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the described embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.
[0018] Unless otherwise defined, the technical terms or scientific terms used in the present disclosure should be understood by people with ordinary skills in the field to which the present disclosure belongs. The "first", "second" and similar words used in the present disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components. "Include" or "comprise" and similar words mean that the elements or objects appearing before the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connect" or "connected" and similar words are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.
[0019] The present disclosure is described below through several specific embodiments. In order to keep the following description of the embodiments of the present disclosure clear and concise, detailed descriptions of known functions and known components (elements) may be omitted. When any component (component) of the embodiments of the present disclosure appears in more than one drawing, the component (component) is represented by the same or similar reference numeral in each drawing.
[0020] In high-performance computing systems, efficient data transmission is crucial. Crossbar is a commonly used interconnect technology that allows any input to be directly connected to any output, theoretically providing a network with fully connected inputs and outputs.
[0021] Figure 1A A schematic diagram of a crossbar switch matrix. Figure 1B A schematic diagram of data transmission via a crossbar switch matrix.
[0022] like Figure 1A As shown in Figure 1, M inputs (IN1~INM) and N outputs (OUT1~OUTN) are fully connected through a crossbar switch matrix. Figure 1B As shown, data sending unit 0~data sending unit 3 and data receiving unit 0~data receiving unit 3 are connected to the cross switch matrix. The data packets that the data sending unit needs to send will first be gathered to the cross switch matrix, and then the arbitration mechanism will decide how to allocate them to the data receiving units.
[0023] The inventors of the present disclosure have noticed that there are two main disadvantages to using a crossbar switch matrix for data transmission: 1. Congestion problem: Since all data paths converge on the crossbar switch matrix, the crossbar switch matrix becomes a bottleneck for data transmission. A large number of concurrent requests may cause data packets to queue up in the crossbar switch matrix waiting for transmission, thereby reducing the overall performance of the system.
[0024] 2. Delay problem: Since all data packets need to be aggregated to the crossbar switch matrix first, and then the arbitration mechanism is used to determine how to allocate them to the data receiving unit, this process adds additional delay.
[0025] At least one embodiment of the present disclosure provides a data transmission device, comprising at least one first ring link, wherein the first ring link comprises a plurality of arbitrators connected in sequence, each of the plurality of arbitrators is connected to at least one data sending unit among a plurality of data sending units and / or at least one data receiving unit among a plurality of data receiving units, and the arbitrator is configured to: monitor whether there is a bandwidth margin on the first ring link, and in response to the existence of a bandwidth margin, allow the data sending unit connected to the arbitrator to send a first data packet to the first ring link and transmit it along the first ring link; and / or receive a second data packet from the first ring link and transmitted along a transmission direction, and determine whether to transmit the second data packet to the data receiving unit connected to the arbitrator.
[0026] A data transmission device provided by at least one embodiment of the present disclosure uses a ring link composed of multiple arbitrators to realize data transmission. Each arbitrator is responsible for the data transmission decision of the data sending unit and / or data receiving unit connected to it. Data requests do not need to be aggregated to a central node for processing, which reduces the time between requests and responses and effectively avoids congestion and delay problems caused by data centralization.
[0027] Figure 2 A schematic block diagram of a data transmission device provided for at least one embodiment of the present disclosure.
[0028] For example, Figure 2 As shown, the data transmission device 200 includes at least one first ring link 201, wherein the first ring link 201 includes a plurality of arbitrators 2011 connected in sequence, and each arbitrator 2011 is connected to at least one data sending unit among a plurality of data sending units and / or at least one data receiving unit among a plurality of data receiving units. The arbitrator 2011 is configured to: monitor whether there is a bandwidth margin on the first ring link, and in response to the existence of a bandwidth margin, allow the data sending unit connected to the arbitrator to send a first data packet to the first ring link and transmit along the first ring link; and / or receive a second data packet from the first ring link, transmitted along the transmission direction, and determine whether to transmit the second data packet to the data receiving unit connected to the arbitrator. Here, the second data packet may refer to any data packet transmitted on the first ring link, and the second data packet may be the same as the first data packet or different from the first data packet, and the embodiments of the present disclosure are not limited to this.
[0029] For example, the arbitrator may be connected to only one data transmission unit, and is configured to monitor whether there is a bandwidth margin on the first ring link, and in response to the existence of a bandwidth margin, allow the data transmission unit connected to the arbitrator to send a data packet to the first ring link and transmit it along the first ring link. For example, the arbitrator continuously monitors the bandwidth usage on the first ring link, and if it is detected that there is a bandwidth margin, that is, the current first ring link has not reached its maximum transmission capacity, it is considered that more data packets can be safely and efficiently transmitted at this time, and the connected data transmission unit is allowed to send the data packet to the first ring link and transmit it along the first ring link. The first ring link has a fixed transmission direction.
[0030] For example, the arbitrator may be connected to only one data receiving unit, and is configured to receive a data packet transmitted from the first ring link along the transmission direction, and determine whether to transmit the data packet to the data receiving unit connected to the arbitrator. For example, the arbitrator is responsible for receiving a data packet transmitted from the first ring link along the transmission direction. After receiving the data packet, the arbitrator determines whether it is necessary to transmit the data packet to the connected data receiving unit. If not, the data packet continues to be transmitted along the transmission direction.
[0031] For example, the arbitrator can be connected to a data sending unit and a data receiving unit, and is configured to monitor whether there is a bandwidth margin on the first ring link, and in response to the existence of a bandwidth margin, allow the data sending unit connected to the arbitrator to send a data packet to the first ring link and transmit it along the first ring link; and receive a data packet from the first ring link and transmitted along the transmission direction, and determine whether to transmit the data packet to the data receiving unit connected to the arbitrator.
[0032] The embodiment of the present disclosure does not limit the number of first ring links, and only requires that a single first ring link or a combination of multiple first ring links can cover each data sending unit and data receiving unit that has data transmission requirements.
[0033] According to the data transmission device provided by the above embodiment of the present disclosure, the arbitrator can effectively manage the data traffic on the first ring link by monitoring and controlling the sending of data packets. In addition, the use of multiple distributed arbitrators instead of a cross switch matrix to achieve data transmission does not require data aggregation to the center, which can effectively avoid congestion and delay problems caused by data centralization and improve data transmission efficiency and reliability.
[0034] In the data transmission device provided by at least one embodiment of the present disclosure, the arbitrator is further configured to determine whether to transmit the second data packet to the data receiving unit connected to the arbitrator according to the destination address of the second data packet. Here, the second data packet may refer to any data packet transmitted on the first ring link.
[0035] For example, a data packet may carry a destination address, such as the destination address information in the header of the data packet. For example, a forwarding rule may be preset inside the arbitrator, and the forwarding rule defines the correspondence between the destination address and the data receiving unit. When a data packet arrives at the arbitrator, if the arbitrator determines that the destination address of the data packet corresponds to the receiving unit connected to the arbitrator, the data packet is transmitted to the corresponding data receiving unit; if the arbitrator determines that the destination address of the data packet does not correspond to the receiving unit connected to the arbitrator, the data packet will continue to be transmitted on the first ring link.
[0036] In the data transmission device provided by at least one embodiment of the present disclosure, when the amount of data on a single first ring link is less than a preset traffic threshold, the single first ring link is configured to transmit all data packets.
[0037] For example, when only a single ring link is set for data transmission of all data sending units and data receiving units, if the amount of data on the first ring link is less than the preset flow threshold, it means that the amount of data on the first ring link is small and is in a light load state, and only using the first ring link for data transmission will not cause congestion or delay. It should be noted that the embodiment of the present disclosure does not limit the size of the preset flow, and can be flexibly set according to different application scenarios and requirements.
[0038] Figure 3 A schematic diagram of a data transmission device implementing data transmission according to at least one embodiment of the present disclosure is shown. For example, Figure 3 An example of implementing data transmission based on a single first ring link is shown.
[0039] For example, Figure 3 As shown, the first ring link includes arbitrators 0 to arbitrators 3 connected in sequence, arbitrator 0 is connected to data sending unit 0 and data receiving unit 0, arbitrator 1 is connected to data sending unit 1 and data receiving unit 1, arbitrator 2 is connected to data sending unit 2 and data receiving unit 2, and arbitrator 3 is connected to data sending unit 3 and data receiving unit 3, so as to realize data transmission between data sending unit 0 to data sending unit 3 and data receiving unit 0 to data receiving unit 3. The transmission direction of the first ring link is clockwise, that is, arbitrator 0→arbitrator 1→arbitrator 2→arbitrator 3→arbitrator 0.
[0040] For example, Figure 3As shown, taking the case where the data sending unit 0 needs to send a target data packet to the data receiving unit 3 as an example, the arbitrator 0 monitors whether there is a bandwidth margin on the first ring link, and in response to the existence of a bandwidth margin, allows the data sending unit 0 to send the target data packet to the first ring link and transmit it clockwise along the first ring link. Arbitrators 1 to arbitrators 3 receive various data packets transmitted along the transmission direction from the first ring link, and determine whether to transmit these data packets to the connected data receiving unit. For example, when the target data packet arrives at arbitrator 1, arbitrator 1 determines that it is not necessary to transmit the target data packet to the connected data receiving unit 1, and the target data packet continues to be transmitted along the transmission direction on the first ring link. For example, when the target data packet arrives at arbitrator 3, arbitrator 3 determines that it is necessary to transmit the target data packet to the connected data receiving unit 3, and transmits the target data packet to the data receiving unit 3, thereby realizing the transmission of the target data packet from the data sending unit 0 to the data receiving unit 3.
[0041] In the data transmission device provided by at least one embodiment of the present disclosure, when the amount of data on a single first ring link is greater than a preset traffic threshold, at least one first ring link includes multiple first ring links so that all data packets are distributed to multiple first ring links.
[0042] For example, when only a single ring link is set for data transmission of all data sending units and data receiving units, if the amount of data on the first ring link is greater than the preset flow threshold, it means that the amount of data on the first ring link is large and is in an overload state. Using only the first ring link for data transmission may cause congestion and delay, affecting data transmission efficiency. In this case, multiple first ring links are set, each of which connects part of the data sending units and / or part of the data receiving units, so that the data packets originally transmitted by a single first ring link are distributed to multiple first ring links, thereby reducing the amount of data on each first ring link.
[0043] For example, when the data volume on multiple first ring links is reduced below the preset distribution flow threshold, the number of first ring links can also be reduced to save resources. The preset distribution flow threshold is less than the preset flow threshold and can be flexibly set according to different application scenarios and requirements.
[0044] According to the data transmission device provided by the above embodiment of the present disclosure, when the amount of data on a single ring link is too large, network congestion and delay can be effectively alleviated by adding multiple ring links to disperse the traffic, thereby improving the efficiency and reliability of data transmission.
[0045] Figure 4 A schematic diagram of a data transmission device implementing data transmission according to at least one embodiment of the present disclosure is shown. For example, Figure 4 An example of implementing data transmission based on multiple first ring links is shown.
[0046] For example, Figure 4 As shown, the first ring link A includes arbitrators 0 to arbitrators 3 connected in sequence, arbitrator 0 is connected to data sending unit 0, arbitrator 1 is connected to data sending unit 1 and data receiving unit 1, arbitrator 2 is connected to data sending unit 2, and arbitrator 3 is connected to data sending unit 3 and data receiving unit 3, so as to realize data transmission between data sending unit 0 to data sending unit 3 and data receiving unit 1 and data receiving unit 3. The first ring link B includes arbitrators 4 to arbitrators 7 connected in sequence, arbitrator 4 is connected to data sending unit 0 and data receiving unit 0, arbitrator 5 is connected to data sending unit 1, arbitrator 6 is connected to data sending unit 2 and data receiving unit 2, and arbitrator 7 is connected to data sending unit 3, so as to realize data transmission between data sending unit 0 to data sending unit 3 and data receiving unit 0 and data receiving unit 2. The transmission direction of the first ring link A is clockwise, that is, arbitrator 0→arbitrator 1→arbitrator 2→arbitrator 3→arbitrator 0. The transmission direction of the first ring link B is also clockwise, that is, arbitrator 4 →arbitrator 5 →arbitrator 6 →arbitrator 7 →arbitrator 4 .
[0047] For example, Figure 4 As shown, taking the case where the data sending unit 0 needs to send a target data packet to the data receiving unit 3 as an example, the arbitrator 0 monitors whether there is a bandwidth margin on the first ring link A. In response to the existence of a bandwidth margin, the data sending unit 0 is allowed to send the target data packet to the first ring link A and transmit it clockwise along the first ring link A. The arbitrator 1 and the arbitrator 3 receive each data packet transmitted along the transmission direction from the first ring link A, and determine whether to transmit these data packets to the connected data receiving unit. For example, when the target data packet arrives at the arbitrator 1, the arbitrator 1 determines that it is not necessary to transmit the target data packet to the connected data receiving unit 1, and the target data packet continues to be transmitted along the transmission direction on the first ring link A. For example, when the target data packet arrives at the arbitrator 3, the arbitrator 3 determines that it is necessary to transmit the target data packet to the connected data receiving unit 3, and the target data packet is transmitted to the data receiving unit 3, thereby realizing the transmission of the target data packet from the data sending unit 0 to the data receiving unit 3 on the first data link A.
[0048] For example, Figure 4As shown, taking the case where the data sending unit 0 needs to send a target data packet to the data receiving unit 2 as an example, the arbitrator 4 monitors whether there is a bandwidth margin on the first ring link B. In response to the existence of a bandwidth margin, the data sending unit 0 is allowed to send the target data packet to the first ring link B and transmit it clockwise along the first ring link B. The arbitrator 4 and the arbitrator 6 receive each data packet transmitted along the transmission direction from the first ring link B, and determine whether to transmit these data packets to the connected data receiving unit. For example, when the target data packet arrives at the arbitrator 4, the arbitrator 4 determines that it is not necessary to transmit the target data packet to the connected data receiving unit 0, and the target data packet continues to be transmitted along the transmission direction on the first ring link B. For example, when the target data packet arrives at the arbitrator 6, the arbitrator 6 determines that it is necessary to transmit the target data packet to the connected data receiving unit 2, and the target data packet is transmitted to the data receiving unit 2, thereby realizing the transmission of the target data packet from the data sending unit 0 to the data receiving unit 2 on the first data link B.
[0049] In the data transmission device provided by at least one embodiment of the present disclosure, there is at least one arbitrator in the first ring link that is connected to only one adjacent arbitrator. The data transmission device also includes a second ring link, the second ring link has a transmission direction opposite to that of the first ring link, and the second ring link is configured to receive feedback information sent by a data sending unit connected to a downstream arbitrator in the first ring link, and transmit it to a data sending unit connected to an upstream arbitrator in the first ring link, so that the data sending unit connected to the upstream arbitrator adjusts the size of the data packet to be sent and / or the destination data receiving unit according to the feedback information.
[0050] For example, the first ring link is a non-closed ring link with a clear starting point and an ending point, and data flows in the direction from the starting point to the ending point. Along the data transmission direction, the first arbitrator and the last arbitrator in the first ring link are only connected to one adjacent arbitrator. At this time, according to the data transmission direction, the arbitrators in the first ring link can be divided into upstream arbitrators and downstream arbitrators, that is, the arbitrator closer to the starting point is the upstream arbitrator, and the arbitrator closer to the ending point is the downstream arbitrator.
[0051] For example, a second ring link opposite to the transmission direction of the first ring link is set to realize flow control, the second ring link includes a plurality of arbitrators connected in sequence, each of the plurality of arbitrators is connected to at least one data sending unit of the plurality of data sending units. The number of arbitrators included in the first ring link and the second ring link may be equal, and the data sending units connected to the corresponding arbitrators in the first ring link and the second ring link may also be the same.
[0052] For example, the feedback information includes the amount of data that the data sending unit connected to the downstream arbitrator needs to send. When the amount of data that the data sending unit connected to the downstream arbitrator needs to send is large or there is not enough bandwidth margin to send data for a long time, the feedback information can be sent through the second ring link and transmitted to the data sending unit connected to the upstream arbitrator, informing the data sending unit connected to the upstream arbitrator to control the amount of data that needs to be sent and reserve more bandwidth margin for the data sending unit connected to the downstream arbitrator, so as to avoid the sending unit connected to the upstream arbitrator always occupying the sending advantage, resulting in the sending unit connected to the downstream arbitrator being unable to send data, thereby achieving the purpose of traffic balancing.
[0053] For example, the data sending unit connected to the upstream arbitrator can determine the proportion of the reserved bandwidth margin according to the feedback information and the total amount of data packets that it needs to send, and adjust the size of the data packets that it needs to send and / or the destination data receiving unit. For example, the size of the data packet that needs to be sent can be reduced, split into smaller data packets for multiple transmissions, or other available data receiving units can be selected as the destination data receiving unit.
[0054] For example, if the data transmission device includes a plurality of first ring links, a plurality of second ring links may be correspondingly provided to form a plurality of first ring link-second ring link matching pairs. In each matching pair, the number of arbitrators included in the first ring link and the second ring link may be equal, and the data sending units connected to the arbitrators may also be the same, that is, the second ring link in each matching pair is used to control the amount of data in the first ring link.
[0055] According to the data transmission device provided by the above embodiment of the present disclosure, by setting the second ring link, dynamic adjustment of the data transmission strategy can be achieved, which can better adapt to the ever-changing network environment, thereby improving the efficiency and reliability of data transmission.
[0056] Figure 5 A schematic diagram of a data transmission device implementing data transmission according to at least one embodiment of the present disclosure is shown. For example, Figure 5 A second ring link is shown with a transmission direction opposite to the first ring link.
[0057] For example, Figure 5As shown, the first ring link includes arbitrators 0 to arbitrators 3 connected in sequence, and arbitrators 0 and arbitrators 3 are only connected to one adjacent arbitrator, serving as the first and last arbitrators of the link respectively. Arbitrator 0 is connected to data sending unit 0, arbitrator 1 is connected to data sending unit 1, arbitrator 2 is connected to data sending unit 2, and arbitrator 3 is connected to data sending unit 3 and data receiving unit 3, so as to realize data transmission between data sending unit 0 to data sending unit 3 and data receiving unit 3. The transmission direction of the first ring link is clockwise, that is, arbitrator 0 → arbitrator 1 → arbitrator 2 → arbitrator 3.
[0058] For example, Figure 5 As shown, the second ring link includes arbitrator 0' to arbitrator 3' connected in sequence. Arbitrator 0' is connected to data sending unit 0, arbitrator 1' is connected to data sending unit 1, arbitrator 2' is connected to data sending unit 2, and arbitrator 3' is connected to data sending unit 3. The transmission direction of the second ring link is counterclockwise, that is, arbitrator 3'→arbitrator 2'→arbitrator 1'→arbitrator 0'.
[0059] For example, Figure 5 As shown, it is taken as an example that both the data sending unit 0 and the data sending unit 2 need to send data packets to the data receiving unit 3. Arbitrator 0 is an upstream arbitrator, and arbitrator 2 is a downstream arbitrator. The data sending unit 2 sends the feedback information to the second ring link through arbitrator 2', and transmits it to the data sending unit 0 via arbitrator 1' and arbitrator 0'. The data sending unit 0 adjusts the size of the data packet it needs to send according to the received feedback information, and reserves more bandwidth margin for the data sending unit 2 to use, so as to realize data transmission between the data sending unit 2 and the data receiving unit 3.
[0060] In the data transmission device provided in at least one embodiment of the present disclosure, the data sending unit is a computing unit, and the data receiving unit is a cache unit.
[0061] For example, a computing unit may be an execution unit (EU) that executes computing tasks, and a cache unit may include a first-level cache (L1 cache), a second-level cache (L2 cache), or a last-level cache (LLC).
[0062] For example, when a computing unit sends an access request to a cache unit, the data sending unit is the computing unit, the data receiving unit is the cache unit, and the data packet is the access request. For example, when multiple computing units simultaneously send access requests to the same cache unit, the data transmission device provided according to the embodiment of the present disclosure can determine which computing unit accesses the cache unit.
[0063] In the data transmission device provided in at least one embodiment of the present disclosure, the data sending unit is a cache unit, and the data receiving unit is a calculation unit.
[0064] For example, when the cache unit returns read data to the computing unit, the data sending unit is the cache unit, the data receiving unit is the computing unit, and the data packet is the read data. For example, when multiple cache units return read data to the same computing unit at the same time, the data transmission device provided according to the embodiment of the present disclosure can determine which cache unit returns the read data to the computing unit.
[0065] In the data transmission device provided by at least one embodiment of the present disclosure, the data transmission device is arranged in an on-chip network.
[0066] The data transmission device provided by the embodiment of the present disclosure, as a part of the on-chip network, can effectively connect multiple data sending units and data receiving units to provide high-bandwidth and low-latency data transmission.
[0067] Figure 6 A flowchart of a data transmission method provided by at least one embodiment of the present disclosure.
[0068] like Figure 6 As shown, at least one embodiment of the present disclosure provides a data transmission method implemented based on the data transmission device provided by at least one embodiment above, including the following steps S601 to S602.
[0069] Step S601: Each arbitrator monitors whether there is bandwidth margin on the first ring link where it is located, and in response to the existence of bandwidth margin, allows the data sending unit connected to the arbitrator to send a first data packet to the first ring link and transmit along the first ring link.
[0070] Step S602: Each arbitrator receives a second data packet transmitted along the transmission direction from the first ring link, and determines whether to transmit the second data packet to the data receiving unit connected to the arbitrator.
[0071] For detailed description of step S601 and step S602, please refer to the above-mentioned embodiment of the data transmission device, which will not be described in detail here.
[0072] Figure 7 A schematic block diagram of a processor provided for at least one embodiment of the present disclosure.
[0073] like Figure 7As shown, the processor 700 provided in the embodiment of the present disclosure includes a data transmission device 701, multiple computing units 702, and multiple cache units 703. The data transmission device 701 can be a data transmission device provided by any embodiment of the present disclosure. Regarding the structure, function, and technical effect of the data transmission device 701, reference can be made to the relevant content of the data transmission device 200, which will not be repeated here. For example, the processor can be a single-core or multi-core central processing unit (CPU), a graphics processing unit (GPU), a general-purpose graphics processing unit (GPGPU), an artificial intelligence (AI) accelerator, etc., and the present disclosure does not limit this.
[0074] For example, the computing unit 702 may be a unit that executes computing tasks (Execution Unit, EU), and the computing unit 702 may be used as a data sending unit or a data receiving unit.
[0075] For example, the cache unit 703 may include a first level cache (L1 cache), a second level cache (L2 cache), or a last level cache (LLC), etc. The cache unit 703 may be used as a data sending unit or a data receiving unit.
[0076] For example, when the computing unit sends an access request to the cache unit, the data sending unit is the computing unit and the data receiving unit is the cache unit. For example, when the cache unit returns read data to the computing unit, the data sending unit is the cache unit and the data receiving unit is the computing unit.
[0077] Figure 8 A schematic block diagram of an electronic device provided for at least one embodiment of the present disclosure.
[0078] like Figure 8 As shown, in some embodiments, the electronic device 800 includes a processor 801, and the processor 801 is a processor provided by any of the above embodiments of the present disclosure, for example, Figure 7 The electronic device 800 may be any device with a computing function, such as a computer, a server, a smart phone, a tablet computer, etc., which is not limited in the embodiments of the present disclosure.
[0079] Fig. 9 A schematic block diagram of another electronic device provided for at least one embodiment of the present disclosure.
[0080] like Fig. 9As shown, the electronic device 900 includes a processor provided by any of the above embodiments of the present disclosure, and the electronic device 900 is suitable for implementing the data transmission method provided by the embodiment of the present disclosure. The electronic device 900 may be a terminal device or a server, etc. It should be noted that, Fig. 9 The electronic device 900 shown is only an example and does not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.
[0081] like Fig. 9 As shown, the electronic device 900 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 91, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 92 or a program loaded from a storage device 98 to a random access memory (RAM) 93. For example, the processing device 91 can be a processor provided by any of the above embodiments of the present disclosure. In the RAM 93, various programs and data required for the operation of the electronic device 900 are also stored. The processing device 91, the ROM 92, and the RAM 93 are connected to each other via a bus 94. An input / output (I / O) interface 95 is also connected to the bus 94.
[0082] Typically, the following devices may be connected to the I / O interface 95: an input device 96 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 97 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 98 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 99. The communication device 99 may allow the electronic device 900 to communicate with other electronic devices wirelessly or by wire to exchange data. Although Fig. 9 The electronic device 900 is shown to have various devices, but it should be understood that it is not required to implement or possess all of the devices shown, and the electronic device 900 may alternatively implement or possess more or fewer devices.
[0083] For the detailed description and technical effects of the electronic device 800 / 900, please refer to the above description of the processor and the data transmission method, which will not be repeated here.
[0084] Although the disclosure has been described in detail above with general descriptions and specific implementation methods, it is obvious to those skilled in the art that some modifications or improvements may be made to the embodiments of the disclosure. Therefore, these modifications or improvements made without departing from the spirit of the disclosure are within the scope of protection claimed by the disclosure.
[0085] There are a few points to note about this disclosure: (1) The drawings of the embodiments of the present disclosure only relate to the structures related to the embodiments of the present disclosure. Other structures may refer to the general design.
[0086] (2) For the sake of clarity, in the drawings used to describe the embodiments of the present disclosure, the thickness of layers or regions is enlarged or reduced, that is, these drawings are not drawn according to the actual scale.
[0087] (3) In the absence of conflict, the embodiments of the present disclosure and the features therein may be combined with each other to obtain new embodiments.
[0088] The above description is only a specific implementation of the present disclosure, but the protection scope of the present disclosure is not limited thereto. The protection scope of the present disclosure shall be based on the protection scope of the claims.
Claims
1. A data transmission device, comprising at least one first ring link, wherein: The first ring link includes a plurality of arbitrators connected in sequence, each of the plurality of arbitrators is connected to at least one data sending unit among the plurality of data sending units and / or at least one data receiving unit among the plurality of data receiving units, The arbiter is configured to: monitoring whether there is a bandwidth margin on the first ring link, and in response to the existence of the bandwidth margin, allowing the data sending unit connected to the arbitrator to send a first data packet to the first ring link and transmit it along the first ring link; and / or A second data packet transmitted along a transmission direction from the first ring link is received, and it is determined whether to transmit the second data packet to a data receiving unit connected to the arbitrator.
2. The data transmission device according to claim 1, wherein: The arbitrator is further configured to determine whether to transmit the second data packet to a data receiving unit connected to the arbitrator according to a destination address of the second data packet.
3. The data transmission device according to claim 1, wherein: In the case that the amount of data on a single first ring link is less than a preset traffic threshold, the single first ring link is configured to transmit all data packets.
4. The data transmission device according to claim 1, wherein: In a case where the amount of data on a single first ring link is greater than a preset traffic threshold, the at least one first ring link includes a plurality of first ring links, so that all data packets are distributed to the plurality of first ring links.
5. The data transmission device according to claim 1, wherein: At least one arbitrator in the first ring link is connected only to one adjacent arbitrator, and the data transmission device further includes a second ring link, the second ring link has a transmission direction opposite to that of the first ring link, The second ring link is configured to receive feedback information sent by a data sending unit connected to a downstream arbitrator in the first ring link, and transmit the feedback information to a data sending unit connected to an upstream arbitrator in the first ring link, so that the data sending unit connected to the upstream arbitrator adjusts the size of the data packet it needs to send and / or the destination data receiving unit according to the feedback information.
6. The data transmission device according to claim 5, wherein: The feedback information includes the amount of data that needs to be sent by the data sending unit connected to the downstream arbitrator.
7. The data transmission device according to claim 1, wherein: The data sending unit is a computing unit, and the data receiving unit is a cache unit.
8. The data transmission device according to claim 1, wherein: The data sending unit is a cache unit, and the data receiving unit is a calculation unit.
9. The data transmission device according to claim 1, wherein: The data transmission device is arranged in an on-chip network.
10. A processor, comprising: The data transmission device according to any one of claims 1 to 9; A plurality of computing units, serving as the plurality of data sending units or the plurality of data receiving units; as well as A plurality of cache units are used as the plurality of data receiving units or the plurality of data sending units.
11. An electronic device, comprising: A processor according to claim 10.
12. A data transmission method implemented by the data transmission device according to any one of claims 1 to 9, comprising: Each arbitrator monitors whether there is a bandwidth margin on the first ring link where it is located, and in response to the existence of the bandwidth margin, allows the data sending unit connected to the arbitrator to send the first data packet to the first ring link and transmit it along the first ring link; as well as Each arbitrator receives the second data packet transmitted along the transmission direction from the first ring link, and determines whether to transmit the second data packet to the data receiving unit connected to the arbitrator.
Citation Information
Patent Citations
Method for allocating bandwidth dynamically to design on-chip network
CN101075959A
Double-layer double-loop on chip network topology construction
CN101420380A
Chip and related equipment
CN109995633A
Nelson rule discrimination system and method based on streaming measurement data
CN111597398A
System on chip
CN111797050A
