Data transmission system and method, electronic equipment and storage medium

By monitoring the data change in the data transmission layer of the multi-core integrated system and dynamically adjusting the data transmission path, the bandwidth of multiple data transmission links is used to solve the data transmission delay problem caused by insufficient bandwidth of a single bus link, and more efficient data transmission is achieved.

CN119892722AActive Publication Date: 2025-04-25INSPUR SUZHOU INTELLIGENT TECH CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202510379035.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-03-28
Publication Date
2025-04-25
Estimated Expiration
2045-03-28

AI Technical Summary

Technical Problem

In multi-core integrated systems, the bandwidth of a single bus link cannot meet the large amount of data transmission, resulting in high data transmission delay.

Method used

The data transmission layer monitors the data change amount of data to be transmitted in the core particle layer, and adjusts the data transmission path of the core particle layer according to the data change amount and at least two data transmission links to form a data transmission path composed of multiple data transmission links.

Benefits of technology

When the data volume is large, make full use of the bandwidth of multiple data transmission links to improve the efficiency of data transmission and reduce the data transmission delay.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119892722A_ABST
    Figure CN119892722A_ABST
Patent Text Reader

Abstract

The invention discloses a data transmission system and method, electronic equipment and a storage medium, and relates to the technical field of data transmission, and the method comprises the steps: a data transmission layer can monitor the data variation of to-be-transmitted data of a core particle layer, and adjusts the data transmission path of the core particle layer according to the data variation and a plurality of data transmission links, thereby achieving the data transmission of the to-be-transmitted data. And the data transmission path is composed of a plurality of data transmission links, so that when the data volume is large, the bandwidth of the plurality of data transmission links is fully utilized, the data transmission efficiency is improved, and the data transmission delay is reduced. Therefore, the technical problem of relatively high delay of data transmission can be solved, and the technical effect of reducing the delay of data transmission is achieved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of data transmission, and in particular to a data transmission system and method thereof, an electronic device and a storage medium. Background Art

[0002] The multi-chip integrated system can not only achieve higher performance density but also reduce costs and improve production efficiency by integrating multiple functional chips together. Data transmission is required between different chips in the multi-chip integrated system.

[0003] In the relevant technology of data transmission, a multi-chip integrated system usually uses a single bus link to connect all the chips together, and uses a single bus link to transmit data between the chips. When the amount of data to be transmitted between the chips is large, the bandwidth of a single bus link cannot meet the transmission of a large amount of data, resulting in a high delay in data transmission. Summary of the invention

[0004] The present application provides a data transmission system and method thereof, an electronic device and a storage medium, so as to at least solve the problem of high delay in data transmission in the related art.

[0005] The present application provides a data transmission system, comprising: a core particle layer and a data transmission layer; The data transmission layer is connected to the core particle layer; the data transmission layer includes at least two data transmission links; The data transmission layer is used to monitor the data change amount of the data to be transmitted in the core grain layer, and adjust the data transmission path of the core grain layer according to the data change amount and at least two data transmission links; the data transmission path is composed of at least two data transmission links; The data transmission layer is used to transmit the data to be transmitted in the core particle layer by using the data transmission path.

[0006] The present application provides a data transmission method, including: Monitor the data change of the data to be transmitted in the core particle layer; According to the data change amount and at least two data transmission links, the data transmission path of the core particle layer is adjusted; the data transmission path is composed of at least two data transmission links; The data transmission path is used to transmit the data to be transmitted in the core particle layer.

[0007] The present application also provides a data transmission device, comprising: A monitoring unit, used for monitoring the data change amount of the data to be transmitted in the core particle layer; An adjustment unit, used for adjusting the data transmission path of the core particle layer according to the data change amount and at least two data transmission links; the data transmission path is composed of at least two data transmission links; The transmission unit is used for transmitting the data to be transmitted of the core particle layer by using the data transmission path.

[0008] The present application also provides an electronic device, comprising: a memory for storing a computer program; and a processor for implementing the steps of any of the above-mentioned data transmission methods when executing the computer program.

[0009] The present application also provides a computer-readable storage medium, in which a computer program is stored, wherein when the computer program is executed by a processor, the steps of any of the above-mentioned data transmission methods are implemented.

[0010] The present application also provides a computer program product, including a computer program, which implements the steps of any of the above-mentioned data transmission methods when the computer program is executed by a processor.

[0011] Through the present application, since the data transmission layer can monitor the data change amount of the data to be transmitted in the core particle layer, and adjust the data transmission path of the core particle layer according to the data change amount and multiple data transmission links, and the data transmission path is composed of multiple data transmission links, when the data volume is large, the bandwidth of multiple data transmission links can be fully utilized to improve the efficiency of data transmission and reduce data transmission delay. Therefore, the technical problem of high data transmission delay can be solved, and the technical effect of reducing data transmission delay can be achieved. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] In order to more clearly illustrate the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0013] Figure 1 A schematic diagram of the structure of a data transmission system provided in an embodiment of the present application; Figure 2 A circuit diagram of a data transmission link provided in an embodiment of the present application; Figure 3 A flowchart of a data transmission method provided in an embodiment of the present application; Figure 4 A schematic diagram of the structure of a data transmission device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0014] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0015] It should be noted that, in the description of this application, the terms "include", "comprise" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. The terms "first", "second", etc. in this application are used to distinguish similar objects, and are not used to describe a specific order or sequence.

[0016] In order to enable those skilled in the art to better understand the present application, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0017] Figure 1 A schematic diagram of a data transmission system provided in an embodiment of the present application is shown in FIG. Figure 1 As shown, the data transmission system includes: a core particle layer and a data transmission layer.

[0018] The data transmission layer is connected to the core particle layer; the data transmission layer includes at least two data transmission links.

[0019] The core particle layer is a hardware layer composed of multiple core particles with independent functions. Each core particle is a modular chip, such as a central processing unit (CPU), a graphics processing unit (GPU), a storage unit, etc. Multiple core particles are integrated in the core particle layer through packaging technology. Each core particle in the core particle layer is used to perform tasks such as computing, storage, and communication, and exchanges data with other core particles in the core particle layer through the data transmission layer.

[0020] The data transmission layer is a communication architecture layer located above the core particle layer, responsible for data transmission path management and bandwidth allocation between core particles. The data transmission link is a physical communication channel used for data transmission between core particles. Each data transmission link has independent bandwidth and supports parallel or serial transmission, such as high-speed serial links, optical interconnect links, on-chip network channels, etc.

[0021] The connection between the data transmission layer and the core particle layer can be achieved through a silicon interposer, micro bumps or silicon through vias to achieve physical connection between the core particle and the data transmission layer. Through parallel transmission of multiple links, the total bandwidth is multiplied to meet the needs of high data volume scenarios.

[0022] The data transmission layer is used to monitor the data change of the data to be transmitted in the core grain layer, and adjust the data transmission path of the core grain layer according to the data change and at least two data transmission links; the data transmission path is composed of at least two data transmission links.

[0023] The data change is a quantitative indicator that characterizes the flow fluctuation or burst of data to be transmitted at the core layer, such as the increase or decrease of data volume per unit time, the change rate of bandwidth demand, etc. The data transmission path is an end-to-end communication channel formed by a combination of multiple data transmission links, supporting parallel or serial transmission.

[0024] In order to facilitate a better understanding of the data transmission path, an example is provided, where the data transmission path consists of data transmission link 1 + data transmission path link 3, and the data transmission path A consists of data transmission link 2 + data transmission link 4.

[0025] By embedding a flow sensor at the connection between the data transmission layer and the core particle layer, the number of bytes of the data packet to be transmitted, the packet rate and other parameters are periodically collected to monitor the data change. However, it should be clear that this statement is not intended to limit the way to monitor the data change to only the above method, but can also be achieved in other ways.

[0026] The data transmission layer generates a combination of all data transmission paths of all data transmission links. After obtaining the data change, the data transmission layer dynamically adjusts the data transmission path based on the bandwidth, delay, load and other information of all data transmission paths. The data transmission layer evaluates the load of each data transmission path based on the data change monitored in real time, and selects the data transmission path with the smallest load or the shortest path for data transmission.

[0027] By monitoring data changes in real time and dynamically adjusting the data transmission path, the data transmission layer can optimize data flow according to data load conditions, thereby improving data transmission efficiency and avoiding transmission bottlenecks and delays.

[0028] The data transmission layer is used to transmit the data to be transmitted in the core particle layer by using the data transmission path.

[0029] Data transmission refers to the process of transferring data from one core to another. In the data transmission system, this process is achieved through data transmission paths and related transmission control mechanisms to ensure that data can be accurately and efficiently transferred from one core to another.

[0030] Through the present application, since the data transmission layer can monitor the data change amount of the data to be transmitted in the core particle layer, and adjust the data transmission path of the core particle layer according to the data change amount and multiple data transmission links, and the data transmission path is composed of multiple data transmission links, when the data volume is large, the bandwidth of multiple data transmission links can be fully utilized to improve the efficiency of data transmission and reduce data transmission delay. Therefore, the technical problem of high data transmission delay can be solved, and the technical effect of reducing data transmission delay can be achieved.

[0031] In some embodiments, please refer to Figure 1 , the data transmission layer includes: a first data transmission layer and a second data transmission layer; The core particle layer is connected to the first data transmission layer; The second data transmission layer is connected to the first data transmission layer; The first data transmission layer is used to monitor the data change amount of the data to be transmitted in the core grain layer, and adjust the data transmission path of the core grain layer according to the data change amount and at least two data transmission links; The first data transmission layer is further used to aggregate the data to be transmitted in the core particle layer using the adjusted data transmission path to obtain aggregated data; The second data transmission layer is used to transmit the aggregated data.

[0032] The first data transmission layer is the middle layer of the data transmission system, responsible for interacting with the core particle layer, and completing the monitoring, adjustment and data aggregation functions of the data transmission path of the core particle layer. The first data transmission layer acts as a bridge between the core particle layer and the second data transmission layer, ensuring that data can flow efficiently and accurately between different layers. The second data transmission layer is responsible for long-distance data transmission across core particle groups or across systems. Aggregate data is a collection of data that is integrated, reorganized or compressed by the first data transmission layer for multiple core particles to be transmitted, usually in the form of data packets or data streams. Aggregate data transmission through the second data transmission layer can reduce redundant header information and improve transmission efficiency.

[0033] In some embodiments, please refer to Figure 1 , the first data transmission layer includes: at least two data transmission link networks, at least two interface routers and at least two inter-group routers; At least two interface routers are connected to the core particle group in the core particle layer; the core particle layer includes at least two core particle groups, each core particle group is connected to at least one interface router; the core particle group includes at least two core particles; Each data transmission link network is connected to at least one interface router, and each data transmission link network is connected to at least one inter-group router; At least two inter-group routers are connected to the second data transmission layer; The data transmission link network includes at least two data transmission links; The interface router is used to transmit the data change amount to the inter-group router through the data transmission link network; The inter-group router is used to receive the data change amount and adjust the data transmission path composed of different data transmission links in the data transmission link network according to the data change amount; The data transmission link network is used to transmit the data to be transmitted using the adjusted data transmission path.

[0034] The interface router is a component in the first data transmission layer that directly interacts with the core grain layer. The interface router is connected to the core grain group in the core grain layer, responsible for receiving data changes from the core grain group, and transmitting these data changes to the inter-group router through the data transmission link network. The inter-group router is a node in the first data transmission layer that is connected to the second data transmission layer. The inter-group router is a central routing node that connects multiple data transmission link networks and is responsible for global path optimization and bandwidth allocation. The data transmission link network is a network consisting of at least two physical / logical data transmission links.

[0035] The close cooperation between the interface router and the inter-group router can monitor the data changes in real time and dynamically adjust the transmission path to ensure that the data always selects the optimal link during the transmission process, reducing problems such as data congestion and transmission delay, and improving the efficiency and reliability of data transmission.

[0036] In some embodiments, please refer to Figure 1 ,The interface router includes: an accumulation transmitter; The accumulation transmitter is used to obtain all data packets flowing through the interface router in the historical time period; The accumulation transmitter is also used to randomly select any byte of each data packet among all data packets; The accumulation transmitter is also used to accumulate all selected bytes to obtain a byte accumulation value; The accumulation transmitter is also used to calculate the data change according to the byte accumulation value and the proportional factor; the proportional factor is a factor calculated according to the proportion of the first bit value and the second bit value in the byte accumulation value.

[0037] The accumulator is a functional module inside the interface router. The accumulator focuses on processing data packets flowing through the interface router to monitor and calculate the data change. The accumulator provides key data basis for the dynamic adjustment of the data transmission path through specific byte selection, accumulation and proportional factor calculation operations. The historical time period refers to a past time range that the accumulator refers to when calculating the data change. During this time period, the accumulator continuously monitors and records the relevant information of all data packets flowing through the interface router. Data packets are the basic unit of data transmission in the network and are composed of several bytes. In the data transmission system, the data to be transmitted generated by the core layer will be encapsulated into data packets, enter the data transmission link network through the interface router, and finally transmitted to the destination. The byte accumulation value is an intermediate result of the accumulator in the process of calculating the data change. It is obtained by randomly selecting any byte of each data packet in all data packets in the historical time period and accumulating these selected bytes. The proportional factor is a correction factor calculated based on the ratio of the first bit value and the second bit value in the byte accumulation value. The proportional factor is used to calculate the data change more accurately. The proportional factor takes into account the distribution of different byte types in the data packet, so that the calculation result of the data change amount can more truly reflect the actual data change trend. Among them, the first bit value is 0, and the second bit value is 1.

[0038] The specific processing process of the accumulator transmitter can be implemented by the following method: select certain bytes or bits in the input data packet for statistics. Usually, the most significant bytes or bits are selected, such as the highest bit or a fixed byte. The initial value of the accumulator is set to 0. For each input data packet, a specific byte or bit is extracted, and the present invention extracts the first byte. The value of the extracted byte or bit is accumulated in the accumulator. The value in the accumulator will roughly reflect the total amount of input data. This value is a rough estimate, but it can roughly reflect the size of the data stream. The accumulator sends the calculated accumulated value at a fixed time, and then the accumulator is cleared.

[0039] The byte accumulation value can be calculated using the following formula:

[0040] in, is the byte accumulation value, For the The first bytes, The total number of packets.

[0041] The data change can be calculated using the following formula:

[0042] in, is the data change amount, is the scale factor.

[0043] The chip internal scheduling unit samples and calculates the 0-1 ratio of the data bits in the data packet to estimate the data volume. For example, 1000 bytes of data are randomly selected in each time period, and the 0, 1 ratio is counted. The proportional factor is obtained. The proportional factor is sent to the accumulator transmitter of the interface router through the inter-group high-speed routing.

[0044] By accumulating the byte accumulation and scaling factor adjustment of the transmitter, the system can accurately obtain the changing characteristics of the data packet, thereby optimizing the traffic management based on historical data.

[0045] In some embodiments, please refer to Figure 1 , the data transmission link network includes: at least two multiplexers and switch controllers corresponding to the multiplexers, the at least two multiplexers forming at least two data transmission links; The inter-group router is used to control the switch controller corresponding to the multiplexer to adjust the data transmission path composed of the data transmission links corresponding to at least two multiplexers according to the data change amount.

[0046] A multiplexer is a device that combines multiple signals into a single signal, and is usually used to improve data transmission efficiency. In this embodiment, at least two multiplexers are used to combine multiple data streams into a data transmission link. Each multiplexer is responsible for processing specific input data and dynamically switching routes through a corresponding switch controller. The switch controller is a control device used in conjunction with the multiplexer, responsible for controlling the selection and switching of data transmission links. When network traffic and path requirements change, the switch controller adjusts the physical link path to which the multiplexer is connected according to the control signal. The switch controller achieves network traffic balance and path optimization by adjusting the multiplexer path in real time.

[0047] In order to better understand the multiplexer and the switch controller corresponding to the multiplexer as a data transmission link, Figure 2 As shown, Figure 2 A circuit diagram of a data transmission link provided in an embodiment of the present application, the data transmission link is composed of an 8-to-1 multiplexer and a switch controller. The network reconstruction master core controls the connection state of the data transmission link through a configurable switch controller to determine the pairing relationship between each input port and output port. In addition, I and F0-F7 are the input and output ends of the multiplexer, respectively, and S0-S1 are switch controllers, respectively.

[0048] Through the flexible configuration of the data transmission link network and the use of multiplexers and switch controllers, dynamic adjustment of the data transmission path is achieved. The inter-group router can control the switch controller in real time according to the data change amount, and flexibly adjust the data transmission path composed of the data transmission link corresponding to the multiplexer, reducing data congestion and transmission delay problems, and improving the efficiency and reliability of data transmission.

[0049] In some embodiments, please refer to Figure 1 , the intergroup router is also used to: Identify all data transmission links between the inter-group router and the target interface router; Combining all data transmission links into data transmission paths to obtain all data transmission paths between the inter-group router and the target interface router; each data transmission path includes at least two data transmission links; If the number of all data transmission paths is greater than the preset number, selecting a preset number of data transmission paths from all data transmission paths in ascending order of their path lengths; Dynamically adjusting the data transmission weight of each of the selected preset number of data transmission paths according to bandwidth usage of each of the selected preset number of data transmission paths; The data transmission volume of each data transmission path among the preset number of data transmission paths selected is dynamically allocated according to the data transmission weight.

[0050] The data transmission link network consists of a node set V and an edge set E. The nodes represent routers or computing units, and the edges represent the communication links between the nodes. (Connecting nodes and ) has a weight , usually represents communication delay, bandwidth or transmission cost, the weight of each two adjacent nodes = 1. The node set V is the combination of all data transmission links.

[0051] Between the inter-group router and the interface router, multiple data transmission paths are found for transmission to maximize the transmission bandwidth and minimize congestion. The inter-group router is the source node and the interface router is the destination node.

[0052] Initialize a path set P= , used to store multiple paths from the source node to the target node, and define a weight matrix W, where W[ ][ ]= , indicating a node To Node The weight of the edge between them. Define a capacity matrix C, where C[ ][ ] represents the bandwidth capacity of the edge. Find the first shortest data transmission path p1 from the source node to the destination node, add it to the path set P, and record the corresponding data transmission weight. The data transmission weight records the number of edges of the path, that is, the path length. For each data transmission path found, remove each node v and its connected edges on the data transmission path one by one, recalculate the shortest path of the remaining part, generate a new data transmission path, and add it to the path set. Update the data transmission weight, calculate the path bandwidth occupancy, adjust the weight matrix and capacity matrix C, and repeat the above steps until K different paths are found, or no new paths can be found. The weight and bandwidth occupancy corresponding to each path in the path set are recorded for subsequent transmission. Adjust the weight of each path according to the bandwidth usage to ensure balanced transmission load.

[0053] In order to avoid over-congestion of certain paths (i.e., the data load of certain paths is too high), we need to dynamically adjust the weights of these paths according to the bandwidth usage of the current paths. This weight adjustment can help us choose paths with lighter loads when selecting paths, thereby achieving load balancing of transmission. In order to achieve the relationship between path length and bandwidth allocation, that is, the longer the path, the lower the allocated bandwidth, the path weight can be adjusted according to the path length, and the bandwidth allocation ratio can be adjusted based on this weight.

[0054] It reduces the congestion and delay problems caused by excessive concentration of data on certain paths, while making full use of all available transmission resources and improving the bandwidth utilization and transmission performance of the entire system.

[0055] In some embodiments, please refer to Figure 1 , the intergroup router is also used to: Calculate the total bandwidth of a preset number of selected data transmission paths based on the data change amount and historical time period; Determine the reciprocal of the path length of each data transmission path among the selected preset number of data transmission paths as a bandwidth allocation coefficient; The bandwidth allocation amount of each data transmission path among the selected preset number of data transmission paths is calculated according to the total bandwidth and the bandwidth allocation coefficient.

[0056] The total bandwidth can be calculated using the following formula:

[0057] in, is the total bandwidth, For historical time periods.

[0058] The calculation formula of the bandwidth allocation coefficient can be realized by the following formula:

[0059] in, is the bandwidth allocation coefficient, is the inverse of the path length, The data transmission path.

[0060] The bandwidth allocation can be calculated using the following formula:

[0061] in, is the bandwidth allocation, The preset quantity.

[0062] By allocating bandwidth reasonably, we can avoid network congestion due to insufficient bandwidth on some data transmission paths, improve the reliability of data transmission, and reduce the probability of data packet loss and retransmission.

[0063] In some embodiments, please refer to Figure 1 , the intergroup router is also used to: Calculate the average bandwidth rate of the selected preset number of data transmission paths according to the total bandwidth and the preset number; If the average bandwidth rate is greater than the preset bandwidth rate threshold, the preset number is increased, and based on the increased preset number, the data transmission path is reselected until the average bandwidth rate is less than or equal to the preset bandwidth rate threshold.

[0064] The embodiments of the present application do not limit the specific values ​​of the preset bandwidth rate threshold and the preset number. The mechanism of dynamically adjusting the preset number and the data transmission path enables data transmission to be optimized according to the real-time network conditions and data traffic. When the average bandwidth rate exceeds the threshold, increasing the preset number and reselecting the path can provide more available path options for data transmission, thereby reducing delays and congestion during data transmission and improving the efficiency of data transmission.

[0065] In some embodiments, please refer to Figure 1 , the second data transmission layer includes: at least two relay routers; At least two relay routers are connected to at least two inter-group routers; different relay routers are connected to different inter-group routers; At least two adjacent relay routers are connected to each other; At least two relay routers are used to transmit the aggregated data.

[0066] The connections between adjacent relay routers form multiple transmission paths. Data can be transmitted through different paths, reducing the risk of data loss due to a path failure.

[0067] According to an embodiment of the present application, the present application also proposes a data transmission method, such as Figure 3 As shown, Figure 3 A flow chart of a data transmission method provided in an embodiment of the present application is provided. The method is applied in a data transmission system. The method comprises the following steps: Step 101, monitoring the data change amount of the data to be transmitted in the core particle layer.

[0068] Step 102, adjusting the data transmission path of the core particle layer according to the data change amount and at least two data transmission links; the data transmission path is composed of at least two data transmission links.

[0069] Step 103: using the data transmission path to transmit the data to be transmitted in the core particle layer.

[0070] Through the present application, since the data transmission layer can monitor the data change amount of the data to be transmitted in the core particle layer, and adjust the data transmission path of the core particle layer according to the data change amount and multiple data transmission links, and the data transmission path is composed of multiple data transmission links, when the data volume is large, the bandwidth of multiple data transmission links can be fully utilized to improve the efficiency of data transmission and reduce data transmission delay. Therefore, the technical problem of high data transmission delay can be solved, and the technical effect of reducing data transmission delay can be achieved.

[0071] As a refinement of step 101, when executing the monitoring of the data change amount of the data to be transmitted of the core grain layer, it can be implemented by but not limited to the following methods, including: obtaining all data packets flowing through the interface router in the historical time period; the interface router is a router connected to the core grain layer; randomly selecting any byte of each data packet in all data packets; accumulating all the selected bytes to obtain a byte accumulation value; calculating the data change amount based on the byte accumulation value and the proportional factor; the proportional factor is a factor calculated based on the ratio of the first bit value and the second bit value in the byte accumulation value.

[0072] Since the embodiments of the data transmission method part correspond to the embodiments of the data transmission system part, the embodiments of the data transmission method part refer to the description of the embodiments of the data transmission system part, which will not be described here. And it has the same beneficial effects as the above-mentioned data transmission system.

[0073] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method.

[0074] The embodiment of the present application also provides a data transmission device, Figure 4 A schematic diagram of the structure of a data transmission device provided in an embodiment of the present application is shown in FIG. Figure 4 As shown, including: A monitoring unit 31, used for monitoring the data change amount of the data to be transmitted in the core particle layer; An adjustment unit 32 is used to adjust the data transmission path of the core particle layer according to the data change amount and at least two data transmission links; the data transmission path is composed of at least two data transmission links; The transmission unit 33 is used for transmitting the data to be transmitted of the core particle layer by using the data transmission path.

[0075] Through the present application, since the data transmission layer can monitor the data change amount of the data to be transmitted in the core particle layer, and adjust the data transmission path of the core particle layer according to the data change amount and multiple data transmission links, and the data transmission path is composed of multiple data transmission links, when the data volume is large, the bandwidth of multiple data transmission links can be fully utilized to improve the efficiency of data transmission and reduce data transmission delay. Therefore, the technical problem of high data transmission delay can be solved, and the technical effect of reducing data transmission delay can be achieved.

[0076] For the description of the features in the embodiment corresponding to the data transmission device, reference can be made to the relevant description of the embodiment corresponding to the data transmission system, which will not be repeated here.

[0077] An embodiment of the present application further provides an electronic device, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above data transmission method embodiments.

[0078] An embodiment of the present application further provides a computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to execute the steps of any of the above-mentioned data transmission method embodiments when running.

[0079] In an exemplary embodiment, the computer-readable storage medium may include, but is not limited to, various media that can store computer programs, such as a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk.

[0080] An embodiment of the present application further provides a computer program product, which includes a computer program. When the computer program is executed by a processor, the steps in any one of the above data transmission method embodiments are implemented.

[0081] An embodiment of the present application further provides another computer program product, including a non-volatile computer-readable storage medium, wherein the non-volatile computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in any of the above-mentioned data transmission method embodiments are implemented.

[0082] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0083] The above is a detailed introduction to a data transmission system and method, electronic device and storage medium provided by the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and core idea of ​​the present application. It should be pointed out that for ordinary technicians in this technical field, without departing from the principles of the present application, several improvements and modifications can be made to the present application, and these improvements and modifications also fall within the scope of protection of the claims of the present application.

Claims

1. A data transmission system, characterized in that: include: Core particle layer and data transmission layer; The data transmission layer is connected to the core particle layer; the data transmission layer includes at least two data transmission links; The data transmission layer is used to monitor the data change amount of the data to be transmitted of the core grain layer, and adjust the data transmission path of the core grain layer according to the data change amount and the at least two data transmission links; the data transmission path is composed of the at least two data transmission links; The data transmission layer is used to transmit the data to be transmitted in the core particle layer by using the data transmission path.

2. The data transmission system according to claim 1, characterized in that: The data transmission layer comprises: a first data transmission layer and a second data transmission layer; The core particle layer is connected to the first data transmission layer; The second data transmission layer is connected to the first data transmission layer; The first data transmission layer is used to monitor the data change amount of the data to be transmitted of the core grain layer, and adjust the data transmission path of the core grain layer according to the data change amount and the at least two data transmission links; The first data transmission layer is further used to aggregate the data to be transmitted of the core particle layer using the adjusted data transmission path to obtain aggregated data; The second data transmission layer is used to transmit the aggregated data.

3. The data transmission system according to claim 2, characterized in that: The first data transmission layer includes: at least two data transmission link networks; The data transmission link network includes the at least two data transmission links; The data transmission link network is used to transmit the data to be transmitted using the adjusted data transmission path.

4. The data transmission system according to claim 3, characterized in that: The first data transmission layer further includes: at least two interface routers and at least two inter-group routers; The at least two interface routers are connected to the coregrain group in the coregrain layer; the coregrain layer includes at least two coregrain groups, each coregrain group is connected to at least one interface router; the coregrain group includes at least two coregrains; Each data transmission link network is connected to the at least one interface router, each data transmission link network is connected to at least one inter-group router; the at least two inter-group routers are connected to the second data transmission layer; The interface router is used to transmit the data change amount to the inter-group router through the data transmission link network; The inter-group router is used to receive the data change amount and adjust the data transmission path composed of different data transmission links in the data transmission link network according to the data change amount.

5. The data transmission system according to claim 4, characterized in that: The interface router comprises: an accumulation transmitter; The accumulative transmitter is used to obtain all data packets flowing through the interface router in a historical time period; The accumulative transmitter is further used to randomly select any byte of each data packet in all the data packets; The accumulation transmitter is further used to accumulate all selected bytes to obtain a byte accumulation value; The accumulation transmitter is also used to calculate the data change according to the byte accumulation value and the proportional factor; the proportional factor is a factor calculated according to the proportion of the first bit value and the second bit value in the byte accumulation value.

6. The data transmission system according to claim 4, characterized in that: The data transmission link network comprises: at least two multiplexers and switch controllers corresponding to the multiplexers, wherein the at least two multiplexers constitute the at least two data transmission links; The inter-group router is used to control the switch controller corresponding to the multiplexer to adjust the data transmission path composed of the data transmission links corresponding to the at least two multiplexers according to the data change amount.

7. The data transmission system according to claim 4, characterized in that: The inter-group router is further configured to: Identify all data transmission links between the inter-group router and the target interface router; Performing data transmission path combination on all the data transmission links to obtain all data transmission paths between the inter-group router and the target interface router; each data transmission path includes at least two data transmission links; If the number of all the data transmission paths is greater than the preset number, selecting the preset number of data transmission paths from all the data transmission paths in ascending order of the path lengths of the data transmission paths; Dynamically adjusting the data transmission weight of each of the selected preset number of data transmission paths according to bandwidth usage of each of the selected preset number of data transmission paths; The data transmission amount of each data transmission path in the selected preset number of data transmission paths is dynamically allocated according to the data transmission weight.

8. The data transmission system according to claim 7, characterized in that: The inter-group router is further configured to: Calculating the total bandwidth of the selected preset number of data transmission paths according to the data change amount and the historical time period; Determining the reciprocal of the path length of each data transmission path among the selected preset number of data transmission paths as a bandwidth allocation coefficient; The bandwidth allocation amount of each data transmission path in the selected preset number of data transmission paths is calculated according to the total bandwidth and the bandwidth allocation coefficient.

9. The data transmission system according to claim 8, characterized in that: The inter-group router is further configured to: Calculating an average bandwidth rate of the selected preset number of data transmission paths according to the total bandwidth and the preset number; If the average bandwidth rate is greater than a preset bandwidth rate threshold, the preset number is increased, and based on the increased preset number, a data transmission path is reselected until the average bandwidth rate is less than or equal to the preset bandwidth rate threshold.

10. The data transmission system according to claim 4, characterized in that: The second data transmission layer includes: at least two relay routers; The at least two relay routers are connected to the at least two inter-group routers; different relay routers are connected to different inter-group routers; Adjacent relay routers among the at least two relay routers are connected in pairs; The at least two relay routers are used to transmit the aggregated data.

11. A data transmission method, characterized in that: include: Monitor the data change of the data to be transmitted in the core particle layer; According to the data change amount and at least two data transmission links, the data transmission path of the core particle layer is adjusted; the data transmission path is composed of the at least two data transmission links; The data transmission path is used to transmit the data to be transmitted in the core particle layer.

12. The data transmission method according to claim 11, characterized in that: The monitoring of the data change amount of the to-be-transmitted data of the core grain layer comprises: Acquire all data packets flowing through the interface router in the historical time period; the interface router is a router connected to the core particle layer; Randomly select any byte of each data packet in all the data packets; Accumulate all selected bytes to obtain the byte accumulation value; The data change is calculated according to the byte accumulated value and the proportional factor; the proportional factor is a factor calculated according to the ratio of the first bit value and the second bit value in the byte accumulated value.

13. An electronic device, characterized in that: include: Memory for storing computer programs; A processor, configured to implement the steps of the data transmission method according to any one of claims 11 to 12 when executing the computer program.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the computer program, when executed by a processor, implements the steps of the data transmission method according to any one of claims 11 to 12.

15. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the data transmission method according to any one of claims 11 to 12 are implemented.

Citation Information

Patent Citations

  • Decoupling control method for multi-channel data link transmission between core particles

    CN115794731A

  • Storage-assisted big data multi-path transmission scheduling method

    CN117336231A

  • Data transmission method, system and device, medium and program product

    CN118740747A

  • Data transmission method and related device

    CN118981444A

  • Optimization method for in-memory calculation digital-analog hybrid DNN accelerator for multiple core particles

    CN119067186A