Data transmission system

Abstract

Disclosed in the present application is a data transmission system, which is applied to long-distance transmission of large-data-volume data. The transmission system is provided with a plurality of data transmission subsystems, which are connected by means of a high-bandwidth data transmission link, wherein a data transmission subsystem is further connected to a relatively low-bandwidth data access link, and the data transmission subsystem is further provided with a data temporary storage apparatus, which can cache external data acquired from the data access link. During data transmission, the data transmission subsystem receives external data from the data access link, caches the external data in the data temporary storage apparatus, and then transmits, by means of the high-bandwidth data transmission link, the data cached in the data temporary storage apparatus, so as to ensure that the data transmission link can transmit the cached data in a centralized manner at one time. Therefore, the mutual interference between different data flows is avoided, it is ensured that the bandwidth of the data transmission link has a high utilization rate, and the transmission link sharing is realized, thereby reducing the data transmission cost, and improving the data transmission efficiency.

Description

A data transmission system

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on September 20, 2023, with application number 202311222163.X and application name “A Data Transmission System”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of communication technology, and in particular to a data transmission system. Background Art

[0003] With the advancement of technology and the advent of the big data era, the amount of data that needs to be transmitted over the Internet has exploded. For example, filming data from film and television studios needs to be transmitted to post-production centers for storage and processing. Another example is scientific research data, such as genetic data, meteorological data, or astronomical data, which needs to be transmitted to remote storage or computing centers for processing.

[0004] In big data transmission scenarios, data streams often carry large amounts of data and often travel long distances. For example, in some interprovincial data transmission scenarios, data streams can travel over thousands of kilometers. In scenarios involving large amounts of data and long distances, transmission efficiency is low when data streams are transmitted over existing networks due to limited bandwidth and competition among different data streams for network transmission resources.

[0005] Summary of the Invention

[0006] The present application provides a data transmission system that can ensure high utilization of the bandwidth of the data transmission link, thereby improving data transmission efficiency.

[0007] In a first aspect, the present application provides a data transmission system, comprising: a plurality of data transmission subsystems, wherein the plurality of data transmission subsystems are connected via data transmission links. Any two data transmission subsystems in the data transmission system are directly connected via the data transmission link; alternatively, some data transmission subsystems in the data transmission system are not directly connected via the data transmission link, but are connected via other data transmission subsystems.

[0008] A first data transmission subsystem among the multiple data transmission subsystems is further connected to one or more data access links, and the bandwidth of each data access link is smaller than the bandwidth of the data transmission link to which the first data transmission subsystem is connected. That is, the data transmission rate to the first data transmission subsystem via a single data access link is lower than the data transmission rate via the data transmission link. The first data transmission subsystem is, for example, any one of the multiple data transmission subsystems.

[0009] The first data transmission subsystem includes a data temporary storage device, which is used to buffer data received via the data access link. The first data transmission subsystem is then configured to transmit the data buffered in the data temporary storage device via the connected data transmission link. For example, a user can first inject data into the data temporary storage device of the first data transmission subsystem via the data access link. Once a certain amount of user data has been buffered in the data temporary storage device, the first data transmission subsystem then transmits the user data at high speed via the data transmission link. Alternatively, user data can be directly transmitted at high speed via the data transmission link without buffering.

[0010] In this solution, a data transmission system is provided with multiple data transmission subsystems connected by high-bandwidth data transmission links. The data transmission subsystems are also connected to lower-bandwidth data access links, and the data transmission subsystems are also provided with a data temporary storage device that can cache external data obtained from the data access link. Thus, during the data transmission process, the data transmission subsystem receives external data from the data access link and first caches the external data in the data temporary storage device, and then transmits the data cached in the data temporary storage device via the high-bandwidth data transmission link. Because the data transmission link transmits data cached in the data temporary storage device, the data transmission link can centrally transmit the cached data at one time, avoiding mutual interference between different data streams, ensuring high utilization of the bandwidth of the data transmission link, and thereby improving data transmission efficiency.

[0011] In one possible implementation, the first data transmission subsystem is configured to transmit the target data via the connected data transmission link when the amount of target data cached in the data temporary storage device exceeds a first threshold. The target data includes data belonging to the same data transmission service. The data of the same data transmission service may refer to data requested by the same user and having the same destination address, i.e., data in the same data stream.

[0012] That is to say, for the data in the same data stream, the first data transmission subsystem first caches the data in the data stream through the data temporary storage device, and after the cached data reaches a certain amount of data, it is sent to other data transmission subsystems through the data transmission link, so as to enable the high-bandwidth data transmission link to fully load and transmit the data in the same data stream as much as possible, ensure that the bandwidth of the data transmission link has high utilization, and thus improve the data transmission efficiency.

[0013] In one possible implementation, the first threshold is related to the bandwidth of the data transmission link to which the first data transmission subsystem is connected. Generally speaking, the first threshold and the bandwidth of the data transmission link are positively correlated, i.e., the larger the bandwidth of the data transmission link, the larger the first threshold; and the smaller the bandwidth of the data transmission link, the smaller the first threshold.

[0014] When the amount of data in a single data stream is large, by setting a first threshold related to the bandwidth of the data transmission link, the data within the same data stream can be transmitted intermittently or all at once through the data transmission link. That is, data within the same data stream is continuously transmitted via the data access link to the first data transmission subsystem for caching. The first data transmission subsystem only triggers data transmission when the cached data reaches a certain amount, ensuring that as few data streams as possible are transmitted within the same time period, avoiding mutual interference between data streams, and ensuring that the data transmission link maintains high bandwidth utilization. Furthermore, the data transmission subsystem also supports transmission at a user-specified time point after all user data has been cached.

[0015] In one possible implementation, the data temporary storage device includes multiple data storage devices, each of which is configured to store a portion of target data. The first data transmission subsystem is configured to read the target data from the multiple data storage devices in parallel and transmit the target data via the connected data transmission links. In this manner, the target data read rate of the first data transmission subsystem is effectively the sum of the read rates of the multiple data storage devices, thereby ensuring that the data read rate matches the transmission rate of the data transmission link and preventing the data read rate from affecting the actual data transmission rate.

[0016] In one possible implementation, when the amount of target data is greater than the bandwidth of the data transmission link connected to the first data transmission subsystem, the data transmission link connected to the first data transmission subsystem is only used to transmit the target data during the target data transmission time period.

[0017] In other words, the data transmission link is exclusive during the transmission time period of the target data. The data transmission link only transmits data under the same data transmission service at the same time, ensuring that the data transmission link can fully transmit data under the same data transmission service, avoiding the interference caused by the simultaneous transmission of multiple data streams, and improving the efficiency of data transmission of the data transmission link.

[0018] In one possible implementation, the data access link includes one or more of the following: a wired network access link, a wireless network access link, a dedicated network line access link, and a hard disk access link. In other words, users can access the data transmission subsystem through a variety of different links and select the appropriate link to transmit data to the data transmission subsystem based on actual needs.

[0019] In one possible implementation, when the data access link includes a hard disk access link, the first data transmission subsystem is further configured to read data via the hard disk access link and forward the read data based on the connected data transmission link. In other words, when the first data transmission subsystem has a hard disk access link, the first data transmission subsystem can directly read data from a user-provided hard disk via the hard disk access link and further forward the data read via the hard disk access link via the data transmission link, thereby eliminating the need to cache the read data in a temporary data storage device.

[0020] In one possible implementation, the first data transmission subsystem is further configured to receive data sent by other data transmission subsystems via the connected data transmission link, and forward the data received from the connected data transmission link via the data access link. For example, after receiving data sent by other data transmission subsystems via the data transmission link, the first data transmission subsystem forwards the data received from the other data transmission subsystem via a data access link, such as a wired network access link or a wireless network access link, thereby enabling a user to receive data transmitted by the data transmission system via a data access link, such as a wired network access link or a wireless network access link.

[0021] In one possible implementation, the data temporary storage device is further configured to cache data received by the first data transmission subsystem from the connected data transmission link. In other words, after data transmitted by a user through the data transmission system reaches the destination data transmission subsystem, it can be cached in both the source and destination data transmission subsystems. This allows data to be managed by both the source and destination data transmission subsystems, allowing the user to retrieve the data from the destination data transmission subsystem as needed.

[0022] In one possible implementation, the data transmission system also includes a management and operation system, which is connected to multiple data transmission subsystems respectively; the first data transmission subsystem is used to send a data transmission request to the management and operation system, the data transmission request is used to request the transmission of the first data, and the data transmission request includes the size of the first data and the destination address of the first data; the management and operation system is used to send a data reception request to the second data transmission subsystem based on the data transmission request, the data reception request is used to request the second data transmission subsystem to receive the first data; the management and operation system is also used to send a data transmission instruction to the first data transmission subsystem after receiving the data reception confirmation message returned by the second data transmission subsystem, the data transmission instruction is used to instruct the first data transmission subsystem to transmit the first data.

[0023] In this solution, by setting up a data scheduling center in the data transmission system to schedule data transmission between data transmission subsystems, the data transmission subsystems can more reasonably utilize the data transmission links between each other to transmit data, avoid competition between the data transmission subsystems for data transmission link resources, and effectively ensure that the bandwidth of the data transmission link has high utilization, thereby improving the efficiency of data transmission.

[0024] In one possible implementation, the destination address of the first data includes multiple addresses, for example, the destination address of the first data includes multiple data transmission subsystems. The management and operation system is configured to send data reception requests to the multiple data transmission subsystems based on the data transmission request. That is, the management and operation system sends data reception requests to the multiple data transmission subsystems corresponding to the multiple addresses indicated in the data transmission request, thereby requesting these data transmission subsystems to receive the first data from the first data transmission subsystem. Finally, based on the data reception confirmation messages returned by the multiple data transmission subsystems, the management and operation system can instruct the first data transmission subsystem to send the first data to each of the multiple data transmission subsystems.

[0025] In this solution, based on the data transmission link in the data transmission system, the data received on one data transmission subsystem can be quickly transmitted to multiple other data transmission subsystems, thereby achieving efficient data distribution and meeting the data distribution needs in specific scenarios.

[0026] In one possible implementation, the first data transmission subsystem is further configured to obtain a data transmission instruction issued by a user, the data transmission instruction being used to instruct the transmission of the first data, and the data transmission instruction including the size of the first data, the destination address of the first data, the transmission time point of the first data, the transmission time limit of the first data, and the authorized hosting information of the first data. The transmission time point of the first data refers to the time point at which the first data needs to be transmitted, and the transmission time limit of the first data refers to the time within which the first data needs to be transmitted to the destination address, for example, the first data needs to be transmitted to the destination address within one week. The authorized hosting information of the first data refers to information that the user authorizes the data transmission subsystem to host the first data, thereby ensuring that the source data transmission subsystem and the destination data transmission subsystem of the first data can temporarily host the first data. In addition, the first data transmission subsystem is further configured to determine the transmission priority of the first data based on the transmission time point and the transmission time limit of the first data. Specifically, the shorter the transmission time limit of the first data, the higher the transmission priority of the first data, and the more preferentially the first data transmission subsystem will send a data transmission request for the first data to the management and operation system, thereby ensuring that the first data can be transmitted as quickly as possible.

[0027] In one possible implementation, the data transmission links between the multiple data transmission subsystems are optical transport network (OTN) links with high bandwidth. For example, the bandwidth of any data transmission link may be 100 Gbps, 400 Gbps, 800 Gbps, 1600 Gbps, or the like. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] FIG1 is a schematic structural diagram of a data transmission system provided in an embodiment of the present application;

[0029] FIG2 is a schematic diagram of reading data and transmitting data through a data transmission link according to an embodiment of the present application;

[0030] FIG3 is a comparative schematic diagram of network topologies provided in an embodiment of the present application;

[0031] FIG4 is a schematic structural diagram of a data transmission subsystem provided in an embodiment of the present application;

[0032] FIG5 is a schematic diagram of a data macroblock provided in an embodiment of the present application;

[0033] FIG6 is a schematic diagram of a node routing provided in an embodiment of the present application;

[0034] FIG7 is a schematic diagram of a user submitting data to a data transmission subsystem for transmission according to an embodiment of the present application;

[0035] FIG8 is a schematic diagram of data transmission in a data transmission system provided by an embodiment of the present application;

[0036] FIG9 is a schematic diagram of data transmission in an East-West computing scenario provided by an embodiment of the present application;

[0037] FIG10 is a schematic diagram of data transmission in a data center interconnection scenario provided by an embodiment of the present application;

[0038] FIG11A is a schematic diagram of a traditional digital content distribution method provided by an embodiment of the present application;

[0039] FIG11B is a schematic diagram of a data content distribution system based on a data transmission system according to an embodiment of the present application;

[0040] FIG12 is a schematic structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0041] The following describes the embodiments of the present application in conjunction with the accompanying drawings. Obviously, the embodiments described are only part of the embodiments of the present application, rather than all the embodiments. Those skilled in the art will appreciate that with the development of technology and the emergence of new scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0042] The terms "first," "second," and the like in the specification and claims of this application and the accompanying drawings are used to distinguish similar objects and are not necessarily used to describe a particular order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, such that the embodiments described herein can be practiced in an order other than that shown or described herein.

[0043] In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or device that includes a series of steps or modules is not necessarily limited to those steps or modules explicitly listed, but may include other steps or modules that are not explicitly listed or that are inherent to the process, method, product, or device. The naming or numbering of steps in this application does not mean that the steps in the method flow must be executed in the time / logical sequence indicated by the naming or numbering. The named or numbered process steps can be executed in a different order according to the technical purpose to be achieved, as long as the same or similar technical effects can be achieved.

[0044] With the advancement of technology and the advent of the big data era, the amount of data required to be transmitted over networks has exploded, and increasingly, this data requires long-distance transmission. For example, the newly proposed "East Data, West Computing" concept involves the orderly transmission of data from the eastern part of the country to the western part for computation and processing. Eastern data centers focus on network-intensive services such as the industrial internet, financial securities, disaster warning, telemedicine, video calls, and artificial intelligence reasoning. Western data centers, on the other hand, focus on less demanding services such as back-end processing, offline analysis, and storage backup. The geographical separation of data production and processing will become increasingly common.

[0045] The long-distance transmission of massive amounts of data across regions poses significant challenges to traditional data transmission networks (such as wide area networks). Due to the limited bandwidth of traditional data transmission networks and the high volume of bursty traffic, different data streams compete for network resources and interfere with each other. Therefore, data transmission networks often reserve a certain amount of bandwidth to accommodate bursty traffic and resource competition between data streams. This results in low bandwidth utilization and, consequently, low data transmission efficiency. Furthermore, in long-distance transmission scenarios, large data streams transmitted over traditional data transmission networks often pass through a large number of forwarding devices (such as switches and routers in various regions). These forwarding devices require table lookups when forwarding data, resulting in a high number of table lookups and forwarding operations during transmission, which affects data transmission efficiency. Furthermore, while enterprises can alleviate data transmission efficiency issues to some extent by using dedicated lines to transmit large amounts of data, these networks carry high costs, which are often unaffordable for enterprises.

[0046] Based on this, the present application provides a data transmission system, in which a plurality of data transmission subsystems connected by high-bandwidth data transmission links are provided in the data transmission system, a data access link with a lower bandwidth is also connected to the data transmission subsystem, and a data temporary storage device is also provided on the data transmission subsystem, which can cache the external data obtained from the data access link. In this way, during the data transmission process, the data transmission subsystem receives external data from the data access link, and first caches the external data in the data temporary storage device, and then transmits the data cached in the data temporary storage device through the high-bandwidth data transmission link. Since the bandwidth of the data transmission link is much higher than the bandwidth of the data access link, and the data transmission link transmits the data cached in the data temporary storage device, the data transmission link can centrally transmit the cached data at one time, avoid mutual interference between different data streams, ensure that the bandwidth of the data transmission link always has high utilization, and thus improve the data transmission efficiency.

[0047] The data transmission system provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0048] Please refer to Figure 1, which is a schematic diagram of the structure of a data transmission system provided in an embodiment of the present application. As shown in Figure 1, the data transmission system includes multiple data transmission subsystems, and the multiple data transmission subsystems are connected by data transmission links. For any data transmission subsystem, the data transmission subsystem is, for example, a network device in the form of a cabinet (such as a server or switch), or a device cluster composed of multiple network devices. This embodiment does not specifically limit the form of expression of the data transmission subsystem.

[0049] The data transmission links connecting the data transmission subsystems have high bandwidth, i.e., they are capable of transmitting data at a high rate. For example, the data transmission links between the multiple data transmission subsystems are optical transport network links, i.e., the multiple data transmission subsystems are interconnected via high-speed optical fibers. The bandwidth of any of the data transmission links can be, for example, 100 Gbps, 400 Gbps, 800 Gbps, 1600 Gbps, or the like.

[0050] In some possible embodiments, any two data transmission subsystems in the data transmission system are directly connected via a data transmission link. For example, any data transmission subsystem in the data transmission system is directly connected to any other data transmission subsystem via a data transmission link.

[0051] In other possible embodiments, some data transmission subsystems in the data transmission system are not directly connected via data transmission links, but are connected via other data transmission subsystems. For example, data transmission subsystem 1 is directly connected to data transmission subsystem 2 via data transmission link 1, and data transmission subsystem 2 is directly connected to data transmission subsystem 3 via data transmission link 2. Therefore, data transmission subsystem 1 and data transmission subsystem 3 are actually connected via data transmission subsystem 2.

[0052] Taking the first data transmission subsystem among multiple data transmission subsystems (the first data transmission subsystem can be any data transmission subsystem among the multiple data transmission subsystems) as an example, the first data transmission subsystem is also connected to a data access link, which is used to receive data that needs to be transmitted through the data transmission system. Among them, the bandwidth of the data access link connected to the first data transmission subsystem is smaller than the bandwidth of the data transmission link connected to the first data transmission subsystem. In other words, for the data transmission subsystems in the data transmission system, the data transmission subsystem is connected to the external network through a data access link with lower bandwidth (such as a link in a traditional network) to obtain the data that needs to be transmitted from the external network; while the data transmission subsystems are connected through a data transmission link with higher bandwidth, thereby realizing high-speed transmission of data in the data transmission subsystem.

[0053] In addition, the first data transmission subsystem further includes a data temporary storage device, which is used to cache data received via the data access link, and the first data transmission subsystem is used to transmit the data cached in the data temporary storage device via the connected data transmission link. Because the bandwidth of the data access link to which the first data transmission subsystem is connected is relatively low, while the bandwidth of the data transmission link used by the first data transmission subsystem to transmit data is relatively high, the first data transmission subsystem may first cache the data received from the data access link, and then transmit the data via the data transmission link after the cached data reaches a certain amount. This ensures that the data transmission link can centrally transmit the cached data at one time, avoids mutual interference between different data streams, and ensures high bandwidth utilization of the data transmission link.

[0054] Furthermore, since the first data transmission subsystem is provided with a data temporary storage device, the data temporary storage device can serve as a buffer for burst traffic, thereby injecting a large amount of data to be transmitted in advance, ensuring that the bandwidth of the data transmission link always maintains a high utilization rate, avoiding the phenomenon that the data transmission link is sometimes idle and sometimes congested, thereby ensuring data transmission efficiency.

[0055] After the first data transmission subsystem transmits the data to the destination data transmission subsystem, the destination data transmission subsystem then sends the received data to the actual destination address of the data. For example, the destination data transmission subsystem sends the received data to the destination address specified by the user through the data access link connected to this node.

[0056] Generally speaking, during data transmission, the data transmission subsystem receives external data from the data access link and first caches the external data in a temporary data storage device. The cached data in the temporary data storage device is then transmitted via the high-bandwidth data transmission link. Because the bandwidth of the data transmission link is much higher than that of the data access link, and the data transmission link transmits data cached in the temporary data storage device, the data transmission link can transmit all the cached data at once, avoiding interference between different data streams and ensuring high bandwidth utilization of the data transmission link, thereby improving data transmission efficiency.

[0057] Furthermore, because the data transmission subsystem transmits data cached in the data temporary storage device via a high-bandwidth data transmission link, it can transmit large amounts of data each time, rather than smaller amounts. This allows for the design of a new transmission protocol for the data transmission system, specifically one that utilizes a large-block data transmission mechanism. This allows for data transmission based on larger data packets, further improving data transmission efficiency.

[0058] Optionally, the first data transmission subsystem is configured to transmit the target data via the connected data transmission link when the amount of target data cached by the data temporary storage device exceeds a first threshold, wherein the target data includes data belonging to the same data transmission service. The data of the same data transmission service may refer to data requested for transmission by the same user and having the same destination address, i.e., data in the same data stream.

[0059] That is to say, for the data in the same data stream, the first data transmission subsystem first caches the data in the data stream through the data temporary storage device, and after the cached data reaches a certain amount of data, it is sent to other data transmission subsystems through the data transmission link, so as to enable the high-bandwidth data transmission link to fully load and transmit the data in the same data stream as much as possible, ensure that the bandwidth of the data transmission link has high utilization, and thus improve the data transmission efficiency.

[0060] Optionally, the first threshold is related to the bandwidth of the data transmission link to which the first data transmission subsystem is connected. Generally speaking, the first threshold is positively correlated with the bandwidth of the data transmission link, i.e., the larger the bandwidth of the data transmission link, the larger the first threshold; and the smaller the bandwidth of the data transmission link, the smaller the first threshold.

[0061] Exemplarily, the first threshold value may be a value greater than or equal to the bandwidth of the data transmission link to which the first data transmission subsystem is connected. For example, assuming that the bandwidth of the data transmission link to which the first data transmission subsystem is connected is 100 Gbps, representing that the data transmission link can transmit 100 Gigabytes (G) of data per second, the first threshold value may be 100G, 200G, or 500G, etc., that is, the first threshold value is an integer multiple of the bandwidth of the data transmission link.

[0062] When the amount of data in the same data stream is large, by setting a first threshold related to the bandwidth of the data transmission link, the data in the same data stream can be sent intermittently through the data transmission link. That is, the data in the same data stream is continuously transmitted to the first data transmission subsystem through the data access link for buffering, and the first data transmission subsystem only triggers data transmission when the buffered data reaches a certain amount. In this way, the first data transmission subsystem does not continuously transmit the data of the same data stream through the data transmission link, but intermittently transmits batches of data. For example, assuming that the amount of data in a certain data stream is 1000G, the bandwidth of the data transmission link to which the first data transmission subsystem is connected is 100Gbps, and the first threshold is 100G, then the first data transmission subsystem triggers the transmission of the buffered data through the data transmission link when the buffered amount of data in the data stream reaches 100G. In this way, the first data transmission subsystem transmits the data in the same data stream 10 times through the data transmission link, and the amount of data transmitted each time is 100G, and the transmission time is 1 second.

[0063] In another possible example, the first threshold value may also be related to the data volume of the data transmission service corresponding to the target data. For example, the first threshold value is the same as the data volume of the data transmission service corresponding to the target data, or the first threshold value is slightly smaller than the data volume of the data transmission service corresponding to the target data. In other words, different threshold values ​​may be set for different data transmission services, and the set threshold values ​​are related to the data volume required to be transmitted by the data transmission service itself. In this way, by setting the threshold value for triggering transmission to be equal to or slightly smaller than the data volume of the data transmission service, the data transmission subsystem can transmit the cached data to other data transmission subsystems through the data transmission link after the data belonging to the same data transmission service has been completely cached, thereby ensuring that as few data streams as possible are transmitted in the same time period, avoiding mutual interference between data streams, and ensuring that the data transmission link always maintains high bandwidth utilization.

[0064] Optionally, if the target data volume exceeds the bandwidth of the data transmission link connected to the first data transmission subsystem, the data transmission link connected to the first data transmission subsystem is used only to transmit the target data during the target data transmission time period. That is, the data transmission link is exclusive during the target data transmission time period. The data transmission link only transmits data under the same data transmission service at any given time, ensuring that the data transmission link can fully transmit data under the same data transmission service, avoiding interference caused by the simultaneous transmission of multiple data streams, and improving the data transmission efficiency of the data transmission link.

[0065] Furthermore, because the data read rate is often limited by the performance of the data storage device (e.g., a hard disk), the data read rate from a single data storage device is also limited, and the bandwidth of the data transmission link is often greater than the data storage device's speed. Therefore, in this embodiment, multiple data storage devices can be set up to cache data from the same data stream, and multiple data storage devices can be read in parallel during data transmission, thereby ensuring that the data read rate matches the data transmission rate and avoiding data transmission being affected.

[0066] Exemplarily, the data temporary storage device in the first data transmission subsystem includes multiple data storage devices, each of which is configured to store a portion of the target data. The first data transmission subsystem is configured to read the target data from the multiple data storage devices in parallel and transmit the target data via the connected data transmission link. In this manner, the target data read rate of the first data transmission subsystem is effectively the sum of the read rates of the multiple data storage devices, thereby ensuring that the data read rate matches the transmission rate of the data transmission link and preventing the data read rate from affecting the actual data transmission rate.

[0067] Specifically, refer to FIG2 , FIG2 is a schematic diagram of a method for reading data and transmitting data through a data transmission link provided by an embodiment of the present application. As shown in FIG2 , it is assumed that the data temporary storage device of the first data transmission subsystem includes 5 data storage devices (respectively, data storage device 1-data storage device 5), and the data reading rate of each data storage device is 20Gbps. Moreover, each data storage device stores part of the data under the same data transmission service (for example, each data storage device stores 1 / 5 of the data under the same data transmission service). In this way, when the first data transmission subsystem transmits the data in the data temporary storage device through the data transmission link, the first data transmission subsystem can read data from the 5 data storage devices in parallel, and transmit the read data through the same data transmission link after aggregating them. In this way, since the reading rate of each data storage device is 20Gbps, and the 5 data storage devices read at the same time, when the read data is aggregated into the data transmission link for transmission, the transmission rate of the data transmission link is 100Gbps, ensuring that the transmission rate of the data transmission link can match the bandwidth of the data transmission link itself, ensuring that the data transmission link can fully load the data.

[0068] Optionally, for any data transmission subsystem in the data transmission system, the data access link connected to the data transmission subsystem may include one or more of the following links: a wired network access link, a wireless network access link, a dedicated network line access link, and a hard disk access link.

[0069] The wired network access link may refer to a link that accesses a traditional Internet Protocol (IP) network. Based on the wired network access link, users can send data that needs to be transmitted based on the data transmission system to the data transmission subsystem through the traditional IP network.

[0070] A wireless network access link may refer to a link that accesses a wireless network, such as a link to a satellite or a link to a wireless base station. Based on the wireless network access link, a user can send data that needs to be transmitted via the data transmission system to the data transmission subsystem via a satellite or wireless base station.

[0071] The network dedicated line access link may refer to a link connected to the network dedicated line, that is, the user directly accesses the data transmission subsystem through the network dedicated line, so the user can send data that needs to be transmitted based on the data transmission system to the data transmission subsystem through the network dedicated line.

[0072] A hard drive access link refers to a link that provides a hard drive access port. Users can connect a hard drive to the data transfer subsystem by inserting the hard drive into the hard drive access port. This allows the data transfer subsystem to directly access the data on the user-provided hard drive via the hard drive access link.

[0073] It should be noted that the above is an introduction to the possible types of data access links connected to the data transmission subsystem. For a data transmission subsystem, the data transmission subsystem may be connected to one or more of the above-mentioned types of links, and each type of link may be connected to one or more links. For example, for the first data transmission subsystem, the types of data access links connected to the first data transmission subsystem may include wired network access links, wireless network access links, network dedicated line access links and hard disk access links, and the wired network access links connected to the first data transmission subsystem type may include multiple links, that is, different users can access the first data transmission subsystem through different wired network access links. Specifically, this embodiment does not limit the type and number of data access links connected to the data transmission subsystem.

[0074] Optionally, when the data access link includes a hard disk access link, the first data transmission subsystem is further configured to read data through the hard disk access link and forward the read data based on the connected data transmission link. That is, when the first data transmission subsystem has a hard disk access link, the first data transmission subsystem can directly read data from a hard disk provided by the user through the hard disk access link, and further forward the data read through the hard disk access link through the data transmission link, thereby omitting the operation of caching the read data into a data temporary storage device. Specifically, the first data transmission subsystem may be provided with multiple hard disk access links, and the user may connect multiple hard disks to different hard disk access links, respectively, so that the first data transmission subsystem can read data from multiple hard disks in parallel through multiple hard disk access links, thereby matching the data reading rate with the transmission rate of the data transmission link.

[0075] It should be noted that when the data transmission subsystem has a hard disk access link, if the user transmits data to the data transmission subsystem through the hard disk access link, the user needs to go to the location of the data transmission subsystem and connect the hard disk to the hard disk access link to realize data transmission to the data transmission subsystem.

[0076] The above describes a process in which the first data transmission subsystem receives externally injected data via a data access link and transmits the received data via data transmission links with other data transmission subsystems. In actual applications, the first data transmission subsystem may also receive data sent by other data transmission subsystems via data transmission links and forward the received data to users via data access links.

[0077] Exemplarily, the first data transmission subsystem is further configured to receive data sent by other data transmission subsystems via a data transmission link, and forward data received from the data transmission link via a data access link. For example, after receiving data sent by other data transmission subsystems via a data transmission link, the first data transmission subsystem forwards the data received from the other data transmission subsystem via a data access link, such as a wired network access link or a wireless network access link, thereby enabling a user to receive data transmitted by the data transmission system via a data access link, such as a wired network access link or a wireless network access link.

[0078] Optionally, the data temporary storage device in the first data transmission subsystem is further configured to cache data received by the first data transmission subsystem from the connected data transmission link. In other words, data transmitted by a user through the data transmission system can be cached in the source and destination data transmission subsystems after reaching the destination data transmission subsystem. This enables data to be hosted in the source and destination data transmission subsystems, allowing the user to retrieve data from the source and destination data transmission subsystems as needed.

[0079] For example, when the first data transmission subsystem receives data transmitted by other data transmission subsystems through a data transmission link, the first data transmission subsystem can cache the received data in a data temporary storage device. Then, when the first data transmission subsystem successfully caches data under the same data transmission service, the first data transmission subsystem sends a data retrieval notification to the user, thereby notifying the user to retrieve the data cached in the first data transmission subsystem. In this way, the user can retrieve data from the first data transmission subsystem through the data access link, for example, the user receives the data cached in the first data transmission subsystem through a wired network access link, or the user brings a hard disk to the first data transmission subsystem and copies the data cached in the first data transmission subsystem through the hard disk.

[0080] In some possible embodiments, to facilitate scheduling of data transmission between data transmission subsystems, a management and operation system may be provided in the data transmission system. Furthermore, the management and operation system is connected to each of the multiple data transmission subsystems, i.e., each data transmission subsystem in the data transmission system is connected to multiple data transmission subsystems.

[0081] After the first data transmission subsystem has received and cached the first data to be transmitted via the data access link, the first data transmission subsystem sends a data transmission request to the management and operation system. The data transmission request is used to request the transmission of the first data, and the data transmission request includes the size of the data to be transmitted and the destination address of the first data. The destination address of the first data can refer to the destination data transmission subsystem of the first data, that is, the destination address of the first data is the data transmission subsystem in the data transmission system; the destination address of the first data can also be an IP address on the Internet (such as the IP address specified by the user when transmitting the first data to the first data transmission subsystem).

[0082] After obtaining the data transmission request, the management operation system sends a data reception request to the second data transmission subsystem based on the data transmission request. The data reception request is used to request the second data transmission subsystem to receive the first data. The data reception request can be used to indicate the size of the first data, so that the second data transmission subsystem can prepare sufficient cache space for the first data based on the size of the first data. It should be noted that when the destination address of the first data is the destination data transmission subsystem, the second data transmission subsystem is the destination data transmission subsystem of the first data; when the destination address of the first data is an IP address on the Internet, the second data transmission subsystem can be a data transmission subsystem determined by the management operation system that can reach the destination address of the first data.

[0083] After preparing the buffer space for receiving the first data based on the data reception request, the second data transmission subsystem may return a data reception confirmation message to the management and operation system. This data reception confirmation message indicates that the second data transmission subsystem confirms that it can receive the first data. In this way, the management and operation system is further configured to, upon receiving the data reception confirmation message returned by the second data transmission subsystem, send a data transmission instruction to the first data transmission subsystem. This data transmission instruction instructs the first data transmission subsystem to transmit the first data.

[0084] Optionally, the data transmission instruction is further used to indicate a time period for the first data transmission subsystem to transmit the first data, that is, within what time period the first data transmission subsystem needs to transmit the first data.

[0085] Specifically, the management and operation system is responsible for scheduling data transmission in the entire data transmission system. In addition to the first data transmission subsystem requesting data transmission from the management and operation system, there may be other data transmission subsystems requesting data transmission from the management and operation system, and the data transmission links requested by other data transmission subsystems to transmit data may be the same as the data transmission links requested by the first data transmission subsystem to transmit data. Based on this, the management and operation system can determine the time period for each data transmission subsystem to use a specific data transmission link to transmit data based on the data transmission situation in the actual scenario (such as the data transmission subsystem requesting data transmission and the priority of the data requested by each data transmission subsystem), thereby ensuring that the data transmission link can be exclusive to a specific data transmission subsystem in each time period as much as possible, so as to improve the bandwidth utilization of the data transmission link.

[0086] In general, by setting up a data scheduling center in the data transmission system to schedule data transmission between data transmission subsystems, the data transmission subsystems can more reasonably utilize the data transmission links between each other to transmit data, avoid competition for data transmission link resources between the data transmission subsystems, and effectively ensure that the bandwidth of the data transmission link has high utilization, thereby improving the efficiency of data transmission.

[0087] In some possible embodiments, the destination address of the first data requested to be transmitted by the first data transmission subsystem includes multiple addresses, for example, the destination address of the first data includes multiple data transmission subsystems. Then, after receiving the data transmission request, the management operation system sends a data reception request to the multiple data transmission subsystems based on the multiple addresses indicated in the data transmission request. That is, the management operation system sends a data reception request to the multiple data transmission subsystems corresponding to the multiple addresses indicated in the data transmission request, thereby requesting these data transmission subsystems to receive the first data from the first data transmission subsystem. Finally, the management operation system can instruct the first data transmission subsystem to send the first data to the multiple data transmission subsystems respectively based on the data reception confirmation messages returned by the multiple data transmission subsystems.

[0088] It is understandable that this solution, based on the data transmission link in the data transmission system, can quickly transmit data received on one data transmission subsystem to multiple other data transmission subsystems, thereby achieving efficient data distribution and meeting the data distribution needs in specific scenarios. For example, in a movie distribution scenario, a movie distribution company needs to distribute movies to cinemas in various cities. In this case, the movie distribution company can pre-transmit the digital content of the movie to a data transmission subsystem closest to the movie distribution company, and then use this data transmission subsystem to distribute the digital content of the movie to data transmission subsystems deployed in various cities. The cinemas in each city can then retrieve the digital content of the movie from the nearest data transmission subsystem, achieving efficient distribution of the digital content of the movie.

[0089] For ease of understanding, the data transmission system provided in the embodiments of the present application will be described in detail below with reference to specific examples.

[0090] Please refer to Figure 3, which is a comparative diagram of the network topology provided by the embodiment of the present application. As shown in Figure 3, the network topology shown on the left side of Figure 3 is the existing IP network topology, and the network topology shown on the right side of Figure 3 is the network topology of the data transmission system provided by this solution.

[0091] Specifically, the existing IP network topology is designed for connectivity, primarily for the transmission of small amounts of data such as text, voice, and video, emphasizing real-time performance, low latency, and determinism. However, when it comes to transmitting large amounts of data, this existing IP network topology no longer meets the requirements. The existing IP network topology is essentially a tree-like networking model, requiring a large number of different types of network devices to form the network for data forwarding, such as access devices, switches, routers, and transmission equipment. Consequently, data transmission over long distances undergoes multiple intermediate protocol conversions and table lookups across numerous forwarding devices. Furthermore, different data streams compete for bandwidth resources, resulting in low network bandwidth utilization and low data transmission efficiency.

[0092] Based on this, the data transmission system provided by this solution features a more streamlined network topology, reducing the number of network node hops and enabling direct data transmission at the physical path layer. Specifically, the data transmission subsystems within the data transmission system are directly connected via backbone optical fibers, with bandwidths reaching 100G, 400G, 800G, or 1600G.

[0093] Generally speaking, data transmission subsystems are primarily deployed in areas where data is centrally transmitted, and where data flows can reach hundreds of gigabytes or more. This means the data transmission subsystem is capable of aggregated data transmission. For example, data transmission subsystems are deployed in cities like Beijing, Shanghai, Shenzhen, Guangzhou, Hangzhou, and Guiyang, where large amounts of data are centrally transmitted. Furthermore, the size of the data transmission subsystem can be adjusted based on data volume. For example, the data transmission subsystem can be deployed in a cluster or as a single device.

[0094] Furthermore, because a data transmission system aggregates large amounts of data into a data transmission subsystem, which then transmits this aggregated data to other data transmission subsystems via high-speed data transmission links, the data transmission subsystem effectively aggregates data and then transmits it centrally. This is similar to the concept of a port in transportation, and therefore can also be referred to as a "data port."

[0095] For example, please refer to Figure 4, which is a schematic diagram of the structure of a data transmission subsystem provided in an embodiment of the present application. As shown in Figure 4, the data transmission subsystem in the data transmission system includes multiple components: a data access component, a data directory, a node routing component, a data pool, and a data scheduling component.

[0096] The data access component is a component that provides a data access link and is responsible for managing data access, and can provide a variety of data access methods for the data transmission subsystem through the data access link. Specifically, the method of data accessing the data transmission subsystem may include, for example, a traditional IP network, that is, slowly injecting data into the data pool of the data transmission subsystem through the IP network. The method of data accessing the data transmission subsystem may also include, for example, network dedicated line access, satellite access, wireless base station access, hard disk access, and Gigabit Capable Passive Optical Network (GPON) and other access methods (i.e., the data access link in the above embodiment). Generally speaking, the access bandwidth of the data access method provided by the data access component is lower than the bandwidth of the link between the data transmission subsystems. Therefore, the data injected into the data transmission subsystem through the data access component needs to be cached in the data pool of the data transmission subsystem, and after the data is sufficient to support the link bandwidth between the data transmission subsystems, the intermittent mode of data transmission is started.

[0097] The data directory is a component that manages data in the data transmission subsystem. It mainly includes local management systems such as data size, data storage location, data encryption, and data compression, which is similar to a file system. Specifically, the data directory receives data injected by the data access component and allocates data macroblocks for the data in the data pool, thereby storing the data in the data pool. The data directory also manages the data pool, provides data address handles for data scheduling, and realizes high-speed data transmission. In addition, the data directory also provides data access permission control, that is, only authorized users are allowed to access the data cached in the data pool; the data directory also provides data lifecycle management, that is, monitoring the cache length of the data and regularly deleting data that has reached a certain cache length.

[0098] The data pool is an area in the data transmission subsystem used to cache data (i.e., the data temporary storage device in the above embodiment). It is essentially a network-based cluster storage pool. The data pool is actually composed of multiple data macroblocks. The size of a data macroblock can be in units of 1GB, 10GB, 100GB, or even larger data volumes. In addition, a data macroblock is a logical concept. A data macroblock is actually composed of multiple physical storage units, and multiple physical storage units can be deployed on different physical nodes. That is, multiple physical storage units are located on different data storage devices, and each physical storage unit can be a part of the storage unit on the data storage device to which it belongs. In this way, a data macroblock can realize data reading and writing in parallel, providing high-speed data writing and data reading rates.

[0099] Specifically, the definition of a data macroblock may include: storage node, input / output (IO) rate, IO concurrency rate, and data block size. For example, please refer to Figure 5, which is a schematic diagram of a data macroblock provided in an embodiment of the present application. As shown in Figure 5, the data macroblock has three storage areas (data block 1, data block 2, and data block 3), and these three storage areas are located at node 1, node 2, and node 3, respectively. When the data in the data macroblock needs to be sent, data can be read and written synchronously from node 1, node 2, and node 3 in parallel to achieve high-speed data movement. The read rate of each node in node 1, node 2, and node 3 is 10Gbps. By reading the three nodes in parallel, the parallel read rate of the data macroblock can be 10Gbps*3=30Gbps. In general, in the data pool, by setting the data macroblock to be composed of physical storage units on multiple different physical nodes, data can be aggregated step by step to ensure that the read rate of the entire data macroblock is consistent with the transmission rate of the data transmission link.

[0100] Node routing is responsible for managing and scheduling routing management between data transmission subsystems, configuring routes to each data transmission subsystem, and achieving direct access between the source data transmission subsystem and the destination data transmission subsystem. For example, please refer to Figure 6, which is a schematic diagram of a node routing provided in an embodiment of the present application. As shown in Figure 6, each data transmission subsystem can be represented by a specific number, IP address or character string, etc.; and the node routing can record the output port from the current data transmission subsystem to any other data transmission subsystem to indicate the path of data transmission. In general, node routing needs to maintain information similar to a routing table and a scheduling mechanism for large time slices to complete the planning of the transmission path. The reachability between data transmission subsystems is achieved through the local routing table maintained by each data transmission subsystem.

[0101] Data scheduling refers to the reading and writing of data based on the optical network status and the data macroblock information provided by the data directory, completing the conversion from data readout to network protocol. Generally speaking, the data scheduling module includes data reading, data transmission, and data transmission reliability processing. It also involves the coordinated interaction between the data scheduling modules of the current data transmission subsystem and the destination data transmission subsystem to complete the data movement to the designated data area on the other end.

[0102] The above describes the composition of the data transmission subsystem. The following describes the process of injecting external data into the data transmission subsystem and transmitting the data in the data transmission system through the data transmission subsystem.

[0103] For example, please refer to Figure 7, which is a schematic diagram of a user submitting data to a data transmission subsystem for transmission provided in an embodiment of the present application. As shown in Figure 7, a user who needs to transmit data through a data transmission system can inject the data to be transmitted into the data transmission subsystem through the data access method provided by the data transmission subsystem, and submit the data transmission request to the data transmission subsystem. Among them, the data transmission request may include, for example: the amount of data to be transmitted, the data destination, the time limit requirement for data transmission (i.e., how long the data transmission needs to be completed) and the data continuity requirement (i.e., how long the data needs to be retained after arriving at the destination data transmission subsystem).

[0104] Upon receiving a user's data transmission request, the data transmission subsystem first allocates storage resources in the data pool for the user's data to be transmitted, and then receives the data injected into the data transmission subsystem through the data access link. After the user's data is fully injected into the data transmission subsystem, the data scheduling component in the data transmission subsystem can apply for a transmission link through the management and operation system based on the user's data transmission request and the status of the optical fiber network. This will then open up the physical network channel and begin data transmission.

[0105] For example, please refer to Figure 8, which is a schematic diagram of data transmission in a data transmission system provided by an embodiment of the present application. As shown in Figure 8, the process of transmitting user-submitted data in the data transmission system includes the following steps 1 to 7.

[0106] Step 1: The user sends a data transmission request to data transmission subsystem A. The data transmission request may include: the destination data transmission subsystem of the data, the data size, the data transmission time requirement, the data access method (such as IP network, dedicated network line or vehicle-mounted disk array, etc.), the data retention period, and whether the data is authorized for use by a third party.

[0107] In step 2, based on the user's data transmission request, data transmission subsystem A determines whether it can accept the user's data transmission request. If data transmission subsystem A accepts the user's data transmission request, it allocates storage resources in the data pool for the user's data to be transmitted and returns a response message to the user, informing the user to transfer the data to data transmission subsystem A.

[0108] In step 3, after receiving the response message from data transmission subsystem A, the user can transmit the required data to data transmission subsystem A through the data access link provided by data transmission subsystem A. For example, the user can send data to the data transmission subsystem via an IP network or dedicated network line; or the user can drive to the location of data transmission subsystem A and connect the vehicle's hard disk array to the hard disk access link provided by data transmission subsystem A, thereby injecting data into data transmission subsystem A.

[0109] In step 4, when the data requested by the user is completely or nearly completely injected into the data pool of data transmission subsystem A, data transmission subsystem A sends a data transmission request to the management and operation system. This data transmission request includes information such as the destination data transmission subsystem (e.g., data transmission subsystem B), the data size, and data processing permissions. After receiving the data transmission request, the management and operation system sends a data reception request to data transmission subsystem B, requesting that data transmission subsystem B allocate storage space for the data to be transmitted.

[0110] In step 5, after allocating storage space for the data, data transmission subsystem B can send a data reception confirmation message to the management and operation system and data transmission subsystem A, indicating that data transmission subsystem B is ready to receive data. The management and operation system can then send a data transmission instruction to data transmission subsystem A according to the scheduling policy, instructing data transmission subsystem A to transmit the data. The data transmission instruction can also specify the time period for data transmission subsystem A to transmit the data.

[0111] In step 6, data transmission subsystem A initiates data transmission, transferring the data cached in the data pool to data transmission subsystem B. During data transmission, data transmission is scheduled using data macroblocks as the unit; data retransmission and multipath transmission are scheduled using data blocks as the unit. Specifically, after receiving each data macroblock, data transmission subsystem B initiates a data integrity check. If a data block is lost, a retransmission request is issued, thereby retransmitting a new data block, avoiding the need to retransmit the entire data macroblock. A data macroblock is the basic unit of data scheduling between data transmission subsystems. Multiple data macroblocks constitute a user transmission task, and a data macroblock must be transmitted within a time slice.

[0112] In addition, the data pools (i.e., data temporary storage devices) in data transmission subsystem A and data transmission subsystem B use high-speed storage devices, which can convert the data transfer process between traditional central processing units (CPUs) into data transfer between high-speed storage devices, and can even use direct data transfer between media to improve data transmission efficiency.

[0113] In step 7, after the data transmission is completed, the data pool of data transmission subsystem B caches the data transmitted by data transmission subsystem A. Data transmission subsystem B can send a data retrieval notification to the user, thereby notifying the user to retrieve the data cached in data transmission subsystem B. For example, the user can retrieve the data from data transmission subsystem B through a data access link in data transmission subsystem B (e.g., an IP network, a network, or a hard disk access link).

[0114] In addition, after the user retrieves data from the data transmission subsystem B, the data transmission subsystem B may also perform operations such as data storage, deletion, and distribution based on the user's configuration, which is not specifically limited in this embodiment.

[0115] The following describes specific application scenarios in which data transmission is implemented using the data transmission system provided by this embodiment.

[0116] Please refer to Figure 9, which is a schematic diagram of data transmission in an East-West Computing scenario provided by an embodiment of the present application. In the specific scenario of East-West Computing, the data generated in the eastern city often needs to be moved to the data center in the western city for calculation. As shown in Figure 9, the user can inject a large amount of data that needs to be transmitted into the data transmission subsystem A through a network mode (such as an IP network or a dedicated network line) or a vehicle-mounted hard disk mode, so that the data transmission subsystem A can cache a data copy 1. Then, the data transmission subsystem A can send the cached data copy 1 to the destination data transmission subsystem (such as data transmission subsystem C) according to the user's data transmission requirements. The data transmission subsystem C receives the data sent by the data transmission subsystem A and caches it to obtain a data copy 3. In this way, the user can retrieve data from the data transmission subsystem C through the network mode or the vehicle-mounted hard disk mode in the data transmission subsystem C.

[0117] Moreover, during the data transmission process in the data transmission system, the data transmission subsystems along the way (such as data transmission subsystem B between data transmission subsystem A and data transmission subsystem C) can back up the data, that is, obtain data copy 2, so that data copy 2 can be used in the area where data transmission subsystem B is located.

[0118] Please refer to Figure 10, which is a schematic diagram of data transmission in a data center interconnection scenario provided by an embodiment of the present application. As shown in Figure 10, in the data center interconnection scenario, the data transmission subsystem is mainly deployed at the edge of the data center and interconnected with the data transmission subsystem of the remote data center. In this scenario, the data transmission subsystem can be only a data scheduling component, the data pool can be a reused memory pool and hard disk area currently available in the data center, and the data directory can be deployed to the CPU of the computing area. In this way, the data that needs to be transmitted between data centers is first synchronized to the data pool in the memory area, and then dispatched from the data pool to the data transmission center for transmission.

[0119] Please refer to Figures 11A and 11B. Figure 11A is a schematic diagram of a traditional digital content distribution provided in an embodiment of the present application; Figure 11B is a schematic diagram of a data content distribution based on a data transmission system provided in an embodiment of the present application. As shown in Figure 11A, in the traditional digital content distribution process, such as the distribution of digital movies to various cities, a digital movie is about 200G or more, and is mainly distributed through satellites and mobile hard disks. Among them, the satellite distribution method has certain limitations. For example, the construction of a satellite receiving station in a cinema may be subject to property restrictions, resulting in some cinemas being unable to receive digital movies via satellite; in addition, the satellite distribution method is greatly affected by the climate, and it is a one-way transmission with a low bandwidth. The mobile hard disk distribution method requires a large number of mobile hard disks to copy digital movies and send them by express delivery. As the number of cinemas increases, more mobile hard disks are needed to copy digital movies, which is inefficient and cannot be fully digitized.

[0120] As shown in FIG11B , when the data transmission system provided by the embodiment of the present application is used to distribute digital content, the content distribution company only needs to transmit the digital content to the nearest data transmission subsystem. The data transmission subsystem can then, based on the authorization of the content distribution company, transmit the digital content to one or more designated data transmission subsystems, such as the data transmission subsystem in each provincial capital city nationwide. In this way, more than 200G of digital content can be distributed to each data transmission subsystem within a few minutes. In this way, the data transmission subsystem that receives the digital content then distributes the digital content locally step by step, thereby quickly distributing the digital content to the designated destination, such as distributing the digital content to movie theaters in each city.

[0121] Please refer to Figure 12, which is a structural diagram of an electronic device provided in an embodiment of the present application. The electronic device 1200 shown in Figure 12 can be, for example, the data transmission subsystem in the above-mentioned embodiment. Specifically, the electronic device 1200 includes: a transceiver 1201, a processor 1202 and a memory 1203 (wherein the number of processors 1202 in the electronic device 1200 can be one or more, and Figure 12 takes one processor as an example), wherein the processor 1202 may include an application processor 12021 and a communication processor 12022. In some embodiments of the present application, the transceiver 1201, the processor 1202 and the memory 1203 may be connected via a bus or other means.

[0122] Memory 1203 may include read-only memory and random access memory, and provides instructions and data to processor 1202. A portion of memory 1203 may also include non-volatile random access memory (NVRAM). Memory 1203 stores processor and operation instructions, executable modules, or data structures, or subsets or extended sets thereof. The operation instructions may include various operation instructions for implementing various operations.

[0123] Processor 1202 controls the operation of the electronic device. In specific applications, the various components of the electronic device are coupled together via a bus system. In addition to a data bus, the bus system may also include a power bus, a control bus, and a status signal bus. However, for clarity, all bus systems are referred to as a bus system in the figure.

[0124] The methods disclosed in the above embodiments of the present application can be applied to or implemented by processor 1202. Processor 1202 can be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be completed by hardware integrated logic circuits or software instructions in processor 1202. The above processor 1202 can be a general-purpose processor, a digital signal processor (DSP), a microprocessor, or a microcontroller, and can further include an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The processor 1202 can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present application. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in conjunction with the embodiments of the present application can be directly implemented as being executed by a hardware decoding processor, or can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium well-known in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, etc. The storage medium is located in memory 1203, and processor 1202 reads the information in memory 1203 and, in conjunction with its hardware, completes the steps of the above method.

[0125] Transceiver 1201 (e.g., a network card) can be used to receive input digital or character information and generate signal input related to the relevant settings and function control of the electronic device. Transceiver 1201 can also be used to output digital or character information through the first interface; and send instructions to the disk group through the first interface to modify the data in the disk group. Transceiver 1201 can also include a display device such as a display screen.

[0126] Through the description of the above implementation methods, those skilled in the art can clearly understand that the present application can be implemented by means of software plus necessary general-purpose hardware, and of course can also be implemented by dedicated hardware including application-specific integrated circuits, dedicated CPUs, dedicated memories, dedicated components, etc. In general, all functions performed by computer programs can be easily implemented with corresponding hardware, and the specific hardware structures used to implement the same function can also be diverse, such as analog circuits, digital circuits, or dedicated circuits. However, for the present application, software program implementation is a better implementation method in most cases. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a readable storage medium, such as a computer's floppy disk, USB flash drive, mobile hard disk, ROM, RAM, magnetic disk or optical disk, etc., and includes a number of instructions for enabling a computer device to execute the methods described in each embodiment of the present application.

[0127] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.

[0128] It should be understood that “one embodiment” or “an embodiment” mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, “in one embodiment” or “in an embodiment” appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in the various embodiments of the present application, the size of the sequence numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0129] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0130] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0131] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0132] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0133] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0134] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

Claims

1. A data transmission system, characterized in that: include: A plurality of data transmission subsystems, wherein the plurality of data transmission subsystems are connected via data transmission links; The first data transmission subsystem among the multiple data transmission subsystems is also connected to a data access link data transmission subsystem; The first data transmission subsystem includes a data temporary storage device, which is used to cache data received through the data access link, and the first data transmission subsystem is used to send the data cached in the data temporary storage device through the connected data transmission link.

2. The system according to claim 1, characterized in that The first data transmission subsystem is used to send the target data through the connected data transmission link when the amount of target data cached by the data temporary storage device is greater than a first threshold, and the target data includes data belonging to the same data transmission service.

3. The system according to claim 2, characterized in that The data temporary storage device includes multiple data storage devices, each of the multiple data storage devices is used to store part of the target data, and the first data transmission subsystem is used to read the target data from the multiple data storage devices in parallel and transmit the target data through the connected data transmission link.

4. The system according to claim 2 or 3, characterized in that: The first threshold is related to the bandwidth of a data transmission link to which the first data transmission subsystem is connected.

5. The system according to any one of claims 2 to 4, characterized in that: When the amount of the target data is greater than the bandwidth of the data transmission link to which the first data transmission subsystem is connected, the data transmission link to which the first data transmission subsystem is connected is only used to transmit the target data during the time period of the target data transmission.

6. The system according to any one of claims 1 to 5, characterized in that: The data transmission system further comprises a management and operation system, and the management and operation system is respectively connected to the plurality of data transmission subsystems; The first data transmission subsystem is used to send a data transmission request to the management and operation system, wherein the data transmission request is used to request the transmission of first data, and the data transmission request includes the size of the first data and the destination address of the first data; The management and operation system is used to send a data receiving request to the second data transmission subsystem based on the data transmission request, and the data receiving request is used to request the second data transmission subsystem to receive the first data; The management and operation system is further configured to send a data transmission instruction to the first data transmission subsystem after receiving a data reception confirmation message returned by the second data transmission subsystem, wherein the data transmission instruction is configured to instruct the first data transmission subsystem to transmit the first data.

7. The system according to claim 6, characterized in that The destination address of the first data includes a plurality of addresses; The management and operation system is used to send data receiving requests to multiple data transmission subsystems based on the data transmission request.

8. The system according to claim 6 or 7, characterized in that: The first data transmission subsystem is further used to obtain a data transmission instruction issued by a user, the data transmission instruction is used to instruct the transmission of the first data, and the data transmission instruction includes the size of the first data, the destination address of the first data, the transmission time point of the first data, the transmission time limit of the first data, and the authorization trusteeship information of the first data; The first data transmission subsystem is further used to determine the transmission priority of the first data based on the transmission time point and the transmission time limit.

9. The system according to any one of claims 6 to 8, characterized in that: The second data transmission subsystem is further used to send a data retrieval notification after receiving the first data, wherein the data retrieval notification is used to instruct a user to retrieve the first data from the second data transmission subsystem.

10. The system according to any one of claims 1 to 9, characterized in that: The data transmission links between the multiple data transmission subsystems are optical transport network (OTN) links.

11. The system according to any one of claims 1 to 10, characterized in that: The data access link includes one or more of the following links: a wired network access link, a wireless network access link, a network dedicated line access link, and a hard disk access link.

12. The system according to claim 11, characterized in that In the case where the data access link includes the hard disk access link, the first data transmission subsystem is further configured to read data through the hard disk access link and forward the read data based on the connected data transmission link.

13. The system according to any one of claims 1 to 12, characterized in that: The first data transmission subsystem is further configured to receive data sent by other data transmission subsystems via the connected data transmission link, and forward data received from the connected data transmission link via the data access link.

14. The system according to claim 13, characterized in that The data temporary storage device is also used to buffer data received from the data transmission link connected to the first data transmission subsystem.

15. The system according to any one of claims 1 to 14, characterized in that: The bandwidth of the data access link is smaller than the bandwidth of the data transmission link connected to the first data transmission subsystem.

Images