Data transmission system

Abstract

The invention discloses a data transmission system which is applied to long-distance transmission of a large amount of data. A plurality of data transmission subsystems connected through a high-bandwidth data transmission link are arranged in the data transmission system, each data transmission subsystem is further connected with a low-bandwidth data access link, and a data temporary storage device is further arranged on each data transmission subsystem and can cache external data obtained from the data access links. In the data transmission process, the data transmission subsystem receives the external data from the data access link, caches the external data to the data temporary storage device, and then transmits the data cached in the data temporary storage device through the high-bandwidth data transmission link, so that the data transmission link can transmit the cached data in a centralized manner at one time; mutual interference between different data streams is avoided, it is ensured that the bandwidth of a data transmission link has a high utilization rate, transmission link sharing is achieved, the data transmission cost is reduced, and then the data transmission efficiency is improved.

Description

Technical Field

[0001] The present application relates to the field of communication technology, and in particular to a data transmission system. Background Art

[0002] With the development of science and technology and the advent of the big data era, the amount of data that needs to be transmitted on the network has exploded. For example, the shooting data of a film and television base needs to be transmitted to a post-production center for storage and processing; for another example, scientific research data such as genetic data, meteorological data or astronomical data needs to be transmitted to a storage center or computing center in a different place for processing.

[0003] In large data transmission scenarios, the data volume of data streams is often large, and the transmission distance of data streams may also be relatively long. For example, in some cross-provincial data transmission scenarios, the transmission distance of data streams may be more than a thousand kilometers. In large data volume and long-distance transmission scenarios, when data streams are transmitted through existing networks, the network bandwidth is limited, and different data streams will compete with each other for network transmission resources, resulting in low data flow transmission efficiency. Summary of the invention

[0004] The present application provides a data transmission system, which can ensure that the bandwidth of the data transmission link has high utilization rate, thereby improving the data transmission efficiency.

[0005] The first aspect of the present application provides a data transmission system, including: a plurality of data transmission subsystems, and the plurality of data transmission subsystems are connected through a data transmission link. Wherein, any two data transmission subsystems in the data transmission system are directly connected through the data transmission link; or, some data transmission subsystems in the data transmission system are not directly connected through the data transmission link, but are connected through other data transmission subsystems.

[0006] The first data transmission subsystem among the multiple data transmission subsystems is also connected to one or more data access links, and the bandwidth of each data access link is smaller than the bandwidth of the data transmission link to which the first data transmission subsystem is connected. That is, the rate of transmitting data to the first data transmission subsystem through a single data access link is lower than the rate of transmission through the data transmission link. The first data transmission subsystem is, for example, any one of the multiple data transmission subsystems.

[0007] The first data transmission subsystem includes a data temporary storage device, which is used to cache data received through the data access link, and the first data transmission subsystem is used to send the data cached in the data temporary storage device through the connected data transmission link. For example, the user can first inject data into the data temporary storage device of the first data transmission subsystem through the data access link; after the user data cached in the data temporary storage device reaches a certain amount, the first data transmission subsystem then transmits the user data at high speed through the data transmission link. In addition, user data can also be directly transmitted at high speed through the data transmission link without caching.

[0008] In this solution, a plurality of data transmission subsystems connected by high-bandwidth data transmission links are provided in the data transmission system, and a data access link with a lower bandwidth is also connected to the data transmission subsystem, and a data temporary storage device is also provided on the data transmission subsystem, which can cache the external data obtained from the data access link. In this way, during the data transmission process, the data transmission subsystem receives external data from the data access link, and first caches the external data in the data temporary storage device, and then transmits the data cached in the data temporary storage device through the high-bandwidth data transmission link. Since the data transmission link transmits the data cached in the data temporary storage device, the data transmission link can centrally transmit the cached data at one time, avoid mutual interference between different data streams, ensure that the bandwidth of the data transmission link has high utilization, and thus improve the data transmission efficiency.

[0009] In a possible implementation, the first data transmission subsystem is used to send the target data through the connected data transmission link when the amount of target data cached by the data temporary storage device is greater than a first threshold, and the target data includes data belonging to the same data transmission service. The data of the same data transmission service may refer to data requested for transmission by the same user and having the same destination address, that is, data in the same data stream.

[0010] That is to say, for the data in the same data stream, the first data transmission subsystem first caches the data in the data stream through the data temporary storage device, and after the cached data reaches a certain amount of data, it is sent to other data transmission subsystems through the data transmission link, so as to enable the high-bandwidth data transmission link to fully load and transmit the data in the same data stream as much as possible, ensuring that the bandwidth of the data transmission link has a high utilization rate, thereby improving the data transmission efficiency.

[0011] In a possible implementation, the first threshold is related to the bandwidth of the data transmission link to which the first data transmission subsystem is connected. Generally speaking, the first threshold is positively correlated with the bandwidth of the data transmission link, that is, the larger the bandwidth of the data transmission link, the larger the first threshold; the smaller the bandwidth of the data transmission link, the smaller the first threshold.

[0012] When the amount of data in the same data stream is large, by setting a first threshold value related to the bandwidth of the data transmission link, the data in the same data stream can be sent intermittently through the data transmission link or transmitted all at once through the data transmission link. That is, the data in the same data stream is continuously transmitted to the first data transmission subsystem through the data access link for caching, and the first data transmission subsystem triggers the transmission of data only when the cached data reaches a certain amount, ensuring that as few data streams as possible are transmitted in the same period, avoiding mutual interference between data streams, and ensuring that the data transmission link always maintains high bandwidth utilization. At the same time, the data transmission subsystem also supports transmission at the user-specified time point after all user data is cached.

[0013] In a possible implementation, the data temporary storage device includes multiple data storage devices, each of which is used to store part of the target data, and the first data transmission subsystem is used to read the target data from the multiple data storage devices in parallel and transmit the target data through the connected data transmission link. In this way, the rate at which the first data transmission subsystem reads the target data is actually the sum of the reading rates of the multiple data storage devices, thereby ensuring that the data reading rate can match the transmission rate of the data transmission link, and avoiding the data reading rate affecting the actual data transmission rate.

[0014] In a possible implementation, when the amount of target data is greater than the bandwidth of the data transmission link connected to the first data transmission subsystem, the data transmission link connected to the first data transmission subsystem is only used to transmit the target data during the target data transmission time period.

[0015] That is to say, the data transmission link is exclusive during the transmission time period of the target data. The data transmission link only transmits data under the same data transmission service at the same time, ensuring that the data transmission link can fully transmit data under the same data transmission service, avoiding the interference caused by the simultaneous transmission of multiple data streams, and improving the efficiency of data transmission of the data transmission link.

[0016] In a possible implementation, the data access link includes one or more of the following links: a wired network access link, a wireless network access link, a network dedicated line access link, and a hard disk access link. That is, the user can access the data transmission subsystem through a variety of different links, and thus select a corresponding link according to actual needs to transmit data to the data transmission subsystem.

[0017] In a possible implementation, when the data access link includes a hard disk access link, the first data transmission subsystem is further used to read data through the hard disk access link and forward the read data based on the connected data transmission link. That is, when the first data transmission subsystem has a hard disk access link, the first data transmission subsystem can directly read data from the hard disk provided by the user through the hard disk access link, and further forward the data read through the hard disk access link through the data transmission link, thereby omitting the operation of caching the read data to the data temporary storage device.

[0018] In a possible implementation, the first data transmission subsystem is also used to receive data sent by other data transmission subsystems through the connected data transmission link, and forward the data received from the connected data transmission link through the data access link. For example, after the first data transmission subsystem receives data sent by other data transmission subsystems through the data transmission link, it forwards the data received from other data transmission subsystems through data access links such as wired network access links or wireless network access links, so that users can receive data transmitted through the data transmission system from data access links such as wired network access links or wireless network access links.

[0019] In a possible implementation, the data temporary storage device is also used to cache the data received by the first data transmission subsystem from the connected data transmission link. That is to say, after the data transmitted by the user through the data transmission system reaches the destination data transmission subsystem, it can also be cached in the source and destination data transmission subsystems, that is, the data is managed in the source and destination data transmission subsystems, so that the user can retrieve it from the destination data transmission subsystem as needed.

[0020] In one possible implementation, the data transmission system also includes a management and operation system, which is connected to multiple data transmission subsystems respectively; the first data transmission subsystem is used to send a data transmission request to the management and operation system, the data transmission request is used to request the transmission of first data, and the data transmission request includes the size of the first data and the destination address of the first data; the management and operation system is used to send a data reception request to the second data transmission subsystem based on the data transmission request, the data reception request is used to request the second data transmission subsystem to receive the first data; the management and operation system is also used to send a data transmission instruction to the first data transmission subsystem after receiving a data reception confirmation message returned by the second data transmission subsystem, the data transmission instruction is used to instruct the first data transmission subsystem to transmit the first data.

[0021] In this scheme, by setting up a data scheduling center in the data transmission system to schedule data transmission between data transmission subsystems, the data transmission subsystems can more reasonably utilize the data transmission links between each other to transmit data, avoid competition between the data transmission subsystems for data transmission link resources, and effectively ensure that the bandwidth of the data transmission link has high utilization, thereby improving the efficiency of data transmission.

[0022] In a possible implementation, the destination address of the first data includes multiple addresses, for example, the destination address of the first data includes multiple data transmission subsystems. The management operation system is used to send a data reception request to the multiple data transmission subsystems based on the data transmission request. That is, the management operation system sends a data reception request to the multiple data transmission subsystems corresponding to the multiple addresses indicated in the data transmission request, thereby requesting these data transmission subsystems to receive the first data from the first data transmission subsystem. Finally, the management operation system can instruct the first data transmission subsystem to send the first data to the multiple data transmission subsystems respectively based on the data reception confirmation messages returned by the multiple data transmission subsystems.

[0023] In this solution, based on the data transmission link in the data transmission system, the data received on one data transmission subsystem can be quickly transmitted to multiple other data transmission subsystems, thereby achieving efficient data distribution and meeting the data distribution needs in specific scenarios.

[0024] In a possible implementation, the first data transmission subsystem is further used to obtain a data transmission instruction issued by a user, the data transmission instruction is used to instruct the transmission of the first data, and the data transmission instruction includes the size of the first data, the destination address of the first data, the transmission time point of the first data, the transmission time limit of the first data, and the authorized trusteeship information of the first data. The transmission time point of the first data refers to the time point at which the first data needs to start transmission, and the transmission time limit of the first data refers to how long the first data needs to be transmitted to the destination address, for example, the first data needs to be transmitted to the destination address within a week. The authorized trusteeship information of the first data refers to the information that the user authorizes the data transmission subsystem to host the first data, so as to ensure that the source data transmission subsystem and the destination data transmission subsystem of the first data can temporarily store and host the first data. In addition, the first data transmission subsystem is also used to determine the transmission priority of the first data based on the transmission time point of the first data and the transmission time limit of the first data. Specifically, the shorter the transmission time limit of the first data, the higher the transmission priority of the first data, and the first data transmission subsystem gives priority to sending a data transmission request for the first data to the management and operation system, thereby ensuring that the first data can be transmitted as soon as possible.

[0025] In a possible implementation, the data transmission links between the multiple data transmission subsystems are optical transport network (OTN) links with high bandwidth values. For example, the bandwidth of any data transmission link is 100 Gbps, 400 Gbps, 800 Gbps, 1600 Gbps, etc. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 A schematic diagram of the structure of a data transmission system provided in an embodiment of the present application;

[0027] Figure 2 A schematic diagram of reading data and transmitting data through a data transmission link provided in an embodiment of the present application;

[0028] Figure 3 A comparative schematic diagram of the network topology provided in the embodiments of the present application;

[0029] Figure 4 A schematic diagram of the structure of a data transmission subsystem provided in an embodiment of the present application;

[0030] Figure 5 A schematic diagram of a data macroblock provided in an embodiment of the present application;

[0031] Figure 6 A schematic diagram of node routing provided in an embodiment of the present application;

[0032] Figure 7 A schematic diagram of a user submitting data to a data transmission subsystem for transmission provided in an embodiment of the present application;

[0033] Figure 8 A schematic diagram of data transmission in a data transmission system provided in an embodiment of the present application;

[0034] Fig. 9 A schematic diagram of data transmission in an East-West computing scenario provided in an embodiment of the present application;

[0035] Fig.10 A schematic diagram of data transmission in a data center interconnection scenario provided in an embodiment of the present application;

[0036] Fig.11A A schematic diagram of a traditional digital content distribution provided in an embodiment of the present application;

[0037] Fig. 11B A schematic diagram of implementing data content distribution based on a data transmission system provided in an embodiment of the present application;

[0038] Fig.12A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0039] The following describes the embodiments of the present application in conjunction with the accompanying drawings. Obviously, the described embodiments are only embodiments of a part of the present application, rather than all embodiments. It is known to those skilled in the art that with the development of technology and the emergence of new scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0040] The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchanged where appropriate, so that the embodiments described herein can be implemented in an order other than that illustrated or described herein.

[0041] In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or modules is not necessarily limited to those steps or modules that are clearly listed, but may include other steps or modules that are not clearly listed or inherent to these processes, methods, products or devices. The naming or numbering of steps in this application does not mean that the steps in the method flow must be executed in the time / logical sequence indicated by the naming or numbering. The named or numbered process steps can change the execution order according to the technical purpose to be achieved, as long as the same or similar technical effects can be achieved.

[0042] With the development of science and technology and the advent of the big data era, the amount of data that needs to be transmitted on the network has exploded, and more and more big data needs to involve long-distance transmission. For example, in the newly proposed concept of "East Data West Computing", data from the eastern part of the country needs to be transmitted in an orderly manner to the west for calculation and processing. The eastern data center focuses on processing services with high network requirements such as industrial Internet, financial securities, disaster warning, telemedicine, video calls, and artificial intelligence reasoning; the western data center focuses on processing background processing, offline analysis, storage backup and other services that do not require high network requirements. The scenario of cross-regional separation of data production and processing will become increasingly common.

[0043] The long-distance transmission of massive amounts of data across regions poses a great challenge to traditional data transmission networks (such as wide area networks). Due to the limited bandwidth of traditional data transmission networks and the large amount of burst traffic on data transmission networks, different data streams will compete for network resources and interfere with each other. Therefore, data transmission networks often reserve a certain amount of bandwidth to cope with burst traffic and resource competition between data streams, resulting in low bandwidth utilization of data transmission networks, and thus low data flow transmission efficiency. In addition, in the scenario of long-distance transmission, when large amounts of data flows are transmitted through traditional data transmission networks, they often flow through a large number of forwarding devices (such as switches and routers in various regions). These forwarding devices need to perform table lookup forwarding when forwarding data, resulting in a large number of table lookup forwarding times during the transmission process of the data flow, affecting the transmission efficiency of the data flow. In addition, although enterprise users can alleviate the problem of data transmission efficiency to a certain extent by using dedicated line networks to transmit large amounts of data, dedicated line networks require high costs, which are often difficult for enterprise users to afford.

[0044] Based on this, the present application provides a data transmission system, in which a plurality of data transmission subsystems connected by high-bandwidth data transmission links are arranged in the data transmission system, a data access link with lower bandwidth is also connected to the data transmission subsystem, and a data temporary storage device is also arranged on the data transmission subsystem, which can cache the external data obtained from the data access link. In this way, during the data transmission process, the data transmission subsystem receives external data from the data access link, and first caches the external data in the data temporary storage device, and then transmits the data cached in the data temporary storage device through the high-bandwidth data transmission link. Since the bandwidth of the data transmission link is much higher than the bandwidth of the data access link, and the data transmission link transmits the data cached in the data temporary storage device, the data transmission link can centrally transmit the cached data at one time, avoid mutual interference between different data streams, ensure that the bandwidth of the data transmission link always has high utilization, and thus improve the data transmission efficiency.

[0045] The data transmission system provided in the embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0046] See also Figure 1 , Figure 1 A schematic diagram of the structure of a data transmission system provided in an embodiment of the present application. Figure 1 As shown, the data transmission system includes multiple data transmission subsystems, and the multiple data transmission subsystems are connected through data transmission links. For any data transmission subsystem, the data transmission subsystem is, for example, a network device in the form of a cabinet (such as a server or a switch), or a device cluster composed of multiple network devices. This embodiment does not specifically limit the form of the data transmission subsystem.

[0047] Among them, the data transmission link used to connect the data transmission subsystem has a high bandwidth, that is, it can realize data transmission at a high rate. Exemplarily, the data transmission link between multiple data transmission subsystems is an optical transmission network link, that is, multiple data transmission subsystems are interconnected through high-speed optical fibers, and the bandwidth of any data transmission link is, for example, 100Gbps, 400Gbps, 800Gbps, 1600Gbps, etc.

[0048] In some possible embodiments, any two data transmission subsystems in the data transmission system are directly connected via a data transmission link. For example, for any data transmission subsystem in the data transmission system, the data transmission subsystem is directly connected to any other data transmission subsystem via a data transmission link.

[0049] In some other possible embodiments, some data transmission subsystems in the data transmission system are not directly connected through data transmission links, but are connected through other data transmission subsystems. For example, for data transmission subsystem 1, data transmission subsystem 1 is directly connected to data transmission subsystem 2 through data transmission link 1, and data transmission subsystem 2 is directly connected to data transmission subsystem 3 through data transmission link 2, so data transmission subsystem 1 and data transmission subsystem 3 are actually connected through data transmission subsystem 2.

[0050] Taking the first data transmission subsystem among multiple data transmission subsystems (the first data transmission subsystem can be any one of the multiple data transmission subsystems) as an example, the first data transmission subsystem is also connected to a data access link, and the data access link is used to receive data that needs to be transmitted through the data transmission system. Among them, the bandwidth of the data access link connected to the first data transmission subsystem is smaller than the bandwidth of the data transmission link connected to the first data transmission subsystem. In other words, for the data transmission subsystem in the data transmission system, the data transmission subsystem is connected to the external network through a data access link with lower bandwidth (such as a link in a traditional network) to obtain the data that needs to be transmitted from the external network; and the data transmission subsystems are connected through a data transmission link with higher bandwidth, thereby realizing high-speed transmission of data in the data transmission subsystem.

[0051] In addition, the first data transmission subsystem also includes a data temporary storage device, which is used to cache data received through the data access link, and the first data transmission subsystem is used to send the data cached in the data temporary storage device through the connected data transmission link. Since the bandwidth of the data access link connected to the first data transmission subsystem is relatively low, and the bandwidth of the data transmission link used by the first data transmission subsystem to transmit data is relatively high, the first data transmission subsystem may first cache the data received from the data access link, and then send the data through the data transmission link after the cached data reaches a certain amount of data, thereby ensuring that the data transmission link can centrally transmit the cached data at one time, avoiding mutual interference between different data streams, and ensuring that the bandwidth of the data transmission link has high utilization.

[0052] Furthermore, since the first data transmission subsystem is provided with a data temporary storage device, the data temporary storage device can be used as a buffer for burst traffic, thereby injecting a large amount of data to be transmitted in advance, ensuring that the bandwidth of the data transmission link always maintains a high utilization rate, avoiding the phenomenon that the data transmission link is sometimes idle and sometimes congested, thereby ensuring data transmission efficiency.

[0053] After the first data transmission subsystem transmits the data to the destination data transmission subsystem, the destination data transmission subsystem then sends the received data to the actual destination address of the data. For example, the destination data transmission subsystem sends the received data to the destination address specified by the user through the data access link connected to this node.

[0054] In general, during the data transmission process, the data transmission subsystem receives external data from the data access link, and first caches the external data in the data temporary storage device, and then transmits the data cached in the data temporary storage device through the high-bandwidth data transmission link. Since the bandwidth of the data transmission link is much higher than the bandwidth of the data access link, and the data transmission link transmits the data cached in the data temporary storage device, the data transmission link can centrally transmit the cached data at one time, avoiding mutual interference between different data streams, ensuring that the bandwidth of the data transmission link always has high utilization, thereby improving data transmission efficiency.

[0055] In addition, since the data transmission subsystem transmits the data cached in the data temporary storage device through a high-bandwidth data transmission link, the data transmission subsystem can transmit data with a large amount of data each time it transmits data, and will not transmit data with a small amount of data. In this way, based on the characteristics of the data transmission system transmitting large blocks of data, a new transmission protocol can be designed for the data transmission system, that is, a transmission mechanism for large blocks of data is adopted, so that data can be transmitted based on data packets with a large amount of data during the data transmission process, further improving the data transmission efficiency.

[0056] Optionally, the first data transmission subsystem is used to send the target data through the connected data transmission link when the amount of target data cached by the data temporary storage device is greater than a first threshold, and the target data includes data belonging to the same data transmission service. The data of the same data transmission service may refer to data requested for transmission by the same user and having the same destination address, that is, data in the same data stream.

[0057] That is to say, for the data in the same data stream, the first data transmission subsystem first caches the data in the data stream through the data temporary storage device, and after the cached data reaches a certain amount of data, it is sent to other data transmission subsystems through the data transmission link, so as to enable the high-bandwidth data transmission link to fully load and transmit the data in the same data stream as much as possible, ensuring that the bandwidth of the data transmission link has a high utilization rate, thereby improving the data transmission efficiency.

[0058] Optionally, the first threshold is related to the bandwidth of the data transmission link to which the first data transmission subsystem is connected. Generally speaking, the first threshold is positively correlated with the bandwidth of the data transmission link, that is, the larger the bandwidth of the data transmission link, the larger the first threshold; the smaller the bandwidth of the data transmission link, the smaller the first threshold.

[0059] Exemplarily, the first threshold value may be a value greater than or equal to the bandwidth of the data transmission link to which the first data transmission subsystem is connected. For example, assuming that the bandwidth of the data transmission link to which the first data transmission subsystem is connected is 100 Gbps, which means that the amount of data that can be transmitted per second by the data transmission link is 100 Gigabytes (G), then the first threshold value may be 100G, 200G, or 500G, etc., that is, the first threshold value is an integer multiple of the bandwidth of the data transmission link.

[0060] In the case where the amount of data in the same data stream is large, by setting a first threshold value related to the bandwidth of the data transmission link, the data in the same data stream can be sent intermittently through the data transmission link. That is, the data in the same data stream is continuously transmitted to the first data transmission subsystem through the data access link for caching, and the first data transmission subsystem triggers the transmission of data only when the cached data reaches a certain amount, so that the first data transmission subsystem does not continuously transmit the data of the same data stream through the data transmission link, but intermittently transmits batches of data. For example, assuming that the amount of data in a certain data stream is 1000G, the bandwidth of the data transmission link connected to the first data transmission subsystem is 100Gbps, and the first threshold value is 100G, then the first data transmission subsystem is triggered to transmit the cached data through the data transmission link when the cached amount of data in the data stream reaches 100G. In this way, the first data transmission subsystem transmits the data in the same data stream 10 times through the data transmission link, and the amount of data transmitted each time is 100G, and the transmission time is 1 second.

[0061] In another possible example, the first threshold value may also be related to the data volume of the data transmission service corresponding to the target data. For example, the first threshold value is the same as the data volume of the data transmission service corresponding to the target data, or the first threshold value is slightly smaller than the data volume of the data transmission service corresponding to the target data. In other words, different threshold values ​​may be set for different data transmission services, and the set threshold values ​​are related to the data volume required to be transmitted by the data transmission service itself. In this way, by setting the threshold value for triggering transmission equal to or slightly smaller than the data volume of the data transmission service, the data transmission subsystem can transmit the cached data to other data transmission subsystems through the data transmission link after the data belonging to the same data transmission service has been completely cached, thereby ensuring that as few data streams as possible are transmitted in the same period of time, avoiding mutual interference between data streams, and ensuring that the data transmission link always maintains high bandwidth utilization.

[0062] Optionally, when the amount of target data is greater than the bandwidth of the data transmission link to which the first data transmission subsystem is connected, the data transmission link to which the first data transmission subsystem is connected is only used to transmit the target data during the target data transmission period. That is, the data transmission link is exclusive during the target data transmission period, and the data transmission link only transmits data under the same data transmission service at the same time, ensuring that the data transmission link can fully transmit data under the same data transmission service, avoiding interference caused by the simultaneous transmission of multiple data streams, and improving the efficiency of data transmission of the data transmission link.

[0063] In addition, since the data reading rate is often limited by the performance of the data storage device (such as a hard disk), the data reading rate from a single data storage device is also limited, and the bandwidth of the data transmission link is often greater than the rate of the data storage device such as the hard disk. Therefore, in this embodiment, multiple data storage devices can be set to cache the data under the same data stream, and multiple data storage devices can be read in parallel when transmitting data, so as to ensure that the data reading rate can match the data transmission rate and avoid data transmission being affected.

[0064] Exemplarily, the data temporary storage device in the first data transmission subsystem includes multiple data storage devices, each of which is used to store part of the target data, and the first data transmission subsystem is used to read the target data from the multiple data storage devices in parallel and transmit the target data through the connected data transmission link. In this way, the rate at which the first data transmission subsystem reads the target data is actually the sum of the reading rates of the multiple data storage devices, thereby ensuring that the data reading rate can match the transmission rate of the data transmission link, and avoiding the data reading rate affecting the actual data transmission rate.

[0065] Specifically, see Figure 2 , Figure 2 This is a schematic diagram of a method for reading data and transmitting data through a data transmission link provided in an embodiment of the present application. Figure 2 As shown, it is assumed that the data temporary storage device of the first data transmission subsystem includes 5 data storage devices (respectively data storage device 1-data storage device 5), and the data reading rate of each data storage device is 20Gbps. In addition, each data storage device stores part of the data under the same data transmission service (for example, each data storage device stores 1 / 5 of the data under the same data transmission service). In this way, when the first data transmission subsystem transmits the data in the data temporary storage device through the data transmission link, the first data transmission subsystem can read the data from the 5 data storage devices in parallel, and aggregate the read data and transmit it through the same data transmission link. In this way, since the reading rate of each data storage device is 20Gbps, and the 5 data storage devices are read at the same time, when the read data is aggregated into the data transmission link for transmission, the transmission rate of the data transmission link is 100Gbps, ensuring that the transmission rate of the data transmission link can match the bandwidth of the data transmission link itself, and ensuring that the data transmission link can fully load the data transmission.

[0066] Optionally, for any data transmission subsystem in the data transmission system, the data access link connected to the data transmission subsystem may include one or more of the following links: a wired network access link, a wireless network access link, a network dedicated line access link, and a hard disk access link.

[0067] The wired network access link may refer to a link that accesses a traditional Internet Protocol (IP) network. Based on the wired network access link, a user may send data that needs to be transmitted based on the data transmission system to the data transmission subsystem through the traditional IP network.

[0068] The wireless network access link may refer to a link to access a wireless network, such as a link to access a satellite or a link to access a wireless base station. Based on the wireless network access link, a user can send data that needs to be transmitted based on the data transmission system to the data transmission subsystem through a satellite or a wireless base station.

[0069] The network dedicated line access link may refer to a link connected to the network dedicated line, that is, the user directly accesses the data transmission subsystem through the network dedicated line, so the user can send data that needs to be transmitted based on the data transmission system to the data transmission subsystem through the network dedicated line.

[0070] The hard disk access link may refer to a link that provides a hard disk access port. The user can insert the hard disk into the hard disk access port provided on the data transmission subsystem to access the data in the hard disk to the data transmission subsystem. In this way, the data transmission subsystem can directly read the data in the hard disk provided by the user through the hard disk access link.

[0071] It should be noted that the above is an introduction to the possible types of data access links connected to the data transmission subsystem. For a data transmission subsystem, the data transmission subsystem may be connected to one or more of the above-mentioned types of links, and each type of link may be connected to one or more links. For example, for the first data transmission subsystem, the types of data access links connected to the first data transmission subsystem may include a wired network access link, a wireless network access link, a network dedicated line access link, and a hard disk access link, and the wired network access link connected to the first data transmission subsystem type may include multiple links, that is, different users can access the first data transmission subsystem through different wired network access links. Specifically, the type and number of data access links connected to the data transmission subsystem are not limited in this embodiment.

[0072] Optionally, when the data access link includes a hard disk access link, the first data transmission subsystem is also used to read data through the hard disk access link and forward the read data based on the connected data transmission link. That is to say, when the first data transmission subsystem has a hard disk access link, the first data transmission subsystem can directly read the data in the hard disk provided by the user through the hard disk access link, and further forward the data read through the hard disk access link through the data transmission link, thereby omitting the operation of caching the read data to the data temporary storage device. Among them, the first data transmission subsystem may be provided with multiple hard disk access links, and the user can connect multiple hard disks to different hard disk access links respectively, so that the first data transmission subsystem can read the data in multiple hard disks in parallel through multiple hard disk access links, so that the data reading rate matches the transmission rate of the data transmission link.

[0073] It should be noted that when the data transmission subsystem has a hard disk access link, if the user transmits data to the data transmission subsystem through the hard disk access link, the user needs to go to the location of the data transmission subsystem and connect the hard disk to the hard disk access link to realize data transmission to the data transmission subsystem.

[0074] The above describes the process in which the first data transmission subsystem receives externally injected data through a data access link, and transmits the received data through a data transmission link with other data transmission subsystems. In actual applications, the first data transmission subsystem may also receive data sent by other data transmission subsystems through a data transmission link, and forward the received data to the user through the data access link.

[0075] Exemplarily, the first data transmission subsystem is also used to receive data sent by other data transmission subsystems through a data transmission link, and forward the data received from the data transmission link through a data access link. For example, after the first data transmission subsystem receives data sent by other data transmission subsystems through a data transmission link, it forwards the data received from other data transmission subsystems through a data access link such as a wired network access link or a wireless network access link, thereby enabling a user to receive data transmitted through the data transmission system from a data access link such as a wired network access link or a wireless network access link.

[0076] Optionally, the data temporary storage device in the first data transmission subsystem is also used to cache data received by the first data transmission subsystem from the connected data transmission link. That is to say, after the data transmitted by the user through the data transmission system reaches the destination data transmission subsystem, it can also be cached in the source and destination data transmission subsystems, that is, the data is managed in the source and destination data transmission subsystems, so that the user can retrieve it from the source and destination data transmission subsystems as needed.

[0077] For example, when the first data transmission subsystem receives data transmitted by other data transmission subsystems through a data transmission link, the first data transmission subsystem can cache the received data in a data temporary storage device. Then, when the first data transmission subsystem successfully caches data under the same data transmission service, the first data transmission subsystem sends a data retrieval notification to the user, thereby notifying the user to retrieve the data cached in the first data transmission subsystem. In this way, the user can retrieve data from the first data transmission subsystem through a data access link, for example, the user receives the data cached in the first data transmission subsystem through a wired network access link, or the user carries a hard disk to the first data transmission subsystem and copies the data cached in the first data transmission subsystem through the hard disk.

[0078] In some possible embodiments, in order to facilitate the scheduling of data transmission between data transmission subsystems, a management operation system may be further provided in the data transmission system. Furthermore, the management operation system is respectively connected to the plurality of data transmission subsystems, that is, each data transmission subsystem in the data transmission system is connected to the plurality of data transmission subsystems.

[0079] After the first data transmission subsystem has received and cached the first data to be transmitted through the data access link, the first data transmission subsystem sends a data transmission request to the management and operation system, where the data transmission request is used to request the transmission of the first data, and the data transmission request includes the size of the data to be transmitted and the destination address of the first data. The destination address of the first data may refer to the destination data transmission subsystem of the first data, that is, the destination address of the first data is the data transmission subsystem in the data transmission system; the destination address of the first data may also be an IP address in the Internet (such as the IP address specified by the user when transmitting the first data to the first data transmission subsystem).

[0080] After obtaining the data transmission request, the management operation system sends a data reception request to the second data transmission subsystem based on the data transmission request, and the data reception request is used to request the second data transmission subsystem to receive the first data. Among them, the data reception request can be used to indicate the size of the first data, so that the second data transmission subsystem can prepare sufficient cache space for the first data based on the size of the first data. It should be noted that, when the destination address of the first data is the destination data transmission subsystem, the second data transmission subsystem is the destination data transmission subsystem of the first data; when the destination address of the first data is an IP address on the Internet, the second data transmission subsystem can be a data transmission subsystem determined by the management operation system that can reach the destination address of the first data.

[0081] After preparing the cache space for receiving the first data based on the data reception request, the second data transmission subsystem may return a data reception confirmation message to the management operation system, and the data reception confirmation message is used to indicate that the second data transmission subsystem confirms that it can receive the first data. In this way, the management operation system is also used to send a data transmission instruction to the first data transmission subsystem after receiving the data reception confirmation message returned by the second data transmission subsystem, and the data transmission instruction is used to instruct the first data transmission subsystem to transmit the first data.

[0082] Optionally, the data transmission instruction is further used to indicate a time period for the first data transmission subsystem to transmit the first data, that is, within what time period the first data transmission subsystem needs to transmit the first data.

[0083] Specifically, the management and operation system is responsible for scheduling data transmission in the entire data transmission system. In addition to the first data transmission subsystem requesting data transmission from the management and operation system, there may be other data transmission subsystems requesting data transmission from the management and operation system, and the data transmission links for other data transmission subsystems to request data transmission may be the same as the data transmission links for the first data transmission subsystem to request data transmission. Based on this, the management and operation system can determine the time period for each data transmission subsystem to use a specific data transmission link to transmit data according to the data transmission situation in the actual scenario (such as the data transmission subsystem requesting data transmission and the priority of the data requested by each data transmission subsystem), thereby ensuring that the data transmission link can be exclusive to a specific data transmission subsystem in each time period as much as possible, so as to improve the bandwidth utilization of the data transmission link.

[0084] In general, by setting up a data scheduling center in the data transmission system to schedule data transmission between data transmission subsystems, the data transmission subsystems can more reasonably utilize the data transmission links between each other to transmit data, avoid competition for data transmission link resources between the data transmission subsystems, and effectively ensure that the bandwidth of the data transmission link has high utilization, thereby improving the efficiency of data transmission.

[0085] In some possible embodiments, the destination address of the first data requested to be transmitted by the first data transmission subsystem includes multiple addresses, for example, the destination address of the first data includes multiple data transmission subsystems. Then, after receiving the data transmission request, the management operation system sends a data reception request to the multiple data transmission subsystems based on the multiple addresses indicated in the data transmission request. That is, the management operation system sends a data reception request to the multiple data transmission subsystems corresponding to the multiple addresses indicated in the data transmission request, thereby requesting these data transmission subsystems to receive the first data from the first data transmission subsystem. Finally, the management operation system can instruct the first data transmission subsystem to send the first data to the multiple data transmission subsystems respectively based on the data reception confirmation messages returned by the multiple data transmission subsystems.

[0086] It can be understood that in this solution, based on the data transmission link in the data transmission system, the data received on one data transmission subsystem can be quickly transmitted to multiple other data transmission subsystems, thereby achieving efficient data distribution, thereby meeting the data distribution needs in specific scenarios. For example, in the movie distribution scenario, the movie distribution company needs to distribute the movie to the cinemas in various cities. Then the movie distribution company can pre-transmit the digital content of the movie to a data transmission subsystem closest to the movie distribution company, and then distribute the digital content of the movie to the data transmission subsystems deployed in various cities through the data transmission subsystem. Then the cinemas in various cities can take out the digital content of the movie from the nearest data transmission subsystem, thereby achieving efficient distribution of the digital content of the movie.

[0087] To facilitate understanding, the data transmission system provided in the embodiments of the present application will be described in detail below with reference to specific examples.

[0088] See also Figure 3 , Figure 3 A comparative schematic diagram of the network topology provided in the embodiment of the present application. Figure 3 As shown, Figure 3 The network topology shown on the left is the existing IP network topology. Figure 3 Shown on the right is the network topology of the data transmission system provided by this solution.

[0089] Specifically, the existing IP network topology is designed for connection, mainly for the transmission of small data such as text, language, and video, emphasizing real-time, low latency, and determinism. However, when large amounts of data are transmitted, this existing IP network topology can no longer meet the requirements. The existing IP network topology is actually a tree-like networking mode, which requires a large number of different types of network devices to network and realize data forwarding, such as access devices, switches, routers, and transmission devices. Therefore, during long-distance transmission, data will perform multiple intermediate protocol conversions and undergo table lookup forwarding by a large number of forwarding devices; in addition, different data streams will compete for bandwidth resources, resulting in low bandwidth utilization of the network and low data transmission efficiency.

[0090] Based on this, the network topology of the data transmission system provided by this solution is designed to be more streamlined, which can reduce the number of network node hops and achieve direct data access at the physical path layer. Specifically, the data transmission subsystems in the data transmission system are directly connected through backbone optical fibers, and the bandwidth can reach 100G, 400G, 800G or 1600G.

[0091] Generally speaking, data transmission subsystems are mainly built in areas where data is transmitted in a centralized manner, and the amount of data flow can reach hundreds of GB or more, that is, the data transmission subsystem can realize data convergence transmission. For example, data transmission subsystems are deployed in cities such as Beijing, Shanghai, Shenzhen, Guangzhou, Hangzhou, and Guiyang where a large amount of data is transmitted in a centralized manner. In addition, the size of the data transmission subsystem can be adjusted according to the amount of data. For example, the data transmission subsystem can be a cluster construction mode or a stand-alone device form.

[0092] In addition, since the data transmission system actually gathers a large amount of data into the data transmission subsystem during use, and then the data transmission subsystem transmits the gathered large amount of data to other data transmission subsystems through a high-speed data transmission link, the data transmission subsystem actually has the characteristics of gathering data and then transmitting it in a centralized manner. In other words, the data transmission subsystem is similar to the concept of a port in transportation, so the data transmission subsystem can also be called a "data port".

[0093] For example, see Figure 4 , Figure 4 This is a schematic diagram of the structure of a data transmission subsystem provided in an embodiment of the present application. Figure 4 As shown, the data transmission subsystem in the data transmission system includes multiple components, namely: data access component, data directory, node routing, data pool and data scheduling component.

[0094] The data access component is a component that provides a data access link and is responsible for managing data access, and can provide a variety of data access methods for the data transmission subsystem through the data access link. Specifically, the method of data access to the data transmission subsystem may include, for example, a traditional IP network, that is, slowly injecting data into the data pool of the data transmission subsystem through the IP network. The method of data access to the data transmission subsystem may also include, for example, network dedicated line access, satellite access, wireless base station access, hard disk access, and Gigabit Capable Passive Optical Network (GPON) and other access methods (i.e., the data access link in the above embodiment). Generally speaking, the access bandwidth of the data access method provided by the data access component is lower than the bandwidth of the link between the data transmission subsystems. Therefore, the data injected into the data transmission subsystem through the data access component needs to be cached in the data pool of the data transmission subsystem, and after waiting for the data to be sufficient to support the link bandwidth between the data transmission subsystems, the intermittent mode is started to perform data transmission.

[0095] The data directory is a component that manages data in the data transmission subsystem, mainly including local management systems such as data size, data storage location, data encryption, and data compression, which is similar to a file system. Specifically, the data directory receives data injected by the data access component and allocates data macroblocks in the data pool for the data, thereby storing the data in the data pool. The data directory also manages the data pool, provides data address handles for data scheduling, and realizes high-speed data transmission. In addition, the data directory also provides data access permission control, that is, only authorized users are allowed to access data cached in the data pool; the data directory also provides data lifecycle management, that is, monitoring the cache duration of the data, and regularly deleting data that has reached a certain cache duration.

[0096] The data pool is an area in the data transmission subsystem for caching data (i.e., the data temporary storage device in the above embodiment), which is essentially a network-based cluster storage pool. The data pool is actually composed of multiple data macroblocks, and the size of a data macroblock can be in units of 1GB, 10GB, 100GB or even larger data volumes. In addition, a data macroblock is a logical concept, and a data macroblock is actually composed of multiple physical storage units, and multiple physical storage units can be deployed on different physical nodes. That is, multiple physical storage units are located on different data storage devices, and each physical storage unit can be a part of the storage unit on the data storage device to which it belongs. In this way, a data macroblock can realize data reading and writing in parallel, providing high-speed data writing and data reading rates.

[0097] Specifically, the definition of a data macroblock may include: storage node, input / output (IO) rate, IO concurrency rate, and data block size. For example, see Figure 5 , Figure 5 A schematic diagram of a data macroblock provided in an embodiment of the present application. Figure 5 As shown, the data macroblock has three storage areas (data block 1, data block 2 and data block 3), and these three storage areas are located at node 1, node 2 and node 3 respectively. When the data in the data macroblock needs to be sent, the data can be read and written synchronously from node 1, node 2 and node 3 in parallel to achieve high-speed data movement. The reading rate of each node in node 1, node 2 and node 3 is 10Gbps. By reading the three nodes in parallel, the parallel reading rate of the data macroblock can be 10Gbps*3=30Gbps. In general, in the data pool, by setting the data macroblock to be composed of physical storage units on multiple different physical nodes, the step-by-step aggregation of data can be achieved, ensuring that the reading rate of the entire data macroblock is consistent with the transmission rate of the data transmission link.

[0098] Node routing is responsible for managing and scheduling the routing between data transmission subsystems, configuring the route to each data transmission subsystem, and achieving direct access between the source data transmission subsystem and the destination data transmission subsystem. For example, see Figure 6 , Figure 6 A schematic diagram of a node routing provided in an embodiment of the present application. Figure 6 As shown in the figure, each data transmission subsystem can be represented by a specific number, IP address or string, etc., and the node routing can record the exit port from the current data transmission subsystem to any other data transmission subsystem to indicate the data transmission path. In general, node routing needs to maintain information similar to the routing table and the scheduling mechanism of large time slices to complete the planning of the transmission path. The accessibility between data transmission subsystems is achieved through the local routing table maintained by each data transmission subsystem.

[0099] Data scheduling refers to the reading and writing of data based on the optical network status and the data macroblock information provided by the data directory, completing the conversion from data reading to network protocol. Generally speaking, the data scheduling module includes data reading, data transmission, and data transmission reliability processing, as well as the collaborative interaction of the data scheduling modules of the current data transmission subsystem and the destination data transmission subsystem to complete the movement of data to the designated data area of ​​the other end.

[0100] The above introduces the composition of the data transmission subsystem. The following will introduce the process of injecting external data into the data transmission subsystem and transmitting the external data in the data transmission system through the data transmission subsystem.

[0101] For example, see Figure 7 , Figure 7 A schematic diagram of a user submitting data to a data transmission subsystem for transmission is provided in an embodiment of the present application. Figure 7 As shown, users who need to transmit data through the data transmission system can inject the data to be transmitted into the data transmission subsystem through the data access method provided by the data transmission subsystem, and submit the data transmission request to the data transmission subsystem. The data transmission request may include, for example: the amount of data to be transmitted, the data destination, the time limit requirement for data transmission (i.e., how long the data transmission needs to be completed) and the continuity requirement of the data (i.e., how long the data needs to be retained after arriving at the destination data transmission subsystem).

[0102] After the user's data transmission request, the data transmission subsystem first allocates storage resources in the data pool for the data that the user needs to transmit, and then receives the data injected into the data transmission subsystem by the user through the data access link. After the user's data is completely injected into the data transmission subsystem, the data scheduling component in the data transmission subsystem can apply for a transmission link through the management operation system based on the user's data transmission request and the status of the optical fiber network, and then open the physical network channel to start data transmission.

[0103] For example, see Figure 8 , Figure 8 A schematic diagram of data transmission in a data transmission system provided in an embodiment of the present application. Figure 8 As shown, the process of transmitting the data submitted by the user in the data transmission system includes the following steps 1 to 7.

[0104] Step 1: The user sends a data transmission request to data transmission subsystem A. The data transmission request may specifically include: the destination data transmission subsystem of the data, the data size, the data transmission time requirement, the data access method (such as IP network, network dedicated line or vehicle-mounted disk array, etc.), the data storage period, and whether to authorize third party use.

[0105] Step 2: Data transmission subsystem A determines whether to accept the data transmission request of the user based on the data transmission request sent by the user. If data transmission subsystem A determines to accept the data transmission request of the user, data transmission subsystem A allocates storage resources in the data pool for the data that the user needs to transmit, and returns a response message to the user to notify the user to transmit data to data transmission subsystem A.

[0106] Step 3, after obtaining the response message returned by the data transmission subsystem A, the user can transmit the data to be transmitted to the data transmission subsystem A through the data access link provided by the data transmission subsystem A. For example, the user sends data to the data transmission subsystem through an IP network or a dedicated network line; or the user drives to the location of the data transmission subsystem A and connects the hard disk array in the car to the hard disk access link provided by the data transmission subsystem A, thereby injecting data into the data transmission subsystem A.

[0107] Step 4: When the data requested to be transferred by the user is completely or about to be completely injected into the data pool in the data transfer subsystem A, the data transfer subsystem A sends a data transfer request to the management operation system. The data transfer request includes information such as the destination data transfer subsystem of the data (e.g., data transfer subsystem B), the data size, and the data processing authority. After receiving the data transfer request, the management operation system sends a data receiving request to the data transfer subsystem B to request the data transfer subsystem B to allocate storage space for the data to be transferred.

[0108] Step 5: After allocating storage space for the data, the data transmission subsystem B can send a data reception confirmation message to the management and operation system and the data transmission subsystem A to indicate that the data transmission subsystem B is ready to receive data. Then, the management and operation system can send a data transmission instruction to the data transmission subsystem A according to the scheduling policy to instruct the data transmission subsystem A to transmit data, and the data transmission instruction can also indicate the time period for the data transmission subsystem A to transmit data.

[0109] Step 6, data transmission subsystem A starts data transmission and transmits the data cached in the data pool to data transmission subsystem B. During the data transmission process, data transmission is sent with data macroblocks as the scheduling unit; data retransmission and data multipath transmission are scheduled with data blocks as the unit. That is, after each data transmission subsystem B receives a data macroblock, it initiates a data integrity check. If a data block is lost, it initiates a retransmission request, thereby retransmitting a data block to avoid retransmitting the entire data macroblock. Among them, the data macroblock is the basic unit of data scheduling between data transmission subsystems. Multiple data macroblocks constitute a user transmission task, and a data macroblock must be transmitted within a time slice unit.

[0110] In addition, the data pool (i.e., data temporary storage device) in data transmission subsystem A and data transmission subsystem B uses high-speed storage devices, which can convert the data transfer process between traditional central processing units (CPUs) into data transfer between high-speed storage devices, and can even use direct data transfer between media to improve data transmission efficiency.

[0111] Step 7, after the data transmission is completed, the data pool of the data transmission subsystem B caches the data transmitted by the data transmission subsystem A, and the data transmission subsystem B may send a data retrieval notification to the user, thereby notifying the user to retrieve the data cached in the data transmission subsystem B. For example, the user may retrieve the data from the data transmission subsystem B through the data access link in the data transmission subsystem B (such as IP network, network, and hard disk access link, etc.).

[0112] In addition, after the user retrieves data from the data transmission subsystem B, the data transmission subsystem B may also perform operations such as data storage, deletion, and distribution based on the user's configuration, which is not specifically limited in this embodiment.

[0113] The following will introduce specific application scenarios of data transmission implemented by the data transmission system provided by this embodiment.

[0114] See also Fig. 9 , Fig. 9 A schematic diagram of data transmission in an East-West computing scenario provided by an embodiment of the present application. In the specific scenario of East-West computing, data generated in eastern cities often needs to be moved to data centers in western cities for computing. Fig. 9 As shown, the user can inject a large amount of data to be transmitted into the data transmission subsystem A through the network mode (such as IP network or network dedicated line) or the vehicle hard disk mode, so that the data transmission subsystem A can cache the data copy 1. Then, the data transmission subsystem A can send the cached data copy 1 to the destination data transmission subsystem (such as data transmission subsystem C) according to the user's data transmission requirements. The data transmission subsystem C receives the data sent by the data transmission subsystem A and caches it to obtain the data copy 3. In this way, the user can retrieve the data from the data transmission subsystem C through the network mode or the vehicle hard disk mode.

[0115] Moreover, during the process of data transmission in the data transmission system, the data transmission subsystems along the way (such as data transmission subsystem B between data transmission subsystem A and data transmission subsystem C) can back up the data, that is, obtain data copy 2, so that data copy 2 can be used in the area where data transmission subsystem B is located.

[0116] See also Fig.10 , Fig.10 The following is a schematic diagram of data transmission in a data center interconnection scenario provided by an embodiment of the present application. Fig.10As shown in the figure, in the data center interconnection scenario, the data transmission subsystem is mainly deployed at the edge of the data center and interconnected with the data transmission subsystem of the remote data center. In this scenario, the data transmission subsystem can only have a data scheduling component, the data pool can reuse the existing memory pool and hard disk area of ​​the data center, and the data directory can be deployed to the CPU in the computing area. In this way, the data that needs to be transmitted between data centers is first synchronized to the data pool in the memory area, and then dispatched from the data pool to the data transmission center for transmission.

[0117] See also Fig.11A and Fig. 11B , Fig.11A A schematic diagram of a traditional digital content distribution provided in an embodiment of the present application; Fig. 11B A schematic diagram of implementing data content distribution based on a data transmission system provided in an embodiment of the present application. Fig.11A As shown in the figure, in the traditional digital content distribution process, such as the distribution of digital movies to various cities, a digital movie is about 200G or more, and it is mainly distributed through satellites and mobile hard disks. Among them, the satellite distribution method has certain limitations. For example, the construction of satellite receiving stations in cinemas may be subject to property restrictions, resulting in some cinemas being unable to receive digital movies via satellite; in addition, the satellite distribution method is greatly affected by climate, and it is a one-way transmission with low bandwidth. The mobile hard disk distribution method requires a large number of mobile hard disks to copy digital movies and send them by express delivery. As the number of cinemas increases, more mobile hard disks need to be used to copy digital movies, which is inefficient and cannot be fully digitized.

[0118] like Fig. 11B As shown, when the data transmission system provided by the embodiment of the present application is used to distribute digital content, the content distribution company only needs to transmit the digital content to the nearest data transmission subsystem, and then the data transmission subsystem can transmit the digital content to one or more designated data transmission subsystems according to the authorization of the content distribution company, such as transmitting it to the data transmission subsystem of each provincial capital city in the country, and more than 200G of digital content can be distributed to each data transmission subsystem within a few minutes. In this way, the data transmission subsystem that receives the digital content then distributes the digital content locally step by step, thereby quickly distributing the digital content to the designated destination, such as distributing the digital content to the cinemas in each city.

[0119] See also Fig.12 , Fig.12 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Fig.12The electronic device 1200 shown may be, for example, the data transmission subsystem in the above-mentioned embodiment. Specifically, the electronic device 1200 includes: a transceiver 1201, a processor 1202, and a memory 1203 (wherein the number of the processor 1202 in the electronic device 1200 may be one or more, Fig.12 In the example, one processor is used as an example), wherein the processor 1202 may include an application processor 12021 and a communication processor 12022. In some embodiments of the present application, the transceiver 1201, the processor 1202 and the memory 1203 may be connected via a bus or other means.

[0120] The memory 1203 may include a read-only memory and a random access memory, and provides instructions and data to the processor 1202. A portion of the memory 1203 may also include a non-volatile random access memory (NVRAM). The memory 1203 stores processor and operation instructions, executable modules or data structures, or subsets thereof, or extended sets thereof, wherein the operation instructions may include various operation instructions for implementing various operations.

[0121] The processor 1202 controls the operation of the electronic device. In a specific application, the various components of the electronic device are coupled together through a bus system, wherein the bus system includes not only a data bus but also a power bus, a control bus, and a status signal bus, etc. However, for the sake of clarity, various buses are referred to as bus systems in the figure.

[0122] The method disclosed in the above embodiment of the present application can be applied to the processor 1202, or implemented by the processor 1202. The processor 1202 can be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit or software instructions in the processor 1202. The above processor 1202 can be a general processor, a digital signal processor (digital signal processing, DSP), a microprocessor or a microcontroller, and can further include an application specific integrated circuit (application specific integrated circuit, ASIC), a field programmable gate array (field-programmable gate array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The processor 1202 can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application. The general processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiment of the present application can be directly embodied as a hardware decoding processor to execute, or the hardware and software modules in the decoding processor can be combined and executed. The software module may be located in a storage medium mature in the art, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 1203, and the processor 1202 reads the information in the memory 1203 and completes the steps of the above method in combination with its hardware.

[0123] The transceiver 1201 (e.g., a network card) can be used to receive input digital or character information and generate signal input related to the relevant settings and function control of the electronic device. The transceiver 1201 can also be used to output digital or character information through the first interface; and send instructions to the disk group through the first interface to modify the data in the disk group. The transceiver 1201 can also include a display device such as a display screen.

[0124] Through the description of the above implementation methods, the technicians in the relevant field can clearly understand that the present application can be implemented by means of software plus necessary general hardware, and of course, it can also be implemented by special hardware including special integrated circuits, special CPUs, special memories, special components, etc. In general, all functions completed by computer programs can be easily implemented with corresponding hardware, and the specific hardware structures used to implement the same function can also be various, such as analog circuits, digital circuits or special circuits. However, for the present application, software program implementation is a better implementation method in more cases. Based on such an understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a readable storage medium, such as a computer floppy disk, U disk, mobile hard disk, ROM, RAM, disk or optical disk, etc., including a number of instructions to enable a computer device to execute the methods described in each embodiment of the present application.

[0125] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.

[0126] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application.

[0127] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

Claims

1. A data transmission system, characterized in that: include: A plurality of data transmission subsystems, wherein the plurality of data transmission subsystems are connected via data transmission links; The first data transmission subsystem among the multiple data transmission subsystems is also connected to a data access link data transmission subsystem; The first data transmission subsystem includes a data temporary storage device, which is used to cache data received through the data access link, and the first data transmission subsystem is used to send the data cached in the data temporary storage device through the connected data transmission link.

2. The system according to claim 1, characterized in that The first data transmission subsystem is used to send the target data through the connected data transmission link when the amount of target data cached by the data temporary storage device is greater than a first threshold, and the target data includes data belonging to the same data transmission service.

3. The system according to claim 2, characterized in that The data temporary storage device includes multiple data storage devices, each of the multiple data storage devices is used to store part of the target data, and the first data transmission subsystem is used to read the target data from the multiple data storage devices in parallel and transmit the target data through the connected data transmission link.

4. The system according to claim 2 or 3, characterized in that: The first threshold is related to the bandwidth of a data transmission link to which the first data transmission subsystem is connected.

5. The system according to any one of claims 2 to 4, characterized in that: When the amount of the target data is greater than the bandwidth of the data transmission link to which the first data transmission subsystem is connected, the data transmission link to which the first data transmission subsystem is connected is only used to transmit the target data during the time period of the target data transmission.

6. The system according to any one of claims 1 to 5, characterized in that: The data transmission system further comprises a management and operation system, and the management and operation system is respectively connected to the plurality of data transmission subsystems; The first data transmission subsystem is used to send a data transmission request to the management and operation system, wherein the data transmission request is used to request the transmission of first data, and the data transmission request includes the size of the first data and the destination address of the first data; The management and operation system is used to send a data receiving request to the second data transmission subsystem based on the data transmission request, and the data receiving request is used to request the second data transmission subsystem to receive the first data; The management and operation system is further configured to send a data transmission instruction to the first data transmission subsystem after receiving a data reception confirmation message returned by the second data transmission subsystem, wherein the data transmission instruction is configured to instruct the first data transmission subsystem to transmit the first data.

7. The system according to claim 6, characterized in that The destination address of the first data includes a plurality of addresses; The management and operation system is used to send data receiving requests to multiple data transmission subsystems based on the data transmission request.

8. The system according to claim 6 or 7, characterized in that: The first data transmission subsystem is further used to obtain a data transmission instruction issued by a user, the data transmission instruction is used to instruct the transmission of the first data, and the data transmission instruction includes the size of the first data, the destination address of the first data, the transmission time point of the first data, the transmission time limit of the first data, and the authorization trusteeship information of the first data; The first data transmission subsystem is further used to determine the transmission priority of the first data based on the transmission time point and the transmission time limit.

9. The system according to any one of claims 6 to 8, characterized in that: The second data transmission subsystem is further used to send a data retrieval notification after receiving the first data, wherein the data retrieval notification is used to instruct a user to retrieve the first data from the second data transmission subsystem.

10. The system according to any one of claims 1 to 9, characterized in that: The data transmission links between the multiple data transmission subsystems are optical transport network (OTN) links.

11. The system according to any one of claims 1 to 10, characterized in that: The data access link includes one or more of the following links: a wired network access link, a wireless network access link, a network dedicated line access link, and a hard disk access link.

12. The system according to claim 11, characterized in that In the case where the data access link includes the hard disk access link, the first data transmission subsystem is further configured to read data through the hard disk access link and forward the read data based on the connected data transmission link.

13. The system according to any one of claims 1 to 12, characterized in that: The first data transmission subsystem is further configured to receive data sent by other data transmission subsystems via the connected data transmission link, and forward data received from the connected data transmission link via the data access link.

14. The system according to claim 13, characterized in that The data temporary storage device is also used to buffer data received from the data transmission link connected to the first data transmission subsystem.

15. The system according to any one of claims 1 to 14, characterized in that: The bandwidth of the data access link is smaller than the bandwidth of the data transmission link connected to the first data transmission subsystem.

Images