Data transmission method, system, medium and electronic device for computing power hub

Abstract

The present invention provides a data transmission method, system, medium and electronic device for a computing power hub; the method comprises the following steps: obtaining a transmission task corresponding to a file to be transmitted scanned by an internal city data center; splitting the transmission task into multiple subtasks, and assigning each subtask to a different link according to a link allocation rule, so as to synchronize the transmission task to a national computing power hub node cluster through different links; feeding back a task response to the internal city data center, so that the internal city data center transmits the file to be transmitted to the national computing power hub node cluster; the computing power hub data transmission method provided by the present invention can provide differentiated control and guarantee for the transmission of application information between each computing power hub node, protect key businesses from the impact of large-scale low-priority businesses, realize orderly and controllable data interaction of each system, and ensure the stable operation of various applications carried by the computing power hub.

Description

Technical Field

[0001] The present invention relates to the field of communications, and in particular to cloud computing technology and computing power network technology, and more particularly to a data transmission method, system, medium and electronic equipment for a computing power hub. Background Art

[0002] With the acceleration of digital transformation and upgrading in various industries, especially the rapid popularization and application of new technologies such as 5G, the total amount of data in society has exploded, and the demand for data resource storage, computing and application has increased significantly. It is urgent to promote the rational layout, supply and demand balance, green intensiveness and interconnection of data centers, build a new computing network system integrating data centers, cloud computing and big data, promote the circulation and application of data elements, and realize green and high-quality development of data centers.

[0003] There are various complex data interactions in the computing power hub, and there is a contradiction between the real-time requirements of message data and the file data transmission requirements; there is a contradiction between the late-sent high-real-time data interaction needs and the early-sent low-real-time data. It is necessary to design and implement data transmission priority strategy control to meet the complex data interaction and transmission needs of different categories and different real-time response requirements.

[0004] However, the current data transmission between nodes in the computing hub is still achieved through QoS speed limiting of traditional IP devices. The QoS speed limiting on traditional IP devices needs to be combined with IP devices to set the maximum and minimum bandwidth of a certain IP or port. The bandwidth of the specified IP or port is managed. Therefore, if the system has many IP devices connected and the IP is relatively dynamic, manual configuration becomes very cumbersome. Moreover, it is impossible to adjust the bandwidth in a timely manner according to the importance of the business. Summary of the invention

[0005] In view of the shortcomings of the prior art mentioned above, the purpose of the present invention is to provide a data transmission method, system, medium and electronic device for a computing power hub. When transmitting data to a computing power hub, differentiated control and guarantee are provided for the transmission of application information between nodes of each computing power hub through the formulated link allocation rules, thereby protecting key businesses from the impact of large-scale low-priority businesses, achieving orderly and controllable data interaction, and ensuring the stable operation of various applications carried by the computing power hub.

[0006] To achieve the above-mentioned purpose and other related purposes, the present invention provides a data transmission method for a computing power hub, comprising the following steps: obtaining a transmission task corresponding to a file to be transmitted scanned by a city's internal data center; splitting the transmission task into multiple subtasks, and assigning each of the subtasks to an independent link according to a link allocation rule, so as to synchronize the transmission task to the national computing power hub node cluster through multiple independent links; and feeding back a task response to the city's internal data center, so that the city's internal data center transmits the file to be transmitted to the national computing power hub node cluster.

[0007] In one embodiment of the present invention, the link allocation rule includes a bandwidth allocation strategy and a transmission time period allocation strategy; wherein the bandwidth allocation strategy includes at least any one of the following: the reserved bandwidth of the transmission task is less than the sum of the link bandwidth and the reserved bandwidth margin; when allocating links, links with small reserved bandwidth are given priority; the number of high-priority transmission tasks is balanced on each link; the transmission time period allocation strategy includes at least any one of the following: slicing the transmission time to allocate continuous time slices to each of the subtasks; allocating appropriate reserved bandwidth to subtasks of various sizes.

[0008] The present invention provides a data transmission system for a computing power hub, comprising: an acquisition module, an allocation module and a feedback module; the acquisition module is used to acquire the transmission task corresponding to the file to be transmitted scanned by the city's internal data center; the allocation module is used to split the transmission task into multiple subtasks, and allocate each of the subtasks to an independent link according to the link allocation rule, so as to synchronize the transmission task to the national computing power hub node cluster through multiple independent links; the feedback module is used to feedback the task response to the city's internal data center, so that the city's internal data center transmits the file to be transmitted to the national computing power hub node cluster.

[0009] The present invention provides a storage medium having a computer program stored thereon, which, when executed by a processor, implements the above-mentioned data transmission method for a computing power hub.

[0010] The present invention provides an electronic device, comprising: a processor and a memory; the memory is used to store a computer program; the processor is used to execute the computer program stored in the memory, so that the electronic device executes the above-mentioned data transmission method for a computing power hub.

[0011] The present invention provides a data transmission system for a computing power hub, comprising: a city internal data center, a national computing power hub node cluster and the above-mentioned electronic equipment; the city internal data center is connected to the electronic equipment, and is used to scan the transmission tasks corresponding to the files to be transmitted, and send the transmission tasks to the electronic equipment; the national computing power hub node cluster is respectively connected to the electronic equipment and the city internal data center, and is used to receive the transmission tasks synchronized by the electronic equipment, and receive the files to be transmitted sent by the city internal data center.

[0012] In one embodiment of the present invention, the transmission of the file to be transmitted by the city internal data center to the national computing power hub node cluster includes the following steps: the city internal data center transmits the file to be transmitted to the national computing power hub node cluster according to the transmission rules; the transmission rules include at least any one of the following transmission strategies: data integration strategy, link allocation strategy, bandwidth allocation strategy, fixed bandwidth strategy, data archiving strategy and statistical analysis strategy.

[0013] In one embodiment of the present invention, the data integration strategy includes: taking appropriate processing measures for files of various sizes to be transmitted; the link allocation strategy includes: when the link stability decreases, issuing an alarm, and adjusting the transmission tasks of the link with high priority to other normal links; when the link is interrupted, issuing an alarm, and adjusting all the transmission tasks of the link to other normal links in order from high to low priority; the bandwidth allocation strategy and the fixed bandwidth strategy are both for transmission tasks of various priorities, and correspondingly take different processing measures; the data archiving strategy includes: archiving the transmission task according to the attributes of the transmission task and the status of each time slice; the statistical analysis strategy includes at least any one of the following: business statistics, accuracy evaluation of transmission control based on reserved bandwidth, network quality and accuracy of expected data volume.

[0014] As described above, the data transmission method, system, medium and electronic device for computing power hubs described in the present invention have the following beneficial effects:

[0015] (1) Compared with the prior art, the computing hub data transmission method provided by the present invention can provide differentiated control and guarantee for the transmission of application information between computing hub nodes, protect key businesses from the impact of large-scale low-priority businesses, realize orderly and controllable data interaction between various systems, and ensure the stable operation of various applications carried by the computing hub.

[0016] (2) The system priority control of the platform architecture provided by the present invention is managed according to business data. When different business data are transmitted through the same physical link, IP address and port, the business priority, bandwidth and transmission time are managed under the router QoS total bandwidth management, and bandwidth and transmission time are allocated to each massive data transmission task. In addition, the bandwidth limit is dynamically increased or decreased according to the transmission status and priority of each massive data transmission task to accelerate high-priority tasks and slow down low-priority tasks when necessary, thereby managing the massive data transmission of various businesses between computing power hubs in an orderly manner. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 Shown is a schematic structural diagram of a terminal in one embodiment of the present invention.

[0018] Figure 2 Shown is a flow chart of a data transmission method for a computing power hub in one embodiment of the present invention.

[0019] Figure 3 Shown is a schematic diagram of data flow transmission in one embodiment of the data transmission method for a computing power hub of the present invention.

[0020] Figure 4 Shown is a strategy diagram of a data transmission method for a computing power hub in one embodiment of the present invention.

[0021] Figure 5 Shown is a schematic diagram of the structure of a data transmission system for a computing power hub in one embodiment of the present invention.

[0022] Figure 6 Shown is a schematic diagram of the structure of a data transmission system for a computing power hub in another embodiment of the present invention. DETAILED DESCRIPTION

[0023] The following describes the embodiments of the present invention through specific embodiments, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict.

[0024] It should be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present invention. The illustrations only show components related to the present invention rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed arbitrarily, and the component layout may also be more complicated.

[0025] Compared with the prior art, the data transmission method, system, medium and electronic device for computing power hubs provided by the present invention can provide differentiated control and guarantee for application information transmission between computing power hub nodes, protect key businesses from the impact of large-scale low-priority businesses, realize orderly and controllable data interaction of each system, and ensure the stable operation of various applications carried by the computing power hub; the system priority control of the platform architecture provided by the present invention is managed according to business data. When different business data are transmitted through the same physical link, IP address and port, under the router QoS total bandwidth management, the priority, bandwidth and transmission time of the business are managed, and bandwidth and transmission time are allocated for each massive data transmission task. According to the transmission status and priority of each massive data transmission task, the bandwidth limit is dynamically increased or decreased to accelerate high-priority tasks and slow down low-priority tasks when necessary, thereby orderly managing the massive data transmission of various businesses between computing power hubs.

[0026] The storage medium of the present invention stores a computer program, and when the computer program is executed by a processor, the following data transmission method for a computing power hub is implemented. The storage medium includes: a read-only memory (ROM), a random access memory (RAM), a disk, a USB flash drive, a memory card, or an optical disk, etc., which can store program codes.

[0027] Any combination of one or more storage media may be used. The storage medium may be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a RAM, a ROM, an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In this document, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in conjunction with an instruction execution system, device, or device.

[0028] Computer-readable signal media may include a data signal propagated in baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0029] The program code embodied on the computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0030] Computer program code for performing the operation of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, Smalltalk, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0031] The present invention will be described below with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present invention. It should be understood that each box of the flowchart and / or block diagram and the combination of the boxes in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer or other programmable data processing device, so as to produce a machine, so that when these computer program instructions are executed by the processor of the computer or other programmable data processing device, a device for implementing the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated.

[0032] These computer program instructions may also be stored in a computer-readable medium, which enables a computer, other programmable data processing apparatus, or other device to operate in a specific manner, so that the instructions stored in the computer-readable medium produce an article of manufacture including instructions for implementing the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0033] Computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide a process for implementing the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0034] The electronic device of the present invention includes a processor and a memory.

[0035] The memory is used to store computer programs; preferably, the memory includes: ROM, RAM, disk, USB flash drive, memory card or CD, etc., which can store program codes.

[0036] The processor is connected to the memory and is used to execute the computer program stored in the memory so that the electronic device performs the following data transmission method for a computing power hub.

[0037] Preferably, the processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0038] In one embodiment, the electronic device includes a terminal and / or a server.

[0039] Figure 1 A block diagram of an exemplary terminal 1 suitable for implementing embodiments of the present invention is shown.

[0040] Figure 1The terminal 1 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0041] like Figure 1 As shown, the terminal 1 is in the form of a general-purpose computing device. The components of the terminal 1 may include, but are not limited to: one or more processors or processing units 11, a memory 12, and a bus 13 connecting different system components (including the memory 12 and the processing unit 11).

[0042] The bus 13 represents one or more of several types of bus structures, including a memory bus or a memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of a variety of bus structures. For example, these architectures include but are not limited to Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.

[0043] The terminal 1 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by the terminal 1, including volatile and non-volatile media, removable and non-removable media.

[0044] The memory 12 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 121 and / or cache memory 122. The terminal 1 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the storage system 123 may be used to read and write non-removable, non-volatile magnetic media ( Figure 1 not shown, usually called a "hard drive"). Although Figure 1 Not shown in the figure, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk"), and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, a DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to the bus 13 via one or more data medium interfaces. The memory 12 may include at least one program product having a set (e.g., at least one) of program modules that are configured to perform the functions of the various embodiments of the present invention.

[0045] A program / utility 124 having a set (at least one) of program modules 1241 may be stored, for example, in the memory 12, such program modules 1241 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which or some combination thereof may include the implementation of a network environment. The program modules 1241 generally perform the functions and / or methods of the embodiments described herein.

[0046] The terminal 1 may also communicate with one or more external devices 2 (e.g., keyboard, pointing device, display 3, etc.), one or more devices that enable a user to interact with the terminal 1, and / or any device that enables the terminal 1 to communicate with one or more other computing devices (e.g., network card, modem, etc.). Such communication may be performed via an input / output (I / O) interface 14. Furthermore, the terminal 1 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) via a network adapter 15. Figure 1 As shown, the network adapter 15 communicates with other modules of the terminal 1 via the bus 13. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in conjunction with the terminal 1, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0047] like Figure 2 and Figure 3 As shown, in one embodiment, the data transmission method for computing power hub of the present invention is applied to a transmission strategy control system (corresponding to the above-mentioned electronic device; see Figure 3 ); Specifically, Figure 2 As shown, the method comprises the following steps:

[0048] Step S1: Obtain the transmission task corresponding to the file to be transmitted scanned by the city internal data center.

[0049] Specifically, the city's internal data center (see Figure 3 ) scans the transmission task and reports the transmission task to the transmission policy control system.

[0050] Step S2: split the transmission task into multiple subtasks, and assign each subtask to a different link according to the link allocation rules, so as to synchronize the transmission task to the national computing power hub node cluster through different links.

[0051] Specifically, after the transmission strategy control system receives the transmission task reported by the city's internal data center, it will synchronize the transmission task to the national computing power hub node cluster (see Figure 3 ).

[0052] It should be noted that a transmission task with a data volume greater than a preset data volume is split into multiple subtasks, and the multiple subtasks are respectively allocated to different links.

[0053] Furthermore, the preset data volume is pre-set, and its specific setting is not a condition to limit the present invention. In practical applications, it can be set according to specific application scenarios.

[0054] The specific splitting rules used for splitting the transmission tasks are not used as conditions to limit the present invention.

[0055] In one embodiment, the link allocation rule includes but is not limited to a bandwidth allocation strategy and a transmission period allocation strategy.

[0056] In one embodiment, the bandwidth allocation strategy includes at least but is not limited to any one of the following:

[0057] (11) The reserved bandwidth of the transmission task is less than the sum of the link bandwidth and the reserved bandwidth margin.

[0058] (12) When allocating links, priority is given to links with smaller reserved bandwidth.

[0059] (13) The number of high-priority transmission tasks is balanced on each link.

[0060] It should be noted that the priority is determined by the transmission policy control system, and different priorities can be assigned to different service levels. For example, a service with high real-time requirements related to billing can be defined as a high priority.

[0061] In this embodiment, the priorities of tasks include three levels: high priority, medium priority, and low priority.

[0062] In one embodiment, the transmission period allocation strategy includes at least but not limited to any one of the following:

[0063] (21) Slice the transmission time to allocate consecutive time slices (time slots) to each of the subtasks.

[0064] It should be noted that time division multiplexing divides the time provided for the entire channel to transmit information into several time slices (referred to as time slots), and allocates these time slots to each signal source for use to ensure resource utilization.

[0065] (22) Allocate different sizes of reserved bandwidth to subtasks of different sizes.

[0066] Specifically, a large pre-occupied bandwidth is allocated to a large task, and a small pre-occupied bandwidth is allocated to a small task.

[0067] In one embodiment, a data volume threshold is defined in advance; tasks with data volumes greater than the data volume threshold are defined as large tasks, and tasks with data volumes not greater than the data volume threshold are defined as small tasks.

[0068] It should be noted that the specific setting of the data volume threshold is not a condition to limit the present invention, and in practical applications, it can be set according to specific application scenarios.

[0069] Step S3: Feedback the task response to the city’s internal data center, so that the city’s internal data center transmits the file to be transmitted to the national computing power hub node cluster.

[0070] In one embodiment, the city internal data center transmits the file to be transmitted to the national computing power hub node cluster, including the following steps: the city internal data center transmits the file to be transmitted to the national computing power hub node cluster according to the transmission rules.

[0071] like Figure 4 As shown, in one embodiment, the transmission rules include at least but are not limited to any one of the following transmission strategies: data integration strategy, link allocation strategy, bandwidth allocation strategy, fixed bandwidth strategy, data archiving strategy and statistical analysis strategy.

[0072] In one embodiment, the data integration strategy includes taking different processing measures for files of different sizes to be transmitted.

[0073] Specifically:

[0074] (31) Packing and compressing small and fragmented files: Pack and compress the small and fragmented files in the files to be transferred to increase the transmission speed.

[0075] (32) Medium-sized file compression: Checks whether a medium-sized file is in compressed format. If not, compresses it before uploading.

[0076] (33) Splitting of very large files: very large files are first split, then compressed and then transmitted.

[0077] In one embodiment, the classification of small fragmented files, medium files and extra-large files is determined according to the size of the files; specifically, files whose size is not greater than a first threshold are defined as small fragmented files; files whose size is greater than the first threshold and less than a second threshold are defined as medium files; files whose size is not less than the second threshold are defined as extra-large files; and the second threshold is greater than the first threshold.

[0078] In one embodiment, the link allocation strategy includes:

[0079] (41) For unstable links

[0080] (411) Alert the network management: the link is unstable and link adjustment will be performed for some tasks in the next time slice;

[0081] (412) The high priority tasks of this link are adjusted to other links in normal status, and the reserved bandwidth margin of the normal links can be used.

[0082] (42) For interrupted links

[0083] (421) Alert the network manager: the link is interrupted, and the link adjustment will be performed for all tasks in the next time slice;

[0084] (422) All tasks are transferred to other links in normal status;

[0085] (423) The priority is adjusted in the order of high, medium and low, and the reserved bandwidth margin of the normal link can be used;

[0086] (424) If no link is found that can be adjusted, no adjustment is made, but an alarm is issued and the task IDs that cannot be adjusted are listed.

[0087] It should be noted that the above judgment on whether the link is stable and whether it is interrupted is achieved through auxiliary link monitoring means.

[0088] In one embodiment, the bandwidth allocation strategy includes taking different processing measures for transmission tasks of different priorities.

[0089] Specifically:

[0090] (51) Low-priority tasks: transmission time is not guaranteed, and bandwidth is given up for delayed high-priority tasks; for normal / advanced tasks, the floating bandwidth Qi is calculated as: pre-occupied bandwidth × low-priority bandwidth floating ratio;

[0091] (52) High priority tasks: ensure transmission time and give priority to accelerating tasks with large delays

[0092] (521) The unreserved available bandwidth Wa of the next time slice = link bandwidth - reserved margin - total reserved bandwidth;

[0093] (522) Available floating bandwidth Wi = reserved bandwidth × high priority bandwidth floating ratio;

[0094] (523) According to the estimated transmission delay time C, Wi is allocated from Wa + ∑Qi (the sum of unreserved available bandwidth + all floating bandwidths) to the task in descending order until Wa + ∑Qi is completely allocated.

[0095] (53) Medium priority task: transmission time is not guaranteed, continue to delay

[0096] (531) For each task, transmission is performed according to the reserved bandwidth and reserved time slice.

[0097] In one embodiment, the fixed bandwidth strategy includes taking different processing measures for transmission tasks of different priorities.

[0098] Specifically:

[0099] (61) High priority tasks: If there is spare bandwidth, they will be accelerated. Prioritize the acceleration of tasks that start early, which is conducive to reducing the number of high priority transmission tasks. The unreserved available bandwidth Wa of the next time slice = link bandwidth - reserved margin - total reserved bandwidth;

[0100] (611) Available floating bandwidth Wi = reserved bandwidth × high priority bandwidth floating ratio;

[0101] (612) Allocate Wi from Wa to the task in order of task start time from earliest to latest until all Wa is allocated.

[0102] (62) Medium and low priority tasks: no acceleration

[0103] (621) For each task, transmission is performed according to the reserved bandwidth and reserved time slice;

[0104] (622) When the high priority bandwidth is lower than the lower limit, the bandwidth of the low priority task can be borrowed.

[0105] In one embodiment, the data archiving strategy includes archiving the transmission tasks for statistical analysis based on the attributes of the transmission tasks and the status of each time slice.

[0106] In one embodiment, the statistical analysis strategy includes at least but is not limited to any one of the following: service statistics, accuracy evaluation of transmission control based on reserved bandwidth, network quality, and accuracy of estimated data volume.

[0107] Specifically:

[0108] (71) Business statistics (amount of data transmitted, flow analysis, statistical period);

[0109] (72) The accuracy of transmission control based on reserved bandwidth (whether the actual transmission volume is consistent with the reserved bandwidth during normal time periods) (assessing the control accuracy of the system);

[0110] (73) Network quality (proportion of time with instability and interruptions);

[0111] (74) Accuracy of estimated data volume.

[0112] It should be noted that the data transmission method for computing power hubs of the present invention provides differentiated control for application information transmission between computing power hub nodes, protects key businesses from the impact of large amounts of low-priority businesses, achieves orderly and controllable data interaction between systems, and ensures stable operation of various applications carried by the computing power hub; among them, differentiation is reflected in differentiated processing of link and bandwidth strategies for tasks of different priorities.

[0113] It should be noted that the protection scope of the data transmission method for computing power hubs described in the present invention is not limited to the execution order of the steps listed in this embodiment. All solutions implemented by adding, reducing or replacing steps in the prior art based on the principles of the present invention are included in the protection scope of the present invention.

[0114] like Figure 5 As shown, in one embodiment, the data transmission system for a computing power hub of the present invention includes an acquisition module 51, an allocation module 52 and a feedback module 53.

[0115] The acquisition module 51 is used to acquire the transmission task corresponding to the file to be transmitted scanned by the city internal data center.

[0116] The allocation module 52 is used to split the transmission task into multiple subtasks, and allocate each subtask to a different link according to the link allocation rules, so as to synchronize the transmission task to the national computing power hub node cluster through different links.

[0117] The feedback module 53 is used to feedback the task response to the city’s internal data center, so that the city’s internal data center transmits the file to be transmitted to the national computing power hub node cluster.

[0118] It should be noted that the structures and principles of the acquisition module 51, the allocation module 52 and the feedback module 53 correspond one-to-one to the steps (step S1 to step S3) in the above-mentioned data transmission method for the computing power hub, so they will not be repeated here.

[0119] It should be noted that it should be understood that the division of the various modules of the above system is only a division of logical functions. In actual implementation, they can be fully or partially integrated into one physical entity, or they can be physically separated. And these modules can all be implemented in the form of software called by processing elements; they can also be all implemented in the form of hardware; some modules can also be implemented in the form of software called by processing elements, and some modules can be implemented in the form of hardware. For example, the x module can be a separately established processing element, or it can be integrated in a certain chip of the above system for implementation. In addition, it can also be stored in the memory of the above system in the form of program code, and called and executed by a certain processing element of the above system. The implementation of other modules is similar. In addition, these modules can be fully or partially integrated together, or they can be implemented independently. The processing element described here can be an integrated circuit with signal processing capabilities. In the implementation process, each step of the above method or each module above can be completed by an integrated logic circuit of hardware in the processor element or instructions in the form of software.

[0120] For example, the above modules may be one or more integrated circuits configured to implement the above methods, such as one or more application specific integrated circuits (ASIC), or one or more digital signal processors (DSP), or one or more field programmable gate arrays (FPGA). For another example, when a module above is implemented in the form of a processing element scheduling program code, the processing element may be a general-purpose processor, such as a central processing unit (CPU) or other processor that can call program code. For another example, these modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).

[0121] like Figure 6 As shown, in one embodiment, the data transmission system for computing power hubs of the present invention includes a city internal data center 61, a national computing power hub node cluster 62 and the above-mentioned electronic equipment 63.

[0122] Specifically, the city's internal data center 61 is connected to the electronic device 63, and is used to scan the transmission tasks corresponding to the files to be transmitted, and send the transmission tasks to the electronic device 63; the national computing power hub node cluster 62 is respectively connected to the electronic device 63 and the city's internal data center 61, and is used to receive the transmission tasks synchronized by the electronic device 63, and receive the files to be transmitted sent by the city's internal data center 61.

[0123] In one embodiment, the transmission of the file to be transmitted by the city internal data center to the national computing power hub node cluster includes the following steps: the city internal data center transmits the file to be transmitted to the national computing power hub node cluster according to the transmission rules; the transmission rules include at least any one of the following transmission strategies: data integration strategy, link allocation strategy, bandwidth allocation strategy, fixed bandwidth strategy, data archiving strategy and statistical analysis strategy.

[0124] In one embodiment, the data integration strategy includes: taking different processing measures for files of different sizes to be transmitted; the link allocation strategy includes: issuing an alarm when the link is unstable, and adjusting the transmission tasks with high priority of the link to other normal links; issuing an alarm when the link is interrupted, and adjusting all transmission tasks of the link to other normal links in order from high to low priority; the bandwidth allocation strategy and the fixed bandwidth strategy are both for transmission tasks of different priorities, and take different processing measures accordingly; the data archiving strategy includes: archiving the transmission task according to the attributes of the transmission task and the status of each time slice; the statistical analysis strategy includes at least any one of the following: business statistics, accuracy evaluation of transmission control based on reserved bandwidth, network quality and accuracy of expected data volume.

[0125] It should be noted that the working principle of the data transmission system for the computing power hub is the same as the working principle of the above-mentioned data transmission method for the computing power hub, so it will not be described in detail here.

[0126] It should be noted that the data transmission system for computing power hubs of the present invention can implement the data transmission method for computing power hubs of the present invention, but the implementation device of the data transmission method for computing power hubs of the present invention includes but is not limited to the structure of the data transmission system for computing power hubs listed in this embodiment. All structural deformations and replacements of the prior art made according to the principles of the present invention are included in the protection scope of the present invention.

[0127] In summary, compared with the prior art, the data transmission method, system, medium and electronic device for the computing power hub of the present invention can provide differentiated control and guarantee for the transmission of application information between the computing power hub nodes provided by the present invention, protect key businesses from the impact of large-scale low-priority businesses, realize orderly and controllable data interaction of each system, and ensure the stable operation of various applications carried by the computing power hub; the system priority control of the platform architecture provided by the present invention is managed according to business data. When different business data are transmitted through the same physical link, IP address and port, under the router QoS total bandwidth management, the priority, bandwidth and transmission time of the business are managed, and bandwidth and transmission time are allocated for each massive data transmission task. According to the transmission status and priority of each massive data transmission task, the bandwidth limit is dynamically increased or decreased to accelerate high-priority tasks and slow down low-priority tasks when necessary, thereby orderly managing the massive data transmission of various businesses between the computing power hubs; therefore, the present invention effectively overcomes the various shortcomings in the prior art and has a high industrial utilization value.

[0128] The above embodiments are merely illustrative of the principles and effects of the present invention, and are not intended to limit the present invention. Anyone familiar with the art may modify or alter the above embodiments without departing from the spirit and scope of the present invention. Therefore, all equivalent modifications or alterations made by a person of ordinary skill in the art without departing from the spirit and technical concept disclosed by the present invention shall still be covered by the claims of the present invention.

Claims

1. A data transmission method for a computing power hub, characterized in that: The following steps are involved: Obtain the transmission tasks of the corresponding files to be transmitted scanned by the city's internal data center; Splitting the transmission task into multiple subtasks, and assigning each of the subtasks to an independent link according to the link allocation rule, so as to synchronize the transmission task to the computing power hub node cluster through multiple independent links; Feedback the task response to the city internal data center, so that the city internal data center transmits the to-be-transmitted file to the computing power hub node cluster; The link allocation rule includes a bandwidth allocation strategy and a transmission period allocation strategy; wherein the bandwidth allocation strategy includes: For low-priority transmission tasks, the transmission time is not guaranteed, and bandwidth is given up for delayed high-priority transmission tasks; for normal / advanced transmission tasks, the floating bandwidth Qi is calculated as: occupied bandwidth × low-priority bandwidth floating ratio; For high-priority transmission tasks, ensure the transmission time and give priority to accelerating the transmission tasks with large delays; Among them, the unreserved available bandwidth Wa of the next time slice = link bandwidth - reserved margin - total reserved bandwidth; The floating bandwidth Wi = reserved bandwidth × high-priority bandwidth floating ratio; According to the estimated transmission delay time C, Wi is allocated from Wa+∑Qi to the transmission task in descending order until Wa+∑Qi is fully allocated; For medium-priority transmission tasks, the transmission time is not guaranteed and will continue to be delayed; Among them, for each transmission task, transmission is performed according to the reserved bandwidth and reserved time slice; The transmission period allocation strategy includes at least one of the following: Slicing the transmission time to allocate consecutive time slices to each of the subtasks; Allocate appropriate reserved bandwidth to each subtask.

2. A data transmission system for computing power hubs, characterized in that: include: Acquisition module, allocation module and feedback module; The acquisition module is used to acquire the transmission task corresponding to the file to be transmitted scanned by the city internal data center; The allocation module is used to split the transmission task into multiple subtasks, and allocate each of the subtasks to an independent link according to the link allocation rule, so as to synchronize the transmission task to the computing power hub node cluster through multiple independent links; The feedback module is used to feed back the task response to the city internal data center, so that the city internal data center transmits the file to be transmitted to the computing power hub node cluster; The link allocation rule includes a bandwidth allocation strategy and a transmission period allocation strategy; wherein the bandwidth allocation strategy includes: For low-priority transmission tasks, the transmission time is not guaranteed, and bandwidth is given up for delayed high-priority transmission tasks; for normal / advanced transmission tasks, the floating bandwidth Qi is calculated as: occupied bandwidth × low-priority bandwidth floating ratio; For high-priority transmission tasks, ensure the transmission time and give priority to accelerating the transmission tasks with large delays; Among them, the unreserved available bandwidth Wa of the next time slice = link bandwidth - reserved margin - total reserved bandwidth; The floating bandwidth Wi = reserved bandwidth × high-priority bandwidth floating ratio; According to the estimated transmission delay time C, Wi is allocated from Wa+∑Qi to the transmission task in descending order until Wa+∑Qi is fully allocated; For medium-priority transmission tasks, the transmission time is not guaranteed and will continue to be delayed; Among them, for each transmission task, transmission is performed according to the reserved bandwidth and reserved time slice; The transmission period allocation strategy includes at least one of the following: Slicing the transmission time to allocate consecutive time slices to each of the subtasks; Allocate appropriate reserved bandwidth to each subtask.

3. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, it implements the data transmission method for a computing power hub as described in claim 1.

4. An electronic device, characterized in that: include: Processor and memory; The memory is used to store computer programs; The processor is used to execute the computer program stored in the memory so that the electronic device executes the data transmission method for the computing power hub as described in claim 1.

5. A data transmission system for computing power hubs, characterized in that: include: The city's internal data center, computing hub node cluster and the electronic equipment described in claim 4; The city internal data center is connected to the electronic device, and is used to scan the transmission tasks corresponding to the files to be transmitted, and send the transmission tasks to the electronic device; The computing power hub node cluster is connected to the electronic device and the city's internal data center respectively, and is used to receive the transmission tasks synchronized by the electronic device and receive the files to be transmitted sent by the city's internal data center.

6. The data transmission system for computing power hub according to claim 5, characterized in that: The transmission of the files to be transmitted by the city internal data center to the computing power hub node cluster includes the following steps: the city internal data center transmits the files to be transmitted to the computing power hub node cluster according to the transmission rules; the transmission rules include at least any one of the following transmission strategies: data integration strategy, link allocation strategy, bandwidth allocation strategy, fixed bandwidth strategy, data archiving strategy and statistical analysis strategy.

7. The data transmission system for computing power hub according to claim 6, characterized in that: The data integration strategy includes: taking appropriate processing measures for files of various sizes to be transmitted; The link allocation strategy includes: when the link stability decreases, an alarm is issued, and the transmission tasks with high priority of the link are adjusted to other normal links; when the link is interrupted, an alarm is issued, and all the transmission tasks of the link are adjusted to other normal links in descending order of priority; The bandwidth allocation strategy and the fixed bandwidth strategy are both aimed at transmission tasks of various priorities, and corresponding processing means are adopted; The data archiving strategy includes: archiving the transmission task according to the attributes of the transmission task and the status of each time slice; The statistical analysis strategy includes at least any one of the following: business statistics, accuracy evaluation of transmission control according to reserved bandwidth, network quality and accuracy of estimated data volume.

Images