Data transmission method and device

Abstract

The invention provides a data transmission method and device, and relates to the technical field of the Internet, and the method comprises the steps: calling a data transmission task, and judging whether the attribute of the data transmission task is periodic transmission or not; under the condition that the attribute of the data transmission task is periodic transmission, determining a target transmission time period corresponding to the data transmission task; if the current time is in the target transmission time period, acquiring details of a data transmission task; allocating an execution process for the data transmission task; and calling an execution process to process the data transmission task according to the details of the data transmission task, and stopping executing the data transmission task until the time point upper limit of the target transmission time period is reached. According to the data transmission scheme between the data storage systems, the data transmission time period between the data storage systems can be flexibly controlled, the data transmission task can be flexibly started or paused according to the corresponding transmission time period in the execution process, and interference to other services in the system is avoided.

Description

Technical Field

[0001] The present application relates to the field of Internet technology, and in particular to a data transmission method and device. Background Art

[0002] Common data transmission between data storage systems is divided into manual transmission, synchronous software transmission and backup software transmission. Synchronous software transmission is better than manual transmission in terms of transmission scale and transmission efficiency, but in scenarios with small data volumes, manual transmission is more convenient than using software synchronous transmission. Whether it is manual transmission or synchronous software transmission, data transmission between data storage systems can be started at a certain point in time through manual or software configuration, but it is not possible to flexibly stop the execution before the data transmission task is completed.

[0003] In the existing method of transmitting data between the above-mentioned data storage systems, since the data transmission action cannot be stopped once it starts, when the data transmission speed is slow or the data transmission scale is too large, resulting in a long data transmission time, it may affect the operation of other normal business systems during normal business operation time. Summary of the invention

[0004] The present application provides a data transmission method and device, which can solve the problem in the prior art that a data transmission task cannot be stopped after it is started.

[0005] According to a first aspect of the present application, a data transmission method is provided, wherein the method comprises:

[0006] Calling a data transmission task, and determining whether the data transmission task attribute is periodic transmission;

[0007] In the case where the data transmission task attribute is periodic transmission, determining a target transmission time period corresponding to the data transmission task;

[0008] If the current time is in the target transmission period, obtaining the data transmission task details;

[0009] Allocating an execution process for the data transmission task;

[0010] Calling the execution process to process the current data transmission task according to the data transmission task details until the upper limit of the time point of the target transmission period is reached and stopping the execution of the data transmission task;

[0011] The execution process is suspended, the execution process information is saved to a record file, and the state of the data transmission task is marked as suspended.

[0012] In some implementations, the step of assigning an execution process to the data transmission task includes:

[0013] Determine whether there is currently a data transmission process corresponding to the data transmission task;

[0014] If it exists, resuming the data transmission process, and assigning the resumed data transmission process to the data transmission task;

[0015] If it does not exist, create a synchronization process and assign it to the data transmission task.

[0016] In some implementations, the step of calling the execution process to process the current data transmission task according to the data transmission task details includes:

[0017] According to the data transmission task details, determine the data provider data storage system and the data receiver data storage system corresponding to the task;

[0018] Establishing a data transmission channel between the data provider's data storage system and the data recipient's data storage system;

[0019] Obtaining a database file containing the data to be sent from the data provider's data storage system through the data transmission channel, wherein the database file includes data content of multiple data blocks, and the multiple data blocks are obtained by dividing the data to be sent by the provider's data storage system according to the topological structure information of each storage node in the receiver's data storage system;

[0020] The database file is loaded into the data storage system of the data recipient.

[0021] In some implementations, when the data transmission task attribute is periodic transmission, after the step of determining a target transmission period corresponding to the data transmission task, the method further includes:

[0022] If the current time is not within the target transmission period, suspending the processing of the data transmission task;

[0023] When it is monitored that the target transmission time period is reached, the data transmission task is executed.

[0024] In some implementations, the step of loading the database file into the data storage system of the data recipient includes:

[0025] Determine a generated first data storage space in the data storage system of the data recipient that matches the database file;

[0026] Converting the data in the database file into data in a file format matching the first data storage space through an adapter;

[0027] The data in the database file after format conversion is loaded into the determined generated data storage space.

[0028] In some implementations, before the data transmission system calls the data transmission task and determines whether the data transmission task attribute is periodic transmission, the method further includes:

[0029] Create a data transfer task;

[0030] The data transmission task is set as a periodic transmission task, and a transmission period is set.

[0031] According to a second aspect of the present application, a data transmission device is provided, wherein the device comprises:

[0032] A judgment module, used for calling a data transmission task and judging whether the attribute of the data transmission task is periodic transmission;

[0033] A time period determination module, used to determine a target transmission time period corresponding to the data transmission task when the data transmission task attribute is periodic transmission;

[0034] An acquisition module, configured to acquire the data transmission task details if the current time is in the target transmission period;

[0035] An allocation module, used for allocating an execution process to the data transmission task;

[0036] A processing module, used for calling the execution process to process the current data transmission task according to the data transmission task details, and stopping the execution of the data transmission task until the upper limit of the time point of the target transmission period is reached;

[0037] The pause module is used to suspend the execution process, save the execution process information to a record file, and mark the state of the data transmission task as paused.

[0038] In some embodiments, the allocation module includes:

[0039] The first submodule is used to determine whether there is a data transmission process corresponding to the data transmission task;

[0040] The second submodule is used to restore the data transmission process if it exists, and assign the restored data transmission process to the data transmission task;

[0041] The third submodule is used to create a synchronization process and assign it to the data transmission task if it does not exist.

[0042] In some embodiments, the processing module includes:

[0043] A fourth submodule is used to determine the data provider data storage system and the data receiver data storage system corresponding to the task according to the data transmission task details;

[0044] A fifth submodule, used to establish a data transmission channel between the data storage system of the data provider and the data storage system of the data recipient;

[0045] A sixth submodule is used to obtain, through the data transmission channel, a database file containing the data to be sent from the data storage system of the data provider, wherein the database file includes data contents of a plurality of data blocks, and the plurality of data blocks are obtained by dividing the data to be sent by the data storage system of the provider according to the topological structure information of each storage node in the data storage system of the receiver;

[0046] The seventh submodule is used to load the database file into the data storage system of the data recipient.

[0047] In some embodiments, the device further comprises:

[0048] a monitoring module, configured to suspend processing of the data transmission task if the current time is not within the target transmission time period after the time period determination module determines the target transmission time period corresponding to the data transmission task;

[0049] The task execution module is used to execute the data transmission task when it is monitored that the target transmission time period has been reached.

[0050] In some implementations, the seventh submodule is specifically used for:

[0051] Determine a generated first data storage space in the data storage system of the data recipient that matches the database file;

[0052] Converting the data in the database file into data in a file format matching the first data storage space through an adapter;

[0053] The data in the database file after format conversion is loaded into the determined generated data storage space.

[0054] In some embodiments, the device further comprises:

[0055] Task creation module, used to create data transmission tasks;

[0056] The property setting module is used to set the data transmission task as a periodic transmission task and set a transmission period.

[0057] According to the third aspect of the present application, there is provided an electronic device, comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; the memory is used to store computer programs; and the processor is used to implement any one of the above-mentioned data transmission methods when executing the program stored in the memory.

[0058] According to a fourth aspect of the present application, a computer storage medium is provided, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, any of the above-mentioned data transmission methods is implemented.

[0059] In summary, the data transmission method and device provided by the present application have at least the following beneficial effects:

[0060] The data transmission method of the present application includes: calling a data transmission task, and determining whether the data transmission task attribute is periodic transmission; in the case where the data transmission task attribute is periodic transmission, determining the target transmission time period corresponding to the data transmission task; if the current time is in the target transmission time period, obtaining the data transmission task details; assigning an execution process to the data transmission task; calling the execution process to process the data transmission task according to the data transmission task details, until the upper limit of the time point of the target transmission time period is reached and the data transmission task is stopped. The data transmission method provided by the present application can ensure that the data transmission task is only executed within the set transmission time period to perform data transmission between data storage systems by setting a transmission time period for the data transmission task, and stop executing the data transmission task when it is outside the set transmission time period, effectively avoiding competition for bandwidth resources with other services when the bandwidth resource utilization rate is high. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] In order to more clearly illustrate the specific implementation methods of the present application or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without paying any creative work.

[0062] Figure 1 is a flowchart showing a method for data transmission according to an embodiment of the present application;

[0063] Figure 2 is a structural block diagram of a data transmission device according to an embodiment of the present application;

[0064] Figure 3 It is a structural block diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0065] In order to make the above and other features and advantages of the present application more clear, the present application is further described below in conjunction with the accompanying drawings. It should be understood that the specific embodiments given herein are for the purpose of explaining to those skilled in the art and are only exemplary and not restrictive.

[0066] In the following description, many specific details are set forth to provide a thorough understanding of the present application. However, it is apparent to those skilled in the art that specific details need not be adopted to practice the present application. In other cases, well-known steps or operations are not described in detail to avoid blurring the present application.

[0067] The present application provides a data transmission method, which can be used for data transmission between data storage systems. It can realize data transmission only in a specific time period, and suspend transmission at other times. It can ensure that the overall business system is not affected by data transmission in other time periods, reduce data risks, and improve work efficiency. For example: set the attribute corresponding to the data transmission task to periodic transmission, and set the transmission time period corresponding to the data transmission task to 1:00 to 3:00 a.m. every day, then data transmission is only performed from 1:00 to 3:00 a.m. every day, and transmission is suspended at other time periods.

[0068] The data transmission scheme provided by the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0069] As attached Figure 1 As shown, the data transmission method provided in the embodiment of the present application includes the following steps:

[0070] Step 101: calling a data transmission task and determining whether the data transmission task attribute is periodic transmission.

[0071] The data transmission method provided in the embodiment of the present application can be applied to an electronic device, on which a computer program related to data transmission is stored, and a processor of the electronic device executes the computer program to perform data transmission. The electronic device can be a data transmission server, which can control data transmission interaction between multiple data storage systems. The data transmission system is set in the electronic device.

[0072] In the actual implementation process, the data transmission server can not only perform data transmission tasks, but also perform other transactional tasks such as executing client instructions to extract target data from the data storage system, batch summary of bills, or batch deletion of data in a data storage system. Since the data transmission server maintains and manages multiple data storage systems, there may be multiple data transmission tasks in the task queue. The data transmission server calls tasks from the task queue according to preset rules. When the called task is a data transmission task, it determines whether the attribute of the data transmission task is periodic transmission. If so, step 102 is executed; if not, the task is processed in the existing manner.

[0073] The data transmission task is created before being called, and the specific creation process may be as follows: first, create a data transmission task; second, set the data transmission task as a periodic transmission task, and set a transmission period for it.

[0074] The transmission period can be flexibly set according to the type of data to be transmitted, or according to the bandwidth resource occupancy of each business in the system, and this is not specifically limited in the embodiments of the present application. By setting the transmission period for the data transmission task, the server and bandwidth resources can be better allocated.

[0075] Step 102: When the data transmission task attribute is periodic transmission, determine a target transmission time period corresponding to the data transmission task.

[0076] When a data transmission task is created, its attribute information and corresponding transmission period are set. Therefore, the data transmission task can be interpreted to determine whether it is a periodic transmission task and its corresponding transmission period (i.e., target transmission period). After the transmission period is determined, it is determined whether the current time is within the transmission period. If so, step 103 is executed; if not, the task is waited for the next task scheduling or until the corresponding transmission period is reached before execution.

[0077] In an optional embodiment, when the attribute of the data transmission task is periodic transmission, after determining the target transmission time period corresponding to the data transmission task, if the current time is not in the target transmission time period, the data transmission task is temporarily suspended; when it is monitored that the target transmission time period is reached, the data transmission task is executed.

[0078] Step 103: If the current time is in the target transmission period, obtain the data transmission task details.

[0079] The data transmission task details may include but are not limited to: the data provider's data storage system identifier, the data recipient's data storage system identifier, etc.

[0080] Step 104: Allocate an execution process for the data transmission task.

[0081] An alternative way to assign execution processes to data transfer tasks can be as follows:

[0082] First, determine whether there is a data transmission process corresponding to the data transmission task;

[0083] Secondly, if it exists, the data transmission process is restored and the restored data transmission process is assigned to the data transmission task; if it does not exist, a synchronization process is created and assigned to the data transmission task.

[0084] This method of optionally allocating execution processes to data transmission tasks can avoid process waste.

[0085] Step 105: Call the execution process to process the data transmission task according to the data transmission task details until the upper limit of the target transmission time period is reached and the data transmission task is stopped.

[0086] The target transmission period includes an upper limit and a lower limit of a time point. For example, if the target transmission period is 0:00 to 3:00 in the morning, the upper limit of the time point is 3:00 and the lower limit of the time point is 0:00. When the execution process performs this data transmission task, it is determined in real time whether the upper limit of the time point has been reached; if not, the data transmission continues; if so, the transmission data is no longer processed and the execution process is suspended, the process information is saved to the record file, and the status of the data transmission task is marked as suspended so that the data transmission task can be continued next time.

[0087] In an optional embodiment, the method of calling the execution process to process the data transmission task according to the data transmission task details may include the following sub-steps:

[0088] Sub-step 1: According to the data transmission task details, determine the data provider data storage system and the data receiver data storage system corresponding to the task;

[0089] Sub-step 2: establishing a data transmission channel between the data storage system of the data provider and the data storage system of the data recipient;

[0090] Sub-step 3: obtaining the database file containing the data to be sent from the data storage system of the data provider through the data transmission channel;

[0091] The database file includes data content of multiple data blocks, and the multiple data blocks are obtained by dividing the data to be sent by the data storage system of the provider according to the topological structure information of each storage node in the data storage system of the receiver;

[0092] Sub-step 4: Load the database file into the data storage system of the data recipient.

[0093] A feasible way to load the database file into the data storage system of the data recipient may be as follows:

[0094] First, determine a first data storage space that has been generated and matches the database file in the data storage system of the data recipient; convert the data in the database file into data in a file format that matches the first data storage space through an adapter; and load the data in the database file after format conversion into the determined generated data storage space.

[0095] Step 106: Suspend the execution process, save the execution process information to a record file, and mark the state of the data transmission task as suspended.

[0096] A data transmission task whose status is marked as paused can continue to be executed the next time the task is called; or it can be started when it is monitored that the lower limit of the transmission time period corresponding to the data transmission task is reached; it can also be set to be started when it is monitored that the transmission time period corresponding to the data transmission task is reached and the bandwidth occupancy ratio is less than the preset ratio. In the embodiment of the present application, there is no specific restriction on the timing of re-execution of the data transmission task whose status is marked as paused.

[0097] The data transmission method provided by the present application calls a data transmission task and determines whether the data transmission task attribute is periodic transmission; in the case where the data transmission task attribute is periodic transmission, determines the target transmission time period corresponding to the data transmission task; if the current time is in the target transmission time period, obtains the data transmission task details; assigns an execution process to the data transmission task; calls the execution process to process the data transmission task according to the data transmission task details until the upper limit of the target transmission time period is reached and stops executing the data transmission task. The data transmission method between data storage systems provided by the present application can ensure that the data transmission task is only executed within the set transmission time period to perform data transmission between data storage systems by setting a transmission time period for the data transmission task, and stops executing the data transmission task when it is outside the set transmission time period, effectively avoiding competition for bandwidth resources with other services when bandwidth resource utilization is high.

[0098] The data transmission method provided in the embodiment of the present application is described below with a specific example, including the following steps:

[0099] Step 1: Create a data transfer task.

[0100] Step 2: Set the data transmission task as a periodic running task, and set the running time period (ie, the transmission period corresponding to the data transmission task), the starting time point of the time period is A, and the ending time point is B.

[0101] Step 3: The system schedules the tasks to be executed in turn, determines whether the current task is a periodic task, and whether the running time period is defined; if yes, determines whether the current time point is already between AB. If it is within the range, proceed to step 4. If it is not within the range, wait for the next task scheduling. If it is a non-periodic task or there is no running time period, perform other processing according to the relevant process in the prior art.

[0102] Step 4: Get detailed information about the data transfer task and determine whether a related process already exists. If so, resume the process and go to step 5. If not, create a synchronization process and go to step 5.

[0103] Step 5: Execute the synchronization process and loop to determine whether the current time point has reached time point B. If not, loop to execute step 5. If it reaches time point B, proceed to step 6.

[0104] Step 6: Stop processing new data I / O, try to suspend the process, save process-related information to a log file, and mark the task status as suspended.

[0105] The data transmission method provided in this specific example, on the one hand, the overall data transmission control is controlled by computer programs, which reduces the participation of operation and maintenance personnel, not only reduces manpower expenditure but also reduces the probability of errors; secondly, when setting the transmission time period for the data transmission task, by accurately avoiding the business time period, the business bandwidth can be effectively utilized and the transmission efficiency can be improved; thirdly, by introducing automatic pause and automatic resume actions, the data transmission efficiency can be effectively improved; fourthly, the customized business operation time period can better allocate server and bandwidth resources compared to the common market that only provides the start time.

[0106] Figure 2 A structural block diagram of a data transmission device for implementing an embodiment of the present application.

[0107] The data transmission device provided in the embodiment of the present application includes the following functional modules:

[0108] The judging module 201 is used to call a data transmission task and judge whether the attribute of the data transmission task is periodic transmission;

[0109] The time period determination module 202 is used to determine the target transmission time period corresponding to the data transmission task when the attribute of the data transmission task is periodic transmission;

[0110] The acquisition module 203 is used to acquire the data transmission task details if the current time is in the target transmission period;

[0111] An allocation module 204 is used to allocate an execution process to the data transmission task;

[0112] The processing module 205 is used to call the execution process to process the current data transmission task according to the data transmission task details, and stop executing the data transmission task until the upper limit of the time point of the target transmission period is reached;

[0113] The pause module 206 is used to suspend the execution process, save the execution process information to a record file, and mark the state of the data transmission task as paused.

[0114] In some embodiments, the allocation module includes:

[0115] The first submodule is used to determine whether there is a data transmission process corresponding to the data transmission task;

[0116] The second submodule is used to restore the data transmission process if it exists, and assign the restored data transmission process to the data transmission task;

[0117] The third submodule is used to create a synchronization process and assign it to the data transmission task if it does not exist.

[0118] In some embodiments, the processing module includes:

[0119] A fourth submodule is used to determine the data provider data storage system and the data receiver data storage system corresponding to the task according to the data transmission task details;

[0120] A fifth submodule, used to establish a data transmission channel between the data storage system of the data provider and the data storage system of the data recipient;

[0121] A sixth submodule is used to obtain, through the data transmission channel, a database file containing the data to be sent from the data storage system of the data provider, wherein the database file includes data contents of a plurality of data blocks, and the plurality of data blocks are obtained by dividing the data to be sent by the data storage system of the provider according to the topological structure information of each storage node in the data storage system of the receiver;

[0122] The seventh submodule is used to load the database file into the data storage system of the data recipient.

[0123] In some embodiments, the device further comprises:

[0124] A monitoring module, configured to suspend processing of the data transmission task if the current time is not in the target transmission time period after the time period determination module determines the target transmission time period corresponding to the data transmission task;

[0125] The task execution module is used to execute the data transmission task when it is monitored that the target transmission time period has been reached.

[0126] In some implementations, the seventh submodule is specifically used for:

[0127] Determine a generated first data storage space in the data storage system of the data recipient that matches the database file;

[0128] Converting the data in the database file into data in a file format matching the first data storage space through an adapter;

[0129] The data in the database file after format conversion is loaded into the determined generated data storage space.

[0130] The data transmission device of the present application calls a data transmission task and determines whether the attribute of the data transmission task is periodic transmission; in the case where the attribute of the data transmission task is periodic transmission, determines the target transmission time period corresponding to the data transmission task; if the current time is in the target transmission time period, obtains the data transmission task details; assigns an execution process to the data transmission task; calls the execution process to process the data transmission task according to the data transmission task details until the upper limit of the time point of the target transmission time period is reached and stops executing the data transmission task. The data transmission device provided by the present application can ensure that the data transmission task is only executed within the set transmission time period to perform data transmission between data storage systems by setting a transmission time period for the data transmission task, and stops executing the data transmission task when it is outside the set transmission time period, effectively avoiding competition for bandwidth resources with other services when the bandwidth resource utilization rate is high.

[0131] It should be understood that the specific features, operations and details described hereinabove with respect to the method of the present application may also be similarly applied to the device and system of the present application, or vice versa. In addition, each step of the method of the present application described above may be performed by a corresponding component or unit of the device or system of the present application.

[0132] It should be understood that each module / unit of the device of the present application can be implemented in whole or in part by software, hardware, firmware or a combination thereof. Each module / unit can be embedded in the processor of the electronic device or independent of the processor in the form of hardware or firmware, or can be stored in the memory of the electronic device in the form of software for the processor to call to perform the operation of each module / unit. Each module / unit can be implemented as an independent component or module, or two or more modules / units can be implemented as a single component or module.

[0133] like Figure 3As shown, the present application provides an electronic device 400, which includes a processor 401 and a memory 402 storing computer program instructions. When the processor 401 executes the computer program instructions, each step of the data transmission method between the above-mentioned data storage systems is implemented. The electronic device 400 can be broadly a server, a terminal, or any other electronic device with necessary computing and / or processing capabilities.

[0134] In one embodiment, the electronic device 400 may include a processor, a memory, a network interface, a communication interface, etc. connected through a system bus. The processor of the electronic device 400 may be used to provide necessary computing, processing and / or control capabilities. The memory of the electronic device 400 may include a non-volatile storage medium and an internal memory. The non-volatile storage medium may store an operating system, a computer program, etc. The internal memory may provide an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface and the communication interface of the electronic device 400 may be used to connect and communicate with external devices through a network. When the computer program is executed by the processor, the steps of the method of the present application are executed.

[0135] The present application provides a computer-readable storage medium, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the above-mentioned data transmission method is implemented.

[0136] Those skilled in the art will appreciate that the method steps of the present application can be completed by instructing related hardware such as the electronic device 400 or a processor through a computer program, and the computer program can be stored in a non-temporary computer-readable storage medium, and the computer program causes the steps of the present application to be executed when it is executed. Depending on the circumstances, any reference to memory, storage, or other media herein may include non-volatile or volatile memory. Examples of non-volatile memory include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, magnetic tape, floppy disk, magneto-optical data storage device, optical data storage device, hard disk, solid state disk, etc. Examples of volatile memory include random access memory (RAM), external cache memory, etc.

[0137] The various technical features described above can be combined arbitrarily. Although all possible combinations of these technical features are not described, any combination of these technical features should be considered to be covered by this specification as long as there is no contradiction in such combination.

[0138] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein by equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A data transmission method, characterized in that: The method comprises: Calling a data transmission task, and determining whether the data transmission task attribute is periodic transmission; In the case where the data transmission task attribute is periodic transmission, determining a target transmission time period corresponding to the data transmission task; If the current time is in the target transmission period, obtaining the data transmission task details; Allocating an execution process for the data transmission task; Calling the execution process to process the current data transmission task according to the data transmission task details until the upper limit of the time point of the target transmission period is reached and stopping the execution of the data transmission task; The execution process is suspended, the execution process information is saved to a record file, and the state of the data transmission task is marked as suspended.

2. The method according to claim 1, characterized in that The step of assigning an execution process to the data transmission task comprises: Determine whether there is currently a data transmission process corresponding to the data transmission task; If it exists, resuming the data transmission process, and assigning the resumed data transmission process to the data transmission task; If it does not exist, create a synchronization process and assign it to the data transmission task.

3. The method according to claim 1, characterized in that: The step of calling the execution process to process the data transmission task according to the data transmission task details includes: Determine the data provider data storage system and the data receiver data storage system corresponding to the task according to the data transmission task details; Establishing a data transmission channel between the data provider's data storage system and the data recipient's data storage system; Obtaining a database file containing the data to be sent from the data provider's data storage system through the data transmission channel, wherein the database file includes data content of multiple data blocks, and the multiple data blocks are obtained by dividing the data to be sent by the provider's data storage system according to the topological structure information of each storage node in the receiver's data storage system; The database file is loaded into the data storage system of the data recipient.

4. The method according to claim 1, characterized in that In the case where the data transmission task attribute is periodic transmission, after the step of determining a target transmission period corresponding to the data transmission task, the method further includes: If the current time is not within the target transmission period, suspending the processing of the data transmission task; When it is monitored that the target transmission time period is reached, the data transmission task is executed.

5. The method according to claim 3, characterized in that: The step of loading the database file into the data storage system of the data recipient comprises: Determine a generated first data storage space in the data storage system of the data recipient that matches the database file; Converting the data in the database file into data in a file format matching the first data storage space through an adapter; The data in the database file after format conversion is loaded into the determined generated data storage space.

6. The method according to claim 1, characterized in that Before the step of the data transmission system calling the data transmission task and determining whether the data transmission task attribute is periodic transmission, the method further includes: Create a data transfer task; The data transmission task is set as a periodic transmission task, and a transmission period is set.

7. A data transmission device, characterized in that: The device comprises: A judgment module, used for calling a data transmission task and judging whether the attribute of the data transmission task is periodic transmission; A time period determination module, used to determine a target transmission time period corresponding to the data transmission task when the data transmission task attribute is periodic transmission; An acquisition module, configured to acquire the data transmission task details if the current time is in the target transmission period; An allocation module, used for allocating an execution process to the data transmission task; A processing module, used for calling the execution process to process the current data transmission task according to the data transmission task details, and stopping the execution of the data transmission task until the upper limit of the time point of the target transmission period is reached; The pause module is used to suspend the execution process, save the execution process information to a record file, and mark the state of the data transmission task as paused.

8. The device according to claim 7, characterized in that The allocation module comprises: The first submodule is used to determine whether there is a data transmission process corresponding to the data transmission task; The second submodule is used to restore the data transmission process if it exists, and assign the restored data transmission process to the data transmission task; The third submodule is used to create a synchronization process and assign it to the data transmission task if it does not exist.

9. An electronic device, characterized in that: The device comprises a processor and a memory, wherein the memory stores a computer program, and when the processor executes the computer program, the steps in the data transmission method according to any one of claims 1 to 6 are implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the data transmission method according to any one of claims 1 to 6 are implemented.

Images