File transmission system and method

Abstract

The invention relates to a file transmission system and method, and belongs to the technical field of data processing, and the system comprises a transmission controller which is used for determining the configuration information of a transmission task; the transmission client is used for requesting target task configuration from the transmission controller, grouping a transmission file list based on configuration information when the configuration information of a target task is received and the configuration information of the target task is detected to be normal, and distributing a transmission thread for each file group, file transmission is carried out based on the transmission thread and a file server; and the file server is used for carrying out file transmission under the condition that the file server is connected with the transmission client and determining that file transmission succeeds based on the file attributes. Through efficient task configuration management, intelligent file grouping and multi-thread transmission, reliable file transmission and verification, flexible system expansibility and optimized user experience, efficient, stable and reliable file transmission service is realized.

Description

Technical Field

[0001] The present invention belongs to the technical field of data processing, and in particular relates to a file transmission system and method. Background Art

[0002] In related technologies, file transfer usually uses SFTP or FTP protocols. The protocol itself does not have a retransmission mechanism. Due to conditions such as network environment and server connection number restrictions, file transfer may fail. Therefore, it is necessary to ensure transmission efficiency and reliability through transmission task scheduling, retry and other mechanisms. In general, the file server will set the number of allowed client connections to ensure its own stability. Therefore, in the scenario of large-scale file transfer, if transmission control is not performed, the transmission may fail due to triggering server restrictions. In addition to server restrictions, transmission failures are also prone to occur under conditions such as unstable network environment and long-term transmission. Therefore, how to better implement file transfer has become a problem that needs to be solved urgently. Summary of the invention

[0003] In view of the above shortcomings of the prior art, the purpose of the invention is to provide a file transmission system and method, which realizes efficient, stable and reliable file transmission services.

[0004] According to a first aspect of the present invention, a file transfer system is proposed, comprising: a transfer controller for determining configuration information of a transfer task; a transfer client for requesting a target task configuration from the transfer controller, and upon receiving the configuration information of the target task and detecting that the configuration information of the target task is normal, grouping a transfer file list based on the configuration information, and assigning a transfer thread to each file group, and performing file transfer based on the transfer thread and a file server; the file server is used to perform the file transfer while being connected to the transfer client, and determine whether the file transfer is successful based on file attributes.

[0005] Furthermore, the configuration information includes the identification, account password, file directory, file, execution time, and task validity of the file server, wherein the transmission controller is used to receive the target task configuration requested by the transmission client and send the target task configuration to the transmission client.

[0006] Further, grouping the transfer file list based on the configuration information includes: reading the transfer file list based on the execution time in the configuration information; and grouping the transfer file list based on the identifier of the file server in the configuration information.

[0007] Furthermore, it also includes: in the case of grouping the transfer file list, sorting the files in the transfer file list based on the task timeliness in the configuration information, wherein the shorter the task timeliness is, the higher the file transfer priority is.

[0008] Furthermore, when a transmission thread is allocated to each file group, the transmission client connects to the file server and detects whether connection restriction is triggered; wherein, when connection restriction is not triggered, the number of threads for each file group is increased, wherein the increased number of threads does not exceed the target number; when connection restriction is triggered, the number of threads for each file group is reduced, wherein the number of threads for each file group is at least one.

[0009] Further, the file attributes include file size or MD5 code, wherein determining whether the file transfer is successful based on the file attributes includes: the transmission client requests the file attributes from the file server; and determining that the file transfer is successful when the file attributes returned by the file server are consistent with the file attributes recorded by the transmission client; wherein the system also includes: reporting the status of the successful file transfer to the transmission controller.

[0010] Furthermore, it also includes: when the file attributes returned by the file server are inconsistent with the file attributes recorded by the transmission client, continuing the file transfer based on the number of retries and the task time limit; when the number of retries and / or the task time limit is exceeded and the file transfer is not successful, reporting the failed status of the file transfer to the transmission controller.

[0011] The second aspect of the present invention proposes a file transfer method, including: determining the configuration information of the transmission task; obtaining the configuration information of the target task from the configuration information of the transmission task; grouping the transmission file list based on the configuration information when the configuration information of the target task is detected to be normal; assigning a transmission thread to each file group, performing file transfer based on the transmission thread and the file server, and determining that the file transfer is successful based on the file attributes.

[0012] According to the third aspect of the present invention, an electronic device is proposed, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute any of the methods described in the second aspect of the present invention.

[0013] According to a fourth aspect of the present invention, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable the computer to execute any one of the methods according to the second aspect of the present invention.

[0014] The beneficial effects of the present invention are as follows:

[0015] The file transmission system and method of the present invention include: a transmission controller for determining the configuration information of the transmission task; a transmission client for requesting the target task configuration from the transmission controller, and when the configuration information of the target task is received and the configuration information of the target task is detected to be normal, the transmission file list is grouped based on the configuration information, and a transmission thread is allocated to each file group, and the file transmission is performed based on the transmission thread and the file server; the file server is used to perform file transmission when connected to the transmission client, and determine that the file transmission is successful based on the file attributes. Through efficient task configuration management, intelligent file grouping and multi-threaded transmission, reliable file transmission and verification, flexible system scalability and optimized user experience, an efficient, stable and reliable file transmission service is achieved. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The accompanying drawings are only used to illustrate specific embodiments and are not considered to limit the present invention. In the entire drawings, the same reference symbols represent the same components. Obviously, the drawings described below are only some embodiments recorded in the embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings.

[0017] Figure 1 is a schematic diagram of a file transmission system according to an embodiment of the present invention;

[0018] Figure 2 is a flowchart of a file transmission method according to an embodiment of the present invention;

[0019] Figure 3 It is a structural block diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0020] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present invention, the technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all of the embodiments. It should be understood that these descriptions are only exemplary and are not intended to limit the scope of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in the field without making creative work should fall within the scope of protection of the present invention.

[0021] Furthermore, in the following description, descriptions of well-known structures and technologies are omitted to avoid unnecessarily obscuring the concepts disclosed in the present invention.

[0022] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the orientation or position relationship indicated by the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inside", "outside", etc. is based on the orientation or position relationship shown in the drawings, which is only for the convenience of describing the present invention and simplifying the description, and does not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation of the present invention. In addition, the terms "first", "second", and "third" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. The terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be a connection between the two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0023] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of methods and systems consistent with some aspects of the present invention as detailed in the appended claims.

[0024] The present invention proposes a file transmission system, method and related equipment. Specifically, the file transmission system, method and related equipment of the embodiments of the present invention are described below with reference to the accompanying drawings.

[0025] Figure 1 is a schematic diagram of a file transmission system according to an embodiment of the present invention. Figure 1 As shown, the file transmission system includes:

[0026] The transmission controller 110 is used to determine the configuration information of the transmission task;

[0027] The transmission client 120 is used to request the target task configuration from the transmission controller 110, and when the configuration information of the target task is received and the configuration information of the target task is detected to be normal, the transmission file list is grouped based on the configuration information, and a transmission thread is allocated to each file group, and the file is transmitted based on the transmission thread and the file server 130;

[0028] The file server 130 is used to perform file transmission when connected to the transmission client 120, and determine whether the file transmission is successful based on the file attributes.

[0029] In an embodiment of the present invention, the configuration information includes the file server's identification, account password, file directory, file, execution time, and task validity, wherein the transmission controller 110 is used to receive the target task configuration requested by the transmission client and send the target task configuration to the transmission client 120.

[0030] That is to say, the transmission client 120 requests the target task configuration from the transmission server 110. The transmission server 110 receives the target task configuration requested by the transmission client 120 and sends the target task configuration to the transmission client 120. When the transmission client 120 receives the configuration information of the target task, it can detect the configuration information, for example, whether the file server is reachable, whether the account is valid, whether the directory is normal, etc. If the detection is normal, the transmission file list is grouped based on the configuration information, and a transmission thread is assigned to each file group. File transfer is performed when the transmission client 120 is connected to the file server 130, and the success of the file transfer is determined based on the file attributes.

[0031] In the embodiment of the present invention, the transmission file list is read based on the execution time in the configuration information, and the transmission file list is grouped based on the identifier of the file server 130 in the configuration information.

[0032] In the case of grouping the transfer file list, the files in the transfer file list are sorted based on the task timeliness in the configuration information, wherein the shorter the task timeliness is, the higher the file transfer priority is. That is, the order of file transfer is controlled by file grouping and sorting, and the groups are grouped by the target file server. The same groups can use the same thread allocation parameters and retry strategies, and are sorted by task timeliness to ensure that the files with shorter task timeliness and higher priority are delivered to the designated file server first.

[0033] In an embodiment of the present invention, when a transmission thread is allocated to each file group, the transmission client 120 is connected to the file server 130 and detects whether connection restriction is triggered; wherein, when connection restriction is not triggered, the number of threads of each file group is increased, wherein the increased number of threads does not exceed the target number; when connection restriction is triggered, the number of threads of each file group is reduced, wherein the number of threads of each file group is at least one. For example, the number of increased threads does not exceed 2. That is, through dynamic allocation of file transfer threads, when the file server limit is not reached, the threads are gradually increased to detect the maximum upper limit value, so that the transmission client 120 can complete the file transfer as soon as possible with the optimal parameters; when the limit is triggered, the transmission threads are immediately reduced to avoid further deterioration of the problem and waste of resources. Therefore, the present invention can improve the transmission efficiency while avoiding triggering file server restrictions and IP bans.

[0034] In an embodiment of the present invention, file attributes include file size or MD5 code, wherein the file attributes can be requested from the file server 130 through the transmission client 120; when the file attributes returned by the file server 130 are consistent with the file attributes recorded by the transmission client 120, it is determined that the file transfer is successful; wherein, when the file transfer is successful, the status of the successful file transfer is reported to the transmission controller 110.

[0035] In one embodiment of the present invention, when the file attributes returned by the file server are inconsistent with the file attributes recorded by the transmission client, the file transfer is continued based on the number of retries and the task time limit; when the number of retries and / or the task time limit are exceeded and the file transfer is unsuccessful, the status of the file transfer failure is reported to the transmission controller 110. That is, the transmission reliability is ensured by double verification. After the file is transferred from the transmission client 120 to the file server 130, the file attributes need to be requested from the file server 130 to ensure the consistency of the file; the transmission client 120 reports the file transfer result to the transmission controller 110. After all the transmissions are completed or when the transmission client 120 recovers from an abnormality, the file transfer result needs to be requested from the transmission controller 110. If there is an abnormal state, the retransmission mechanism is triggered to ensure the transmission reliability.

[0036] In a specific embodiment of the present invention, the file transmission system is implemented as follows:

[0037] 1. Configure the required transmission task in the transmission controller 110, including the identification, account password, file directory, file, execution time, task timeliness and other information of the file server 130;

[0038] 2. The transmission client 120 requests task configuration from the transmission controller 110, and the transmission controller 110 returns the specified task configuration information;

[0039] 3. The transmission client 120 performs configuration detection, including whether the file server 130 is reachable, whether the account is valid, whether the file directory is normal, etc., and returns the result to the transmission controller 110; if the detection result is abnormal, including the file server is unreachable, the account is invalid, the connection is abnormal, the directory does not exist, the permission is abnormal, etc., then wait for the transmission controller 110 to repair the configuration; if the detection is normal, go to step 4;

[0040] 4. The transmission client 120 reads the list of files to be transmitted according to the configured execution time;

[0041] 5. The transmission client 120 groups the read file list according to the configured file servers;

[0042] 6. The transmission client 120 sorts the file list in each group according to the configured task timeliness. The file with the shorter task timeliness has a higher transmission priority to ensure that the file is delivered first;

[0043] 7. The transmission client 120 allocates a file transmission thread for each file group. The initial number of threads cannot be set too large, otherwise, if the file server 130 sets a connection limit, the limit will be triggered and the file cannot be transmitted normally;

[0044] 8. The file transfer thread of the transfer client 120 executes the following loop:

[0045] 8.1 Start connecting to the file server 130. If the connection is restricted, continuing to perform the connection transfer may cause the file server 130 to ban the client IP. Therefore, enter step 9 to adjust the dynamic thread. If the connection is normal, enter step 8.2 to start file transfer.

[0046] 8.2 Obtain a file to be transferred, report the file transfer status to the transfer controller 110, and start transferring the file to the file server 130; if the transfer ends normally, proceed to step 8.3; if a transfer exception is captured, proceed to step 8.4 retry logic;

[0047] 8.3 Request file attributes from the file server 130, usually using the file size or MD5 code as an identifier; if the returned file attributes are consistent with the records of the transmission client 120, it means that the transmission is successful, and the status of the successful file transmission is reported to the transmission controller 110, and the next file is transmitted until all files are transmitted; if the returned file attributes are inconsistent, enter the retry logic in step 8.4;

[0048] 8.4 After the delay waiting, the number of retries and the time limit of the task are determined. If the limit is exceeded, the transmission is terminated and the transmission failure status is reported to the transmission controller 110; if the limit is not exceeded, the file transmission logic is executed again;

[0049] 9. After allocating the file transfer thread, the transmission client 120 starts to detect whether the connection restriction is triggered. If the connection restriction is triggered, the number of file transfer threads is reduced, but at least one file transfer thread must be retained; if the connection restriction is not triggered, the number of threads is increased to improve the transmission efficiency, and the number of threads increased each time shall not exceed 2;

[0050] 10. After all the transmissions are completed or when the transmission client 120 exits and restarts due to an unknown abnormality, it requests the transmission controller 110 for a list of files that have not been completed, and adds the files to the queue to be transmitted, and enters step 6 to execute the file transmission logic.

[0051] According to the file transmission system of the embodiment of the present invention, the transmission controller is used to determine the configuration information of the transmission task; the transmission client is used to request the target task configuration from the transmission controller, and when the configuration information of the target task is received and the configuration information of the target task is detected to be normal, the transmission file list is grouped based on the configuration information, and a transmission thread is assigned to each file group, and the file transmission is performed based on the transmission thread and the file server; the file server is used to perform file transmission when connected to the transmission client, and determine that the file transmission is successful based on the file attributes. The system determines the configuration information of the transmission task through the transmission controller, and the system can flexibly configure various transmission parameters, such as transmission speed, priority, target path, etc., to meet the needs and scenarios of different users; this centralized configuration method reduces the configuration workload of the client and improves the accuracy and consistency of the configuration. The transmission client can intelligently group the transmission file list according to the configuration information of the target task. This can be done according to the attributes such as file size, type, priority, etc. to improve the transmission efficiency; each file group is assigned an independent transmission thread, so that multiple file transmission tasks can be processed in parallel, greatly shortening the transmission time; multi-threaded transmission also enhances the concurrent processing capability of the system, enabling it to more effectively utilize network resources. After the file server establishes a connection with the transmission client, it performs file transfer. This connection mechanism ensures the reliability and stability of file transfer; the file server can also determine whether the file transfer is successful based on the file attributes. This verification mechanism further improves the accuracy and integrity of file transfer. The system adopts a modular design concept. The transmission controller, transmission client and file server each have different responsibilities, which is convenient for system maintenance and upgrades; as business needs grow, the number of transmission controllers, transmission clients or file servers can be easily increased to improve the system's processing power and scalability. Users only need to request the target task configuration from the transmission controller through the transmission client, and do not need to worry about the underlying file grouping, multi-threaded transmission and other complex operations, which reduces the difficulty of use; the system provides real-time transmission progress, error prompts and other functions, which further improves the user experience.

[0052] In order to make it easier for those skilled in the art to understand the present invention, Figure 2 A file transmission method according to a specific embodiment of the present invention is as follows. Figure 2 As shown, the file transmission method includes:

[0053] S210: Determine configuration information of the transmission task.

[0054] In the embodiment of the present invention, the configuration information includes but is not limited to the identification of the file server, account password, file directory, file, execution time, task timeliness, etc.

[0055] S220, obtaining configuration information of the target task from the configuration information of the transmission task.

[0056] S230: When the configuration information of the target task is detected to be normal, the transmission file list is grouped based on the configuration information.

[0057] In an embodiment of the present invention, the transmission file list is read based on the execution time in the configuration information; and the transmission file list is grouped based on the identifier of the file server in the configuration information.

[0058] In an embodiment of the present invention, when the transfer file list is grouped, the files in the transfer file list are sorted based on the task timeliness in the configuration information, wherein the shorter the task timeliness is, the higher the file transfer priority is.

[0059] S240, allocating a transmission thread to each file group, performing file transmission based on the transmission thread and the file server, and determining that the file transmission is successful based on the file attributes.

[0060] In an embodiment of the present invention, when a transmission thread is allocated to each file group, the transmission client connects to the file server and detects whether connection restriction is triggered; wherein, when connection restriction is not triggered, the number of threads for each file group is increased, wherein the increased number of threads does not exceed the target number; when connection restriction is triggered, the number of threads for each file group is reduced, and the number of threads for each file group is at least one.

[0061] In an embodiment of the present invention, the file attributes include the file size or the MD5 code, wherein the file attributes can be requested from the file server through the transmission client; when the file attributes returned by the file server are consistent with the file attributes recorded by the transmission client, it is determined that the file transfer is successful; wherein the status of the successful file transfer is reported to the transmission controller.

[0062] According to the file transfer method of the embodiment of the present invention, the configuration information of the transmission task is determined; the configuration information of the target task is obtained from the configuration information of the transmission task; when the configuration information of the target task is detected to be normal, the transmission file list is grouped based on the configuration information; a transmission thread is allocated to each file group, and the file is transferred based on the transmission thread and the file server, and the success of the file transfer is determined based on the file attributes. The method realizes efficient, stable and reliable file transfer services through efficient task configuration management, intelligent file grouping and multi-threaded transmission, reliable file transmission and verification, flexible system scalability and optimized user experience.

[0063] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods of each embodiment of the present application.

[0064] According to one aspect of an embodiment of the present invention, an electronic device is provided.

[0065] Figure 3 Schematic diagram of the structure of an electronic device according to an embodiment of the present invention. Figure 3 As shown, the electronic device may include one or more ( Figure 3 Only one is shown in the figure) processor 102 (processor 102 may include but is not limited to a microprocessor (Microprocessor Unit, referred to as MPU) or a programmable logic device (Programmable logic device, referred to as PLD)) and a memory 104 for storing data. In an exemplary embodiment, the electronic device may also include a transmission device 106 and an input / output device 108 for communication functions. It can be understood by those skilled in the art that Figure 3 The structure shown is for illustration only and does not limit the structure of the above terminal device. Figure 3 More or fewer components as shown, or with Figure 3 Equivalent functions or comparisons shown Figure 3 A different configuration with more features is shown.

[0066] The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the file transfer method in the embodiment of the present invention. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, to implement the above method. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory remotely arranged relative to the processor 102, and these remote memories may be connected to the terminal device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0067] The transmission device 106 is used to receive or send data via a network. The specific example of the above network may include a wireless network provided by a communication provider of the switching device. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, referred to as NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0068] The present invention provides a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to enable the computer to execute a file transmission method.

[0069] The applicant of the present invention has made a detailed explanation and description of the implementation examples of the present invention in conjunction with the drawings in the specification. However, those skilled in the art should understand that the above implementation examples are only preferred implementation schemes of the present invention, and the detailed description is only to help readers better understand the spirit of the present invention, but not to limit the scope of protection of the present invention. On the contrary, any improvements or modifications based on the inventive spirit of the present invention should fall within the scope of protection of the present invention.

[0070] In addition, each functional unit in each embodiment of the present invention may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0071] The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present invention have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limiting the present invention. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present invention.

[0072] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the embodiments of the present invention, rather than to limit them. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions recorded in the above embodiments, or replace some of the technical features therein by equivalents; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention. Any changes or replacements that can be easily thought of by those skilled in the art within the technical scope disclosed in the present invention should be covered within the protection scope of the present invention.

Claims

1. A file transmission system, characterized in that: include: A transmission controller, used to determine configuration information of the transmission task; A transmission client, used for requesting the target task configuration from the transmission controller, and when receiving the configuration information of the target task and detecting that the configuration information of the target task is normal, grouping the transmission file list based on the configuration information, and assigning a transmission thread to each file group, and performing file transmission based on the transmission thread and the file server; The file server is used to perform the file transfer when connected to the transfer client, and determine that the file transfer is successful based on file attributes.

2. The file transfer system according to claim 1, characterized in that: The configuration information includes the identification, account password, file directory, file, execution time, and task validity of the file server, wherein the transmission controller is used to receive the target task configuration requested by the transmission client and send the target task configuration to the transmission client.

3. The file transfer system according to claim 1, characterized in that: The transmission file list is grouped based on the configuration information, including: Read the transfer file list based on the execution time in the configuration information; The transmission file list is grouped based on the identifier of the file server in the configuration information.

4. The file transfer system according to claim 3, characterized in that: Also includes: In the case of grouping the transfer file list, the files in the transfer file list are sorted based on the task timeliness in the configuration information, wherein the shorter the task timeliness is, the higher the file transfer priority is.

5. The file transfer system according to claim 1, characterized in that: In the case where a transmission thread is allocated to each file group, the transmission client connects to the file server and detects whether connection restriction is triggered; wherein, In the case where connection restriction is not triggered, increasing the number of threads for each file group, wherein the increased number of threads does not exceed the target number; In the case of triggering connection limitation, the number of threads of each file group is reduced, and the number of threads of each file group is at least one.

6. The file transfer system according to claim 1, characterized in that: The file attribute includes a file size or an MD5 code, wherein determining that the file transfer is successful based on the file attribute includes: The transmission client requests the file attribute from the file server; When the file attributes returned by the file server are consistent with the file attributes recorded by the transmission client, it is determined that the file transmission is successful; wherein, The system further comprises: reporting the status of successful file transmission to the transmission controller.

7. The file transfer system according to claim 6, characterized in that: Also includes: When the file attribute returned by the file server is inconsistent with the file attribute recorded by the transmission client, continuing the file transmission based on the number of retries and the task time limit; When the number of retries and / or the task time limit is exceeded and the file transfer is unsuccessful, the file transfer failure status is reported to the transmission controller.

8. A file transmission method, characterized in that: include: Determine the configuration information of the transmission task; Acquire the configuration information of the target task from the configuration information of the transmission task; When the configuration information of the target task is detected to be normal, grouping the transmission file list based on the configuration information; A transmission thread is allocated to each file group, the file is transmitted based on the transmission thread and the file server, and the success of the file transmission is determined based on the file attribute.

9. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, wherein the instructions are executed by the at least one processor so as to enable the at least one processor to perform the method of claim 8.

10. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to cause the computer to execute the method according to claim 8.

Images