A multi-thread based file upload system and method

Abstract

The invention discloses a file uploading system and method based on multithreading. The method comprises the following steps: firstly, configuration parameters of a client are acquired, and a file count which needs to be uploaded by a user is selected at the same time; then, according to a cpu count and the file count, the number of threads which need to be established is determined according to predetermined rules; finally, files to be uploaded are distributed to the n threads according to the principle that file sizes are balanced, and the n threads operate at the same time till uploading is completed. The file uploading system and method based on multithreading improve uploading efficiency of large-batch small files (including word, txt, YOBON files, excel and other office files); besides, in the uploading process, the large-batch small files are divided into groups (the group division principle is that the difference value of file sizes in each group is the smallest and the most balanced) and uploaded through the multiple threads, and therefore the effect of making the most of uploading bandwidth is achieved.

Description

technical field [0001] The invention relates to the field of uploading large batches of small files, in particular to a system and method for uploading files based on multithreading. Background technique [0002] In the prior art, a large number of file uploads will use multi-threading technology to improve efficiency, but when allocating the number of threads, a one-size-fits-all model is often used, that is, only a fixed number of threads is allocated regardless of the configuration of the local computer hardware. This causes two problems: 1. The computer with good hardware configuration does not allocate enough threads, so that the hardware function is not fully utilized, which affects the upload efficiency; 2. The computer with low hardware configuration allocates too many threads, which causes the computer to freeze and also affects the uploading efficiency. File upload efficiency. [0003] In view of this, the prior art needs to be improved and improved. Contents of...

AI Technical Summary

Problems solved by technology

[0004] In view of the deficiencies in the prior art above, the purpose of the present invention is to provide a file upload system and method based on multi-threading, so as to solve the problem of directly adopting multiple uploading methods without considering the hardware itself in the process of uploading large batches of small files in the prior art. Threads may appear stuck, etc., and even affect system performance.

Images