Multi-thread file registration method and device

Abstract

The invention provides a multi-thread file registration method and device, and relates to the technical field of information processing, and the method comprises the steps: obtaining the basic parameters of a to-be-registered file, a threshold value of the number of memory files, and the number of registration threads; scanning the file list of the target position by using a single thread according to the threshold value of the number of the memory files, and determining target to-be-registered file information according to the basic parameters; sending the target to-be-registered file information to a memory database to enable the memory database to generate state mark data of the target to-be-registered file; and generating a multi-thread file registration result according to the targetto-be-registered file information, the state flag data, the registration thread number values and the basic parameters. The file registration efficiency can be improved.

Description

Technical field [0001] The present invention relates to the technical field of information processing, in particular to a method and device for multithreaded file registration. Background technique [0002] File registration includes the process of recording file information to the database and moving files from the source directory to the target directory. When processing daily download files from multiple source systems in a source directory, there are a lot of files, and if there are special dates such as the end of the month, the end of the year, the interest date, etc., the number of large files will also be large, which leads to file registration The process is slow and time consuming, which affects the speed of subsequent file loading. The multi-thread registration method can improve the efficiency of file registration to a certain extent. However, in the prior art, in the process of multi-thread registration, the concurrency of files is controlled through the database. E...

AI Technical Summary

Problems solved by technology

When processing daily download files from multiple source systems in a certain source directory, there are a large number of files, and if there are special dates such as the end of the month, year-end, interest calculation day, etc., the number of large files will also be large, resulting in file registration The process is slow and time-consuming, which affects the speed of subsequent file loading

The multi-threaded registration method can improve the efficiency of file registration to a certain extent. However, in the prior art, during the multi-threaded registration process, the file concurrency is controlled through the database. After each registration thread obtains a file that can be registered, it queries the current file record in the database. , not only the database connection is frequent, but also multiple threads may obtain the same file at the same time, resulting in repeated processing, and the efficiency of file registration needs to be improved

Images