A data dump download method that does not occupy local disk space

Abstract

The present invention provides a data dump download method that does not occupy the local disk space, including packaging the original file to be packaged, and redirecting the packaged output to the input of the pipeline module; if it is data dump: the remote copy module from The output terminal of the pipeline module reads the data and dumps it directly to the disk of the remote device; if it is data download: the Web server download module reads the data from the output terminal of the pipeline module and transmits the data to user browser. A data dump and download method that does not occupy local disk space according to the present invention can realize data transfer without occupying local disk space and has a dynamic speed limit control function by using a packaging module, a pipeline module, and a dynamic speed limit control module together. It has the characteristics of not generating temporary compressed files, not occupying local disk space, dynamic speed limit control, and safe and stable execution speed.

Description

technical field [0001] The invention belongs to the field of information technology, in particular to a method for dumping and downloading data without occupying local disk space. Background technique [0002] With the rapid development of information technology, human beings are moving from the IT era to the DT era, and a large amount of data is generated in the information network at any time. Whether the front-end users obtain the required data from the web server through the browser, or the background maintenance personnel collect maintenance data information from the server, it has become more frequent and normalized. Under the existing technical conditions, when multiple files need to be packaged and dumped or downloaded, generally the multiple files are packaged into a compressed package on the local device first, and then the web server is used for the user to use the browser to download all files. The generated compressed package, or copy the generated compressed p...

AI Technical Summary

Problems solved by technology

[0003] This commonly used method has the following problems: First, there are too many IO operations in the process of the generated temporary compressed package: at least three IO operations are included: the read operation when reading the original file to be compressed, the write operation when generating the temporary compressed package, and the user download or read operation during remote copying; second, the generated temporary compressed package will occupy valuable local disk space: the generated temporary compressed package is only a copy of the original data, which will occupy valuable disk space, especially when the original data file is large , the problem of hard disk space occupation is more serious; the third is that when the disk free space is insufficient, the generation of the compressed package will fail, resulting in the failure of subsequent operations: when the free space of the local disk is less than the disk space required by the compressed package, the package will fail, and the user’s download The request or remote copy task cannot continue; the fourth is the slow packaging process: when there are too many packaged contents, the packaging process takes a long time, and the user or management personnel can only wait, the operation efficiency is low, and the user experience is not good; the fifth is the generated Temporary compressed package needs to be deleted: because the generated compressed package is only for temporary use, it needs to be deleted after use, but because the web server cannot grasp when the user downloads and whether the user needs to download repeatedly, it is inconvenient to grasp the timing of deletion, and the deletion is too early It will cause the user to be unable to download repeatedly, and the compressed package will occupy disk space if deleted too late.

Images