Unlock instant, AI-driven research and patent intelligence for your innovation.
Distributed network downloading method and device for massive large files
What is Al technical title?
Al technical title is built by PatSnap Al team. It summarizes the technical point description of the patent document.
A distributed network and large file technology, applied in multi-programming devices, resource allocation, electrical components, etc., can solve problems such as unproposed solutions
Pending Publication Date: 2021-12-24
易海陆圆(山东)数字技术有限公司
View PDF0 Cites 0 Cited by
Summary
Abstract
Description
Claims
Application Information
AI Technical Summary
This helps you quickly interpret patents by identifying the three key elements:
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more
Image
Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
Click on the blue label to locate the original text in one second.
Reading with bidirectional positioning of images and text.
Smart Image
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0023] figure 1 It is a flow chart of a method for downloading a massive large file distributed network according to an embodiment of the present invention, such as figure 1 As shown, the method includes the following steps:
[0024] Step S102, submitting the download address at the control node.
[0025] Step S104, monitoring task status according to the download address.
[0026] Step S106, according to the task status, perform multi-thread download to obtain download data.
[0027] Step S108, judging whether the downloaded data needs to be downloaded repeatedly.
[0028] Optionally, after the task status is monitored according to the download address, the method further includes: acquiring a busy status according to the task status.
[0029] Optionally, the task status includes: busy status and idle status.
[0030] Optionally, after the judging whether the downloaded data needs to be downloaded repeatedly, the method further includes: repeating to the monitoring task ...
Embodiment 2
[0046] figure 2 It is a flow chart of a massive large file distributed network downloading device according to an embodiment of the present invention, such as figure 2 As shown, the device includes:
[0047] The download module 20 is used for submitting the download address at the control node.
[0048] The monitoring module 22 is configured to monitor the status of the task according to the download address.
[0049] The multi-thread module 24 is configured to perform multi-thread download according to the task status to obtain download data.
[0050] A judging module 26, configured to judge whether the downloaded data needs to be downloaded repeatedly.
[0051] Optionally, after the task status is monitored according to the download address, the method further includes: acquiring a busy status according to the task status.
[0052] Optionally, the task status includes: busy status and idle status.
[0053] Optionally, after the judging whether the downloaded data need...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More
PUM
Login to View More
Abstract
The invention discloses a distributed network downloading method and device for massive large files. The method comprises the following steps: submitting a downloading address at a control node; monitoring a task state according to the downloading address; performing multi-thread downloading according to the task state to obtain downloaded data; and judging whether the downloaded data needs to be downloaded repeatedly or not. The invention solves the problem that in the prior art, although a downloading program can be continuously operated on a server, the downloading period is long when a large number of data files are downloaded due to resource limitation of a single server network, storage and the like. In addition, the invention solves the technical problems that commands such as curl and wget do not support a multi-thread technology so that the efficiency is low and the downloading speed is low when a single large file is downloaded, and the commands do not support remote rpc calling, and remote monitoring and downloading task scheduling are not facilitated.
Description
technical field [0001] The invention relates to the field of data downloading, in particular to a method and device for downloading a large number of large files in a distributed network. Background technique [0002] With the continuous development of intelligent technology, more and more intelligent devices are used in people's life, work and study. The use of intelligent technology has improved the quality of people's life and increased the efficiency of people's study and work. [0003] In atmospheric science, hydrology, oceanography, environmental simulation, geophysics and many other scientific research fields, datasets are usually published as files in a specific format on the Internet for shared access. Common data formats include netCDF, HDF, GRIB, etc. The data in these scientific research fields are usually released according to the organization of data type and time. Some form a file of daily data, and some are monthly or yearly. These files contain data of sever...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More
Application Information
Patent Timeline
Application Date:The date an application was filed.
Publication Date:The date a patent or application was officially published.
First Publication Date:The earliest publication date of a patent with the same application number.
Issue Date:Publication date of the patent grant document.
PCT Entry Date:The Entry date of PCT National Phase.
Estimated Expiry Date:The statutory expiry date of a patent right according to the Patent Law, and it is the longest term of protection that the patent right can achieve without the termination of the patent right due to other reasons(Term extension factor has been taken into account ).
Invalid Date:Actual expiry date is based on effective date or publication date of legal transaction data of invalid patent.
Login to View More 
Login to View More