Marine data automatic downloading method and system

Through multi-threaded parallel download and asynchronous transmission technology, combined with semaphore control, the number of download threads is solved, and the server response time abnormality caused by the unlimited number of download requests and the number of multi-threads in the existing technology is solved, and fast and reliable file downloads and distribution.

CN119449791APending Publication Date: 2025-02-14青岛国实科技集团有限公司
1 Cites 1 Cited by

Patent Information

Application Number
CN202411588946.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-08
Publication Date
2025-02-14

AI Technical Summary

Technical Problem

The prior art does not limit the number of download requests and the number of multiple threads, resulting in obvious abnormalities in the server response time when the number of multiple download threads exceeds the range of parallel requests.

Method used

Through multi-threaded parallel download and asynchronous transmission technology, the number of download threads is controlled in combination with semaphores to ensure the stability and efficiency of the download process, and dynamically adjust the number of download requests and semaphores to avoid abnormal server response time.

Benefits of technology

It realizes fast and reliable download and distribution of files, ensures the stability and efficiency of the download process, avoids abnormal server response time, and improves the system's concurrency capability and resource utilization efficiency.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention relates to an automatic marine data downloading method and system, and belongs to the technical field of data transmission, and the method comprises the steps that downloading parameters and task parallel requirements are acquired, and the downloading parameters comprise remote server information and the number of downloaded files; a downloading thread is created through a main thread according to the number of downloaded files and task parallel requirements, and the downloading thread independently sends a downloading request to a remote server; the remote server sends a downloading file to a downloading thread according to the downloading request, the downloading thread processes data of the downloading file in parallel according to a preset semaphore, the downloading file is stored in a database, and a downloading success notification is sent to the main thread; transmitting the successfully downloaded download file to a remote server through an asynchronous mechanism; wherein the asynchronous transmission step and the multi-thread downloading step are carried out in parallel; through multi-thread parallel downloading and asynchronous transmission, quick and reliable downloading and distribution of files are achieved, the number of downloading threads is controlled through semaphores, and stability and high efficiency of the downloading process are ensured.
Need to check novelty before this filing date? Find Prior Art