File downloading method, device, equipment, storage medium and program product

By creating multiple download queues for different file types and setting corresponding review criteria and sliding window lengths, the problems of low accuracy and efficiency in file review were solved, achieving more efficient file review.

CN119135675BActive Publication Date: 2026-02-24CHINA MOBILE INTERNET CO LTD +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411238756.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-09-04
Publication Date
2026-02-24
Estimated Expiration
2044-09-04

AI Technical Summary

Technical Problem

In existing technologies, the diversity and uneven quantity of document types lead to poor accuracy and low efficiency in document review.

Method used

Create multiple secondary download queues, store download links according to file type, and set corresponding file review criteria and sliding window length for each queue to reasonably allocate the number of download threads and ensure balanced processing among different file types.

Benefits of technology

This improved the accuracy and efficiency of document review, avoiding a decline in overall review efficiency due to an excessive volume of certain document types being reviewed.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119135675B_ABST
    Figure CN119135675B_ABST
Patent Text Reader

Abstract

The application discloses a file downloading method and device, equipment, storage medium and program product, and relates to the technical field of data processing. The file downloading method comprises the following steps: receiving a file auditing request, wherein the request comprises the file types of a plurality of files and the download links of the files; storing the file types of the files and the download links of the files into a first download queue; sequentially moving the download links of the files from the first download queue to a second download queue corresponding to the file types according to the file types; setting a corresponding sliding window length for the second download queue corresponding to each file type according to the reference download thread number of the auditing platform and the auditing amount proportion of each file type within a preset time period; and sequentially obtaining the download links from the corresponding second download queue according to the sliding window lengths to download the files. Through the embodiment, the accuracy and efficiency of file auditing can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application belongs to the field of data processing technology, and in particular relates to a file download method, apparatus, device, storage medium and program product. Background Technology

[0002] With the continuous development of cloud storage services, the amount of stored content in cloud storage is increasing. Managing this stored content is a problem that needs to be solved to prevent criminals from using cloud storage to spread illegal content and have a negative impact on society.

[0003] In existing methods, the review platform receives the review request from the business, obtains the corresponding file download address, and downloads and reviews the review file by requesting download.

[0004] However, due to the diversity of document types and the uneven distribution of document quantities, the accuracy and efficiency of document review are poor. Summary of the Invention

[0005] This application provides a file download method, apparatus, device, storage medium, and program product, which can improve the accuracy and efficiency of file review.

[0006] One aspect of this application provides a file download method, the method comprising:

[0007] Receive file review requests, which include the file types of multiple files and download links for each file;

[0008] Store the file type and download link of each file in the request into the first download queue;

[0009] Based on the file type, the download links of each file are moved sequentially from the first download queue to the second download queue corresponding to the file type.

[0010] Based on the reference download thread count of the review platform and the review volume ratio of each file type within a preset time period, set the corresponding sliding window length for the second download queue for each file type;

[0011] Based on the length of each sliding window, download links are sequentially retrieved from the corresponding second download queue for file download.

[0012] In one aspect of this application, a file downloading apparatus is provided, the apparatus comprising:

[0013] The request receiving module is used to receive file review requests, which include the file types of multiple files and the download links for each file.

[0014] The file storage module is used to store the file type and download link of each file in the request to the first download queue.

[0015] The link migration module is used to move the download links of each file from the first download queue to the second download queue corresponding to the file type, based on the file type.

[0016] The length setting module is used to set the corresponding sliding window length for the second download queue for each file type based on the reference download thread count of the review platform and the review volume ratio of each file type within a preset time period.

[0017] The link acquisition module is used to sequentially acquire download links from the corresponding second download queue based on the length of each sliding window to download the files.

[0018] In one aspect of this application, an electronic device is provided, the device including: a memory and a program or instructions stored in the memory and executable on a processor, wherein when the program or instructions are executed by the processor, they implement the file download method provided in any aspect of the above-described embodiments of this application.

[0019] In one aspect of the embodiments of this application, a readable storage medium is provided, on which a program or instruction is stored, and when the program or instruction is executed by a processor, it implements the file download method provided by any aspect of the embodiments of this application described above.

[0020] In one aspect of the embodiments of this application, a computer program product is provided, wherein when the instructions in the computer program product are executed by the processor of an electronic device, the electronic device performs a file download method as provided in any aspect of the embodiments of this application described above.

[0021] In the document processing method provided in this application embodiment, multiple second download queues are created according to file type, and each second download queue stores download links for files of the corresponding file type. Based on the file type corresponding to each second download queue, corresponding file review standards can be set for each second download queue, thereby improving the accuracy of document review. Simultaneously, based on the reference download thread count of the review platform and the review volume ratio of each file type within a preset time period, a corresponding sliding window length is set for each second download queue corresponding to each file type. Allocating the corresponding number of download threads according to the review volume of each file type ensures balanced processing among file types and avoids low overall document review efficiency due to an excessively large review volume for a certain file type. Thus, by creating multiple second download queues and configuring corresponding download thread counts for each second download queue, this application embodiment can improve both the accuracy and efficiency of document review. Attached Figure Description

[0022] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments of this application will be briefly introduced below. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0023] Figure 1 This is a schematic flowchart of a file download method provided in one embodiment of this application;

[0024] Figure 2 This is a schematic diagram illustrating the process of downloading files using a second download queue according to an embodiment of this application;

[0025] Figure 3 This is a schematic diagram of the process for adjusting the length of a sliding window according to an embodiment of this application;

[0026] Figure 4 This is a schematic diagram of the structure of a file download device provided in one embodiment of this application;

[0027] Figure 5 This is a schematic diagram of the structure of a file download device provided in one embodiment of this application. Detailed Implementation

[0028] The features and exemplary embodiments of various aspects of this application will be described in detail below. To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain this application and not to limit it. For those skilled in the art, this application can be implemented without some of these specific details. The following description of the embodiments is merely to provide a better understanding of this application by illustrating examples.

[0029] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus that includes said element.

[0030] It should be noted that the acquisition, storage, use, and processing of data in the technical solution of this application all comply with the relevant provisions of national laws and regulations.

[0031] It should be noted that in the embodiments of this application, certain software, components, models and other existing solutions in the industry may be mentioned. These should be regarded as exemplary and are only intended to illustrate the feasibility of implementing the technical solution of this application. However, it does not mean that the applicant has used or necessarily used the solution.

[0032] In related technologies, the review platform receives review requests from businesses, obtains the corresponding file download addresses, and downloads and reviews the files through a request-to-download method. However, due to the diversity of file types and the uneven distribution of file quantities, the accuracy and efficiency of file review are poor.

[0033] The purpose of this application is to provide a file download method, apparatus, device, storage medium, and program product. In the file download method provided by this application, multiple second download queues are created according to file type, and each second download queue stores download links for files of the corresponding file type. Based on the file type corresponding to each second download queue, corresponding file review standards can be set for each second download queue, thereby improving the accuracy of file review. Simultaneously, based on the reference download thread count of the review platform and the review volume ratio of each file type within a preset time period, a corresponding sliding window length is set for each second download queue corresponding to each file type. Allocating the corresponding number of download threads according to the review volume of each file type ensures balanced processing among file types and avoids low overall file review efficiency due to excessive review volume of a certain file type. Thus, by creating multiple second download queues and configuring corresponding download thread counts for each second download queue, this application embodiment can improve both the accuracy and efficiency of file review.

[0034] The following describes specific embodiments of the file download method, apparatus, device, storage medium, and program product provided in this application. The case processing method will be described first.

[0035] Figure 1 A flowchart of a file download method is provided. This file download method can be applied to a server and may include the following steps S101 to S105.

[0036] S101, Receive file review request, the request includes the file types of multiple files and the download links of each file.

[0037] In this embodiment, the file review request includes multiple file types of files to be reviewed and their corresponding download links. For example, file types may include image types, video types, audio types, and document types.

[0038] As an example, the server responds to a file review request initiated by the upstream business unit, receiving the file types of each file to be reviewed and their corresponding download links. Furthermore, the file review request may also include basic information such as file size and file extension.

[0039] S102, store the file type and download link of each file in the request into the first download queue.

[0040] In this embodiment, the first download queue is the main queue responsible for maintaining the order and status of the files to be reviewed. It is only responsible for retrieving and storing the file type and download link of the files to be reviewed, and does not perform the actual download task.

[0041] As an example, after receiving a file review request, the server stores the file type and download link of each file to be reviewed in the file review request into the first download queue.

[0042] S103, according to the file type, move the download links of each file from the first download queue to the second download queue corresponding to the file type in sequence.

[0043] In this embodiment, the second download queue is a sub-queue responsible for executing the actual download tasks, with each file type corresponding to a separate second download queue. For example, image types can correspond to second download queue A, video types to second download queue B, audio types to second download queue C, and document types to second download queue D.

[0044] As an example, the server stores the file type and download link of each file to be reviewed in the first download queue, and then, according to the file type of each file to be reviewed in the first download queue, transfers the corresponding download link from the first download queue to the second download queue that matches the file type.

[0045] S104. Based on the reference download thread count of the review platform and the review volume ratio of each file type within a preset time period, set the corresponding sliding window length for the second download queue corresponding to each file type.

[0046] In this embodiment, the reference download thread count is the maximum number of download threads that the review platform can provide for downloading files.

[0047] The review volume ratio is the proportion of the review volume of the corresponding file type to the total review volume of all file types, and the sliding window length is used to represent the number of files that can be downloaded at one time.

[0048] As an example, the review platform has a reference download thread count of 10, and the review volume ratio of image type is 20% within a preset time period, the review volume ratio of video type is 30% within a preset time period, the review volume ratio of audio type is 40% within a preset time period, and the review volume ratio of document type is 10% within a preset time period.

[0049] The sliding window length can be allocated according to the relationship between the proportion of review volume for each file type, i.e., the sliding window length for image type is 2, the sliding window length for video type is 3, the sliding window length for audio type is 4, and the sliding window length for document type is 1.

[0050] S105, based on the length of each sliding window, sequentially retrieve download links from the corresponding second download queue to download the files.

[0051] In this embodiment, after determining the sliding window length corresponding to the second download queue for each file type, the server obtains the download link according to the sliding window length in order to download the file to be reviewed.

[0052] As an example, such as Figure 2 The diagram illustrates a process for downloading files using a second download queue.

[0053] Specifically, when the sliding window has a length of 2, the server first uses the sliding window to obtain the download links for file 1 and file 2 from the second download queue and then downloads the files.

[0054] After downloading files 1 and 2, the sliding window will slide in the preset direction to continue obtaining download links for files 3 and 4, and so on, until all download links for all files in the second download queue have been obtained, at which point the acquisition of download links will stop.

[0055] In this embodiment, multiple second download queues are created according to file type, and each second download queue stores download links for files of the corresponding file type. Based on the file type corresponding to each second download queue, corresponding file review standards can be set for each second download queue, thereby improving the accuracy of file review. Simultaneously, based on the reference download thread count of the review platform and the review volume ratio of each file type within a preset time period, a corresponding sliding window length is set for each second download queue corresponding to each file type. Allocating the corresponding number of download threads according to the review volume of each file type ensures balanced processing among file types and avoids low overall file review efficiency due to excessive review volume of a certain file type. Thus, this embodiment, by creating multiple second download queues and configuring a corresponding number of download threads for each second download queue, can improve both the accuracy and efficiency of file review.

[0056] As an optional embodiment, S104 may specifically include:

[0057] Multiply the reference download thread count of the review platform by the preset length coefficient to obtain the total window length;

[0058] The window splitting coefficient for each file type is determined based on the proportion of each review volume and the proportion threshold.

[0059] Multiply the total window length by the window splitting coefficient for each file type to obtain the sliding window length of the second download queue for each file type.

[0060] In this embodiment, the total window length is the sum of the sliding window lengths corresponding to the second download queues for each file type.

[0061] The window splitting factor is the proportion of the total window length to the sliding window length corresponding to the second download queue.

[0062] As an example, with a preset length coefficient of 0.6 and a reference download thread count of 10 for the review platform, the total window length is 10 * 0.6 = 6.

[0063] Then, the review volume ratio corresponding to each file type is compared with the preset ratio threshold. If it is greater than or equal to the preset ratio threshold, the window splitting coefficient of the corresponding file type can be set to 0.3; if it is less than the preset ratio threshold, the window splitting coefficient of the corresponding file type can be set to 0.1, thus obtaining the window splitting coefficient of each file type.

[0064] Finally, the total window length is multiplied by the window splitting coefficient for each file type to obtain the sliding window length of the second download queue for each file type.

[0065] As another example, if the calculated sliding window length is not an integer, it can be rounded down. Alternatively, the sliding window length for each document type can be determined by rounding up or down based on the proportion of approvals for each type.

[0066] For example, suppose the ranking of file types by review volume ratio is: image review volume ratio > video review volume ratio > audio review volume ratio > document review volume ratio. Then, if the calculated sliding window length is not an integer, the sliding window lengths for image and video types will be rounded up, while the sliding window lengths for audio and document types will be rounded down.

[0067] In this embodiment, the total window length is determined based on the reference download thread count of the review platform and a preset length coefficient. Then, based on the review volume ratio and a ratio threshold, the window splitting coefficient for each file type is obtained. Finally, based on the total window length and the window splitting coefficient, the sliding window length of the second download queue corresponding to each file type can be obtained. Thus, by comprehensively considering the reference download thread count of the review platform and the review volume ratio for each file type, this embodiment can accurately determine the sliding window length of the second download queue corresponding to each file type, thereby improving the overall efficiency of file review.

[0068] As an optional embodiment, the ratio threshold includes a first threshold and a second threshold, wherein the second threshold is greater than the first threshold;

[0069] Based on the proportion of each review volume and the proportion threshold, determine the window splitting coefficient for each file type, which may specifically include:

[0070] The largest proportion among the various audit volume proportions is compared with the proportion threshold to obtain the first comparison result;

[0071] If the first comparison result indicates that the maximum proportion is greater than the second threshold, the window splitting coefficient of the file type with the maximum proportion is set to the second threshold;

[0072] The remaining splitting coefficients are allocated according to the relationship between the review volume ratios of each first file type to obtain the window splitting coefficients for each first file type. The first file types are all file types except for the file type with the largest proportion.

[0073] In this embodiment, after obtaining the approval volume ratio for each file type, the server first sorts them according to their proportion. Assume the sorting result is: image approval volume ratio > video approval volume ratio > audio approval volume ratio > document approval volume ratio.

[0074] Then, the proportion of images reviewed is compared with the proportion threshold. If the proportion of images reviewed is greater than the second threshold, the window splitting coefficient of the image type is set to the second threshold.

[0075] For other file types, the window splitting coefficient is allocated according to the relationship between the review volume ratios. For example, the window splitting coefficient for video type = (1 - second threshold) * video review volume ratio / (video review volume ratio + audio review volume ratio + document review volume ratio).

[0076] This embodiment determines the window splitting coefficient for each document type based on the review volume ratio and the ratio threshold. By comprehensively considering the review volume ratio of each document type, the window splitting coefficient corresponding to each document type can be accurately obtained, which helps to rationally allocate the sliding window length and thus improve the overall efficiency of document review.

[0077] As an optional embodiment, after comparing the maximum review volume ratio among the various review volume ratios with the ratio threshold to obtain a first comparison result, the file download method further includes:

[0078] If the first comparison result indicates that the maximum proportion is between the first threshold and the second threshold, the sum of the maximum proportion and the second largest proportion among the various audit volume proportions is compared with the second threshold to obtain the second comparison result;

[0079] If the second comparison result indicates that the value is not less than the second threshold, the second threshold is allocated according to the relationship between the largest proportion and the second largest proportion to obtain the window splitting coefficient of the file type with the largest proportion and the window splitting coefficient of the file type with the second largest proportion.

[0080] The remaining splitting coefficients are allocated according to the relationship between the review volume ratios of each second file type to obtain the window splitting coefficients for each second file type. The second file types are all file types other than the file types with the largest and second largest proportions.

[0081] In this embodiment, it is assumed that the result of sorting the approval volume ratio of each file type is as follows: image approval volume ratio > video approval volume ratio > audio approval volume ratio > document approval volume ratio.

[0082] If the proportion of images reviewed is greater than or equal to the first threshold and less than or equal to the second threshold, then the sum of the proportion of images reviewed and the proportion of videos reviewed will be compared with the second threshold.

[0083] If the sum of the image review ratio and the video review ratio is greater than or equal to the second threshold, then the second threshold is allocated according to the relationship between the largest ratio and the second largest ratio. Specifically, the window splitting coefficient for image types = second threshold * image review ratio / (image review ratio + video review ratio), and the window splitting coefficient for video types = second threshold * video review ratio / (image review ratio + video review ratio).

[0084] Furthermore, the window splitting coefficients for other file types are allocated according to the relationship between the review volume ratios. Specifically, the window splitting coefficient for audio types = (1 - second threshold) * audio review volume ratio / (audio review volume ratio + document review volume ratio), and the window splitting coefficient for document types = (1 - second threshold) * document review volume ratio / (audio review volume ratio + document review volume ratio).

[0085] This embodiment determines the window splitting coefficient for each document type based on the review volume ratio and the ratio threshold. By comprehensively considering the review volume ratio of each document type, the window splitting coefficient corresponding to each document type can be accurately obtained, which helps to rationally allocate the sliding window length and thus improve the overall efficiency of document review.

[0086] As an optional embodiment, if the first comparison result indicates that the maximum proportion is between the first threshold and the second threshold, the method for downloading the file further includes comparing the sum of the maximum proportion and the second largest proportion among the various audit volume proportions with the second threshold to obtain the second comparison result.

[0087] If the second comparison result indicates that the value is less than the second threshold, the window splitting coefficient of the largest proportion of file types is set to the first threshold, and the window splitting coefficient of the second largest proportion of file types is set to the difference between the second threshold and the first threshold.

[0088] The remaining splitting coefficients are allocated according to the relationship between the review volume ratios of each second document type to obtain the window splitting coefficients for each second document type.

[0089] In this embodiment, it is assumed that the result of sorting the approval volume ratio of each file type is as follows: image approval volume ratio > video approval volume ratio > audio approval volume ratio > document approval volume ratio.

[0090] If the proportion of images reviewed is greater than or equal to the first threshold and less than or equal to the second threshold, the sum of the proportion of images reviewed and the proportion of videos reviewed is further compared with the second threshold.

[0091] If the sum of the proportion of image reviews and the proportion of video reviews is less than the second threshold, then the window splitting coefficient for file types is set to the first threshold, and the window splitting coefficient for video types is set to the difference between the second threshold and the first threshold.

[0092] Furthermore, the window splitting coefficients for other file types are allocated according to the relationship between the review volume ratios. Specifically, the window splitting coefficient for audio types = (1 - second threshold) * audio review volume ratio / (audio review volume ratio + document review volume ratio), and the window splitting coefficient for document types = (1 - second threshold) * document review volume ratio / (audio review volume ratio + document review volume ratio).

[0093] This embodiment determines the window splitting coefficient for each document type based on the review volume ratio and the ratio threshold. By comprehensively considering the review volume ratio of each document type, the window splitting coefficient corresponding to each document type can be accurately obtained, which helps to rationally allocate the sliding window length and thus improve the overall efficiency of document review.

[0094] As an optional embodiment, after comparing the maximum proportion among the various review volume ratios with the proportion threshold to obtain a first comparison result, the file download method further includes:

[0095] If the first comparison result indicates that the maximum proportion is less than the first threshold, the window splitting coefficient for each file type is set to the proportion of the review volume corresponding to the file type.

[0096] In this embodiment, it is assumed that the result of sorting the approval volume ratio of each file type is as follows: image approval volume ratio > video approval volume ratio > audio approval volume ratio > document approval volume ratio.

[0097] If the proportion of images reviewed is less than the first threshold, then the window splitting coefficient for each file type is directly set to the proportion of the review volume corresponding to that file type. Specifically, the window splitting coefficient for image type = image review volume proportion, the window splitting coefficient for video type = video review volume proportion, the window splitting coefficient for audio type = audio review volume proportion, and the window splitting coefficient for document type = document review volume proportion.

[0098] This embodiment determines the window splitting coefficient for each document type based on the review volume ratio and the ratio threshold. By comprehensively considering the review volume ratio of each document type, the window splitting coefficient corresponding to each document type can be accurately obtained, which helps to rationally allocate the sliding window length and thus improve the overall efficiency of document review.

[0099] As an optional embodiment, S105 may specifically include:

[0100] Repeat the following steps until all unprocessed download links in the second download queue have been traversed:

[0101] Based on the order of download links in the second download queue, starting from the first unprocessed download link, a number of download links corresponding to the length of the sliding window are obtained for downloading the file.

[0102] The second download queue is updated when a new download link is added.

[0103] In this embodiment, it is assumed that the length of the sliding window is 2. The server, based on the order of download links in the second download queue, first obtains the first and second unprocessed download links to download the file. Then, after completing the first and second links, the sliding window slides in a preset direction to obtain the third and fourth unprocessed download links, and so on, until all unprocessed download links in the second download queue have been obtained, at which point the acquisition of download links stops.

[0104] Meanwhile, if new download links need to be added to the second download queue, the second download queue will be updated promptly.

[0105] In this embodiment, the download links are retrieved sequentially from the second download queue according to the length of the sliding window. This ensures that all files awaiting review in the second download queue are successfully downloaded, avoiding any omissions and improving the reliability of file review.

[0106] As an optional embodiment, after S105, the file download method further includes:

[0107] Monitor the various load types of the audit platform to obtain the audit platform's business load score;

[0108] Based on the relationship between the workload score and the score threshold, determine the target adjustment strategy for the audit platform;

[0109] Adjust the sliding window length of each second download queue according to the target adjustment strategy.

[0110] In this embodiment, load type is a factor describing the load situation during the file download process. For example, load type may include download thread count load type and algorithm load type.

[0111] The target adjustment strategy is to adjust the sliding window length of each second download queue.

[0112] In this embodiment, the server dynamically monitors the document review process, grasps the operation of each dimension during the document review process, and thus obtains the business load score of the review platform.

[0113] Then, the workload score is compared with the scoring threshold. Based on the relationship between the workload score and the scoring threshold, the corresponding target adjustment strategy for the review platform is determined. Finally, the target adjustment strategy is used to dynamically adjust the sliding window length of each second download queue.

[0114] This embodiment monitors various load types of the review platform to obtain a corresponding business load score. Based on this score, the current load status of the review platform is determined, and a suitable adjustment strategy is selected to adjust the sliding window length of each second download queue in a timely manner. Thus, by dynamically adjusting the sliding window length, this embodiment further improves the efficiency of document review and ensures the stable operation of the review process.

[0115] As an optional embodiment, the various load types of the audit platform are monitored to obtain a business load score for the audit platform, including:

[0116] Monitor the load types of the audit platform to obtain the load ratio corresponding to each load type;

[0117] Multiply each load percentage by its corresponding load coefficient to obtain the load sub-score for each load type;

[0118] The load sub-scores corresponding to each load type are summed to obtain the business load score of the audit platform.

[0119] In this embodiment, the load ratio is information used to describe the actual load situation of the load type.

[0120] As an example, the server first sets a load factor for each load type based on the importance of file review to each load type, and the load factors of each load type are added together to be 1.

[0121] Then, by monitoring each load type on the audit platform, the load ratio corresponding to each load type is obtained. Next, the load ratio corresponding to each load type is multiplied by a preset load coefficient for that load type to obtain a load sub-score for each load type. Finally, the load sub-scores for each load type are summed to obtain the overall business load score for the audit platform.

[0122] This embodiment monitors various load types on the review platform and obtains a load sub-score for each load type. Finally, the load sub-scores are summed to obtain the business load score of the review platform. Thus, this embodiment quantifies the business load of the review platform by quantifying the load status of each load type. Based on the business load score, a suitable target adjustment strategy for the review platform can be accurately determined, improving the accuracy of dynamic adjustment of the sliding window length.

[0123] As an optional embodiment, the load type includes at least one of the following: download thread count load type, algorithm load type, file download speed load type, bandwidth load type, and cache load type;

[0124] The load ratio includes at least one of the following: download thread load ratio, algorithm load ratio, file download speed load ratio, bandwidth load ratio, and cache load ratio.

[0125] The load sub-score includes at least one of the following: download thread load score, algorithm load ratio score, file download speed load score, bandwidth load score, and cache load score.

[0126] In this embodiment, as Figure 3 The diagram illustrates a process for adjusting the length of a sliding window. When adjusting the sliding window length, the server monitors five load types on the review platform: download thread load type, algorithm load type, file download speed load type, bandwidth load type, and cache load type. This yields the corresponding download thread load ratio, algorithm load ratio, file download speed load ratio, bandwidth load ratio, and cache load ratio, which in turn generate corresponding download thread load scores, algorithm load ratio scores, file download speed load scores, bandwidth load scores, and cache load scores.

[0127] Then, the download thread load score, algorithm load ratio score, file download speed load score, bandwidth load score, and cache load score are summed to obtain the audit platform's business load score. Based on the audit platform's business load score, the corresponding target adjustment strategy is determined. The target adjustment strategies include a basic adjustment method for a business load score at level one, a high-load adjustment strategy for a business load score at level two, and a heavy-load adjustment strategy for a business load score at level three.

[0128] For example, the download thread load ratio = the number of currently occupied download threads / the total number of available download threads on the platform; the file download speed load ratio = the current average file download speed / the maximum file download speed; the bandwidth load ratio = the bandwidth used in the current download link / the total available bandwidth in the download link; and the cache load ratio = the current cache consumption / the total cache size.

[0129] This embodiment constructs a review business load scoring system based on real-time monitoring of the review platform's download thread load ratio, algorithm load ratio, file download speed load ratio, bandwidth load ratio, and cache load ratio. This system quantifies the review platform's business load. Based on the business load score, suitable adjustment strategies for the review platform can be accurately determined, improving the accuracy of dynamic adjustments to the sliding window length.

[0130] As an optional embodiment, the scoring threshold includes a first scoring threshold and a second scoring threshold, wherein the second scoring threshold is greater than the first scoring threshold;

[0131] If the business load score is less than the first score threshold, the target adjustment strategy is based on the adjustment method.

[0132] Based on the target adjustment strategy, the sliding window length of each second download queue is adjusted, which may specifically include:

[0133] Obtain the algorithm load factor corresponding to the algorithm load type, the first bandwidth load factor corresponding to the bandwidth load type, and the first cache load factor corresponding to the cache load type;

[0134] The first adjustment score is obtained by summing the products of the algorithm load factor and the algorithm load ratio, the first bandwidth load factor and the bandwidth load ratio, and the first cache load factor and the cache load ratio.

[0135] Multiply the difference between the first adjusted score and the preset total score by the reference download thread count of the review platform to obtain the length of the first adjusted window;

[0136] The sliding window length of each second download queue is adjusted using the maximum value between the first adjustment window length and the total window length.

[0137] In this embodiment, as an example, if the business load score is less than the first load score threshold, it indicates that the business load of the review platform is in a healthy state. At this time, the basic adjustment method of the first level of business load score can be selected to adjust the sliding window length of each second download queue.

[0138] Specifically, the server selects algorithm load type, bandwidth load type, and cache load type as the analysis targets, which have a significant impact on business load scores. Three adjustment factors are pre-defined: the algorithm load factor corresponding to the algorithm load type, the first bandwidth load factor corresponding to the bandwidth load type, and the first cache load factor corresponding to the cache load type. The sum of the algorithm load factor, the first bandwidth load factor, and the first cache load factor is 1.

[0139] Then, the server accumulates the product of the algorithm load factor and the algorithm load ratio, the product of the first bandwidth load factor and the bandwidth load ratio, and the product of the first cache load factor and the cache load ratio to obtain the first adjustment score corresponding to the basic adjustment method.

[0140] Then, the server calculates the length of the first adjustment window by multiplying the difference between the preset total score and the first adjusted score by the reference download thread count of the review platform. The preset total score is 1.

[0141] Finally, the maximum value between the first adjustment window length and the total window length is selected to adjust the sliding window length of each second download queue.

[0142] This embodiment utilizes workload scoring to quantify the workload of the review platform and selects appropriate target adjustment strategies based on this workload. It accurately obtains the adjusted window splitting coefficients for each file type, thereby facilitating the reasonable adjustment of the sliding window length and ultimately improving the overall efficiency of document review.

[0143] As an optional embodiment, the scoring threshold includes a first scoring threshold and a second scoring threshold, wherein the second scoring threshold is greater than the first scoring threshold;

[0144] If the business load score is not less than the first score threshold and not greater than the second score threshold, the target adjustment strategy is the high load adjustment method.

[0145] Based on the target adjustment strategy, the sliding window length of each second download queue is adjusted, which may specifically include:

[0146] Multiply the total window length by the first preset reduction factor to obtain the high-load window length;

[0147] Obtain the second bandwidth load factor corresponding to the bandwidth load type and the second cache load factor corresponding to the cache load type;

[0148] The second adjustment score is determined based on the second bandwidth load factor, the second cache load factor, the bandwidth load ratio, and the cache load ratio.

[0149] The length of the second adjustment window is determined based on the second adjustment score and the reference download thread count of the review platform;

[0150] The sliding window length of each file download queue is adjusted by using the minimum value between the second adjustment window length and the high-load window length.

[0151] In this embodiment, as an example, if the business load score is not less than the first score threshold and not greater than the second score threshold, it indicates that the business load of the review platform fluctuates greatly in a short period of time and is already in a high load state. Therefore, the high load adjustment method with the business load score at the second level can be selected to adjust the sliding window length of each second download queue.

[0152] Specifically, the server first forcibly reduces the total window length to half of its original size to obtain the high-load window length. Then, it selects bandwidth load type and cache load type as the analysis targets. Simultaneously, it sets two adjustment factors: a second bandwidth load factor corresponding to the bandwidth load type and a second cache load factor corresponding to the cache load type. The sum of the second bandwidth load factor and the second cache load factor is 0.5.

[0153] Then, the server adds the product of the second bandwidth load factor and the bandwidth load ratio to the product of the second cache load factor and the cache load ratio to obtain the first calculated value. The first calculated value is then subtracted from the sum of the second bandwidth load factor and the second cache load factor to obtain the second adjustment score.

[0154] Then, the server multiplies the available download threads by the second adjustment score, and then multiplies by 2 to obtain the second adjustment window length. Finally, the minimum value between the second adjustment window length and the high-load window length is selected to adjust the sliding window length of each second download queue.

[0155] Furthermore, the server can set multiple monitoring time periods. Within a consecutive target number of monitoring time periods, if both the bandwidth load ratio and the cache load ratio monitored by the platform simultaneously meet the target conditions, the current high-load adjustment ends. Subsequent adjustments to the sliding window will then be made by readjusting the window size using the basic adjustment method. The target conditions can be that the bandwidth load ratio is less than or equal to a first threshold, and the cache load ratio is less than or equal to a second threshold.

[0156] This embodiment utilizes workload scoring to quantify the workload of the review platform and selects appropriate target adjustment strategies based on this workload. It accurately obtains the adjusted window splitting coefficients for each file type, thereby facilitating the reasonable adjustment of the sliding window length and ultimately improving the overall efficiency of document review.

[0157] As an optional embodiment, the scoring threshold includes a first scoring threshold and a second scoring threshold, wherein the second scoring threshold is greater than the first scoring threshold;

[0158] If the business load score is greater than the second score threshold, the target adjustment strategy is the heavy load adjustment method.

[0159] Based on the target adjustment strategy, the sliding window length of each second download queue is adjusted, which may specifically include:

[0160] Multiply the total length of the initial window by the second preset reduction factor to obtain the length of the heavy load window;

[0161] Get the maximum file type corresponding to the maximum proportion and the minimum file type corresponding to the minimum proportion among all review volumes;

[0162] Based on the heavy load window length, determine the first heavy load length for the largest file type, the second heavy load length for the smallest file type, and the third heavy load length for intermediate file types other than the largest and smallest file types;

[0163] Obtain the third bandwidth load factor corresponding to the bandwidth load type and the third cache load factor corresponding to the cache load type;

[0164] The third adjustment score is determined based on the third bandwidth load factor, the third cache load factor, the bandwidth load ratio, and the cache load ratio.

[0165] Based on the length recovery level corresponding to the third adjustment score, adjust the lengths of the first load, second load, and third load.

[0166] In this embodiment, as an example, if the business load score is greater than the second score threshold, it indicates that the business load of the review platform is under heavy load and the sliding window length needs to be strictly controlled. At this time, the heavy load adjustment method of the third level of business load score can be selected to adjust the sliding window length of each second download queue.

[0167] Specifically, the server first forcibly reduces the total window length to one-eighth of its original length to obtain the heavy-load window length. Then, it selects bandwidth load type and cache load type as the analysis targets. Simultaneously, it sets two adjustment factors: a third bandwidth load factor corresponding to the bandwidth load type and a third cache load factor corresponding to the cache load type. The sum of the third bandwidth load factor and the third cache load factor is 1.

[0168] Then, obtain the maximum file type corresponding to the maximum proportion and the minimum file type corresponding to the minimum proportion among the various review volumes. Only split the heavy load window length into the first heavy load length corresponding to the maximum file type and the second heavy load length corresponding to the minimum file type, and set the third heavy load length corresponding to the remaining intermediate file types to 0.

[0169] Then, the server adds the product of the third bandwidth load factor and the bandwidth load ratio to the product of the third cache load factor and the cache load ratio to obtain the second calculated value. The second calculated value is then subtracted from the sum of the third bandwidth load factor and the third cache load factor to obtain the third adjustment score.

[0170] Finally, the server sets three corresponding length recovery levels for the third adjustment score. Based on the threshold reached by the third adjustment score, the sliding window length is gradually adjusted until it is restored to the initial length.

[0171] Specifically, assuming the score thresholds are set to 0.2, 0.35, and 0.5, when the third adjustment score reaches 0.2, the sliding window length is adjusted to twice the current length. When the third adjustment score reaches 0.35, the sliding window length is again adjusted to twice the current length (i.e., four times the length of the heavily loaded window). Then, when the third adjustment score reaches 0.5, the sliding window length is again adjusted to twice the current length (i.e., eight times the length of the heavily loaded window), and the window returns to its initial length.

[0172] This embodiment utilizes workload scoring to quantify the workload of the review platform and selects appropriate target adjustment strategies based on this workload. It accurately obtains the adjusted window splitting coefficients for each file type, thereby facilitating the reasonable adjustment of the sliding window length and ultimately improving the overall efficiency of document review.

[0173] Based on the file download method, this application also provides specific embodiments of a file download device.

[0174] like Figure 4 As shown, the file download device provided in this application embodiment includes a request receiving module 410, a file storage module 420, a link migration module 430, a length setting module 440, and a link acquisition module 450.

[0175] The request receiving module 410 is used to receive file review requests, which include the file types of multiple files and the download links of each file.

[0176] The file storage module 420 is used to store the file type and download link of each file in the request to the first download queue.

[0177] The link migration module 430 is used to move the download links of each file from the first download queue to the second download queue corresponding to the file type, according to the file type.

[0178] The length setting module 440 is used to set the corresponding sliding window length for the second download queue corresponding to each file type based on the reference download thread count of the review platform and the review volume ratio of each file type within a preset time period.

[0179] The link acquisition module 450 is used to sequentially acquire download links from the corresponding second download queue based on the length of each sliding window to download the file.

[0180] As an optional embodiment, the length setting module 440 may specifically include the following units:

[0181] The total length determination unit is used to multiply the reference download thread number of the review platform by a preset length coefficient to obtain the total window length;

[0182] The coefficient determination unit is used to determine the window splitting coefficient for each file type based on the proportion of each review volume and the proportion threshold.

[0183] The length setting unit is used to multiply the total window length by the window splitting coefficient of each file type to obtain the sliding window length of the second download queue corresponding to each file type.

[0184] As an optional embodiment, the ratio threshold includes a first threshold and a second threshold, wherein the second threshold is greater than the first threshold;

[0185] The coefficient determination unit specifically includes the following sub-units:

[0186] The ratio comparison subunit is used to compare the maximum ratio among the various audit volume ratios with the ratio threshold to obtain the first comparison result;

[0187] The coefficient setting subunit is used to set the window splitting coefficient of the largest proportion of file types to the second threshold when the first comparison result indicates that the largest proportion is greater than the second threshold.

[0188] The coefficient allocation subunit is used to allocate the remaining splitting coefficients according to the relationship between the review volume ratios of each first file type, so as to obtain the window splitting coefficients of each first file type. The first file types are all file types except the file type with the largest proportion.

[0189] As an optional embodiment, after comparing the maximum review volume ratio among the various review volume ratios with the ratio threshold to obtain a first comparison result, the coefficient determination unit further includes the following sub-units:

[0190] The ratio comparison subunit is also used to compare the sum of the maximum ratio and the second largest ratio among the various audit volume ratios with the second threshold when the first comparison result indicates that the maximum ratio is between the first threshold and the second threshold, so as to obtain a second comparison result.

[0191] The coefficient allocation subunit is also used to allocate the second threshold according to the relationship between the largest proportion and the second largest proportion when the second comparison result indication and value are not less than the second threshold, so as to obtain the window splitting coefficient of the file type with the largest proportion and the window splitting coefficient of the file type with the second largest proportion.

[0192] The coefficient allocation subunit is also used to allocate the remaining split coefficients according to the relationship between the review volume ratios of each second file type, so as to obtain the window split coefficients of each second file type. The second file types are all file types other than the file types with the largest and second largest proportions.

[0193] As an optional embodiment, if the first comparison result indicates that the maximum proportion is between the first threshold and the second threshold, after comparing the sum of the maximum proportion and the second largest proportion among the various audit volume proportions with the second threshold to obtain the second comparison result, the coefficient determination unit further includes the following sub-units:

[0194] The coefficient setting subunit is also used to set the window splitting coefficient of the largest proportion of file types to the first threshold when the second comparison result indicates that the value is less than the second threshold, and to set the window splitting coefficient of the second largest proportion of file types to the difference between the second threshold and the first threshold.

[0195] The coefficient allocation subunit is also used to allocate the remaining splitting coefficients according to the relationship between the review volume ratios of each second document type, so as to obtain the window splitting coefficients of each second document type.

[0196] As an optional embodiment, after comparing the maximum proportion among the various audit volume proportions with the proportion threshold to obtain a first comparison result, the coefficient determination unit further includes the following sub-units:

[0197] The coefficient setting subunit is also used to set the window splitting coefficient of each file type to the review volume ratio corresponding to the file type when the first comparison result indicates that the maximum proportion is less than the first threshold.

[0198] As an optional embodiment, the link acquisition module 450 specifically includes the following units:

[0199] The loop execution unit is used to repeatedly execute the following steps until all unprocessed download links in the second download queue have been traversed:

[0200] Based on the order of download links in the second download queue, starting from the first unprocessed download link, a number of download links corresponding to the length of the sliding window are obtained for downloading the file.

[0201] The second download queue is updated when a new download link is added.

[0202] As an optional embodiment, after downloading the file by sequentially obtaining download links from the corresponding second download queue according to the length of each sliding window, the file download device further includes the following modules:

[0203] The scoring determination module is used to monitor various load types of the audit platform and obtain the business load score of the audit platform.

[0204] The strategy determination module is used to determine the target adjustment strategy of the audit platform based on the relationship between the business load score and the score threshold.

[0205] The length adjustment module is used to adjust the sliding window length of each second download queue according to the target adjustment strategy.

[0206] As an optional embodiment, the scoring determination module includes the following units:

[0207] The ratio determination unit is used to monitor each load type of the audit platform and obtain the load ratio corresponding to each load type.

[0208] The sub-score determination unit is used to multiply each load ratio by the corresponding load coefficient to obtain the load sub-score corresponding to each load type.

[0209] The sub-score accumulation unit is used to accumulate the load sub-scores corresponding to each load type to obtain the business load score of the audit platform.

[0210] Based on the file download method, this application also provides specific embodiments of a file download device.

[0211] Figure 5 A schematic diagram of the hardware structure of the file download device provided in an embodiment of this application is shown.

[0212] The file download device may include a processor 501 and a memory 502 storing computer program instructions.

[0213] Specifically, the processor 501 may include a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits that can be configured to implement the embodiments of this application.

[0214] Memory 502 may include mass storage for data or instructions. For example, and not limitingly, memory 502 may include a hard disk drive (HDD), floppy disk drive, flash memory, optical disk, magneto-optical disk, magnetic tape, or Universal Serial Bus (USB) drive, or a combination of two or more of these. Where appropriate, memory 502 may include removable or non-removable (or fixed) media. Where appropriate, memory 502 may be internal or external to the integrated gateway disaster recovery device. In a particular embodiment, memory 502 is non-volatile solid-state memory.

[0215] The processor 501 implements any of the file download methods described in the above embodiments by reading and executing computer program instructions stored in the memory 502.

[0216] In one example, the file download device may also include a communication interface 503 and a bus 510. For example, Figure 5 As shown, the processor 501, memory 502, and communication interface 503 are connected through bus 510 and complete communication with each other.

[0217] The communication interface 503 is mainly used to realize communication between various modules, devices, units and / or equipment in the embodiments of this application.

[0218] Bus 510 includes hardware, software, or both, that couples components of a file download device together. For example, and not limitingly, the bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an Infinite Bandwidth Interconnect, a Low Pin Count (LPC) bus, a memory bus, a Microchannel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local (VLB) bus, or other suitable buses, or combinations of two or more of these. Where appropriate, bus 510 may include one or more buses. Although specific buses are described and illustrated in embodiments of this application, this application contemplates any suitable bus or interconnect.

[0219] Furthermore, in conjunction with the file download methods described in the above embodiments, this application embodiment can provide a computer storage medium for implementation. This computer storage medium stores computer program instructions; when these computer program instructions are executed by a processor, they implement any of the file download methods described in the above embodiments.

[0220] Furthermore, in conjunction with the file download methods described in the above embodiments, this application embodiment can provide a computer program product for implementation. When the instructions in this computer program product are executed by the processor of an electronic device, the electronic device performs any of the file download methods described in the above embodiments.

[0221] It should be clarified that this application is not limited to the specific configurations and processes described above and shown in the figures. For the sake of brevity, detailed descriptions of known methods are omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of this application is not limited to the specific steps described and shown. Those skilled in the art can make various changes, modifications, and additions, or change the order of steps, after understanding the spirit of this application.

[0222] The functional blocks shown in the above-described structural diagram can be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, they can be, for example, electronic circuits, application-specific integrated circuits (ASICs), appropriate firmware, plug-ins, function cards, etc. When implemented in software, the elements of this application are programs or code segments used to perform the required tasks. Programs or code segments can be stored on a machine-readable medium or transmitted over a transmission medium or communication link via data signals carried on a carrier wave. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, radio frequency (RF) links, etc. Code segments can be downloaded via computer networks such as the Internet, intranets, etc.

[0223] It should also be noted that the exemplary embodiments mentioned in this application describe methods or systems based on a series of steps or apparatus. However, this application is not limited to the order of the above steps; that is, the steps can be performed in the order mentioned in the embodiments, or in a different order, or several steps can be performed simultaneously.

[0224] The aspects of this disclosure have been described above with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It should be understood that each block in the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that these instructions, executable via the processor of the computer or other programmable data processing apparatus, enable the implementation of the functions / actions specified in one or more blocks of the flowchart illustrations and / or block diagrams. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor, or a field-programmable logic circuit. It is also understood that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can also be implemented by special-purpose hardware performing the specified functions or actions, or can be implemented by a combination of special-purpose hardware and computer instructions.

[0225] The above description is merely a specific implementation of this application. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, modules, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here. It should be understood that the protection scope of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the protection scope of this application.

Claims

1. A file download method, characterized in that, The method includes: Receive a file review request, the request including the file types of multiple files and download links for each file; Store the file type of each file in the request and the download link of each file in the first download queue; According to the file type, the download links of each file are sequentially moved from the first download queue to the second download queue corresponding to the file type; Based on the reference download thread count of the review platform and the review volume ratio of each file type within a preset time period, a corresponding sliding window length is set for the second download queue corresponding to each file type. The step of setting a corresponding sliding window length for the second download queue corresponding to each file type based on the reference download thread count of the review platform and the review volume ratio of each file type within a preset time period includes: Multiply the reference download thread count of the review platform by a preset length coefficient to obtain the total window length; Based on the respective review volume ratios and ratio thresholds, determine the window splitting coefficients for each of the aforementioned file types; Multiply the total length of the window by the window splitting coefficient for each file type to obtain the sliding window length of the second download queue corresponding to each file type; Based on the length of each sliding window, the download links are sequentially retrieved from the corresponding second download queue to download the files.

2. The method according to claim 1, characterized in that, The ratio threshold includes a first threshold and a second threshold, wherein the second threshold is greater than the first threshold; The step of determining the window splitting coefficient for each file type based on the respective review volume ratio and ratio threshold includes: The largest proportion among the various audit volume proportions is compared with the proportion threshold to obtain a first comparison result; If the first comparison result indicates that the maximum proportion is greater than the second threshold, the window splitting coefficient of the file type of the maximum proportion is set to the second threshold; The remaining splitting coefficients are allocated according to the relationship between the review volume ratios of each first file type to obtain the window splitting coefficients for each first file type, wherein the first file types are all file types other than the file type with the largest proportion.

3. The method according to claim 2, characterized in that, After comparing the maximum review volume ratio among the various review volume ratios with the ratio threshold to obtain a first comparison result, the method further includes: If the first comparison result indicates that the maximum proportion is between the first threshold and the second threshold, the sum of the maximum proportion and the second largest proportion among the various audit volume proportions is compared with the second threshold to obtain a second comparison result; If the second comparison result indicates that the sum is not less than the second threshold, the second threshold is allocated according to the relationship between the maximum proportion and the second large proportion to obtain the window splitting coefficient of the file type with the maximum proportion and the window splitting coefficient of the file type with the second large proportion. The remaining splitting coefficients are allocated according to the relationship between the review volume ratios of each second file type to obtain the window splitting coefficients for each second file type. The second file types are all file types other than the file type with the largest proportion and the file type with the second largest proportion.

4. The method according to claim 3, characterized in that, After comparing the sum of the maximum proportion and the second largest proportion among the various review volume proportions with the second threshold to obtain a second comparison result, the method further includes: If the second comparison result indicates that the sum is less than the second threshold, the window splitting coefficient of the largest proportion of file types is set to the first threshold, and the window splitting coefficient of the second largest proportion of file types is set to the difference between the second threshold and the first threshold; The remaining splitting coefficients are allocated according to the relationship between the review volume ratios of each of the second file types to obtain the window splitting coefficients for each of the second file types.

5. The method according to claim 2, characterized in that, After comparing the largest proportion among the various review volume proportions with the proportion threshold to obtain a first comparison result, the method further includes: If the first comparison result indicates that the maximum proportion is less than the first threshold, the window splitting coefficient of each file type is set to the review volume proportion corresponding to the file type.

6. The method according to claim 1, characterized in that, The step of sequentially retrieving the download links from the corresponding second download queue according to the length of each sliding window and downloading the file includes: The following steps are repeated until all unprocessed download links in the second download queue have been traversed: Based on the order relationship between the download links in the second download queue, starting from the first unprocessed download link, a number of download links corresponding to the length of the sliding window are obtained for downloading the file; If a new download link is added to the second download queue, the second download queue is updated.

7. The method according to any one of claims 1-6, characterized in that, After obtaining the download links sequentially from the corresponding second download queue according to the length of each sliding window and downloading the file, the method further includes: The various load types of the audit platform are monitored to obtain a business load score for the audit platform; Based on the relationship between the business load score and the score threshold, the target adjustment strategy of the review platform is determined; According to the target adjustment strategy, the sliding window length of each of the second download queues is adjusted.

8. The method according to claim 7, characterized in that, The monitoring of various load types of the audit platform to obtain a business load score for the audit platform includes: The load types of the audit platform are monitored to obtain the load ratio corresponding to each load type; Multiply each of the load ratios by its corresponding load coefficient to obtain the load sub-score for each load type. The load sub-scores corresponding to each load type are summed to obtain the business load score of the audit platform.

9. The method according to claim 8, characterized in that, The load type includes at least one of the following: download thread load type, algorithm load type, file download speed load type, bandwidth load type, and cache load type; The load ratio includes at least one of the following: download thread load ratio, algorithm load ratio, file download speed load ratio, bandwidth load ratio, and cache load ratio. The load sub-score includes at least one of the following: download thread load score, algorithm load ratio score, file download speed load score, bandwidth load score, and cache load score.

Citation Information

Patent Citations

  • File downloading method and related product

    CN111262797A

  • Adaptive hierarchical storage method based on time sliding window

    CN111858469A