Unlock instant, AI-driven research and patent intelligence for your innovation.

File processing method and device, equipment and storage medium

A file processing and file technology, applied in file systems, electronic digital data processing, special data processing applications, etc., can solve the problems of low upload efficiency, long time, and large memory footprint, and achieve the effect of improving upload efficiency.

Active Publication Date: 2021-08-06
北京微纳星空科技有限公司
View PDF9 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the process of uploading a large file, if the large file is successfully uploaded in the application server, it mainly reflects that the large file is successfully stored in the application server, but the large file occupies a large amount of memory, so the storage process is slow. When the problem of network interruption occurs during the storage of a large file, the storage of the large file fails, and the client needs to send the large file to the application server for re-storage. This method consumes more time and makes the Large files are uploaded inefficiently in the application server

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • File processing method and device, equipment and storage medium
  • File processing method and device, equipment and storage medium
  • File processing method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0070] figure 1 It shows a flow chart of a file processing method provided by Embodiment 1 of the present application, as shown in figure 1 As shown, the file processing method includes the following steps:

[0071] Step S101: When receiving the upload request from the client that carries the file to be uploaded, according to the name of the file to be uploaded and the number of file node servers, use the first hash remainder method to determine the The first target file node server for the uploaded file.

[0072] Specifically, the above file processing method is applied to the application server in the background. When the client needs to upload a file to the application server for storage, it sends an upload request to the main shard server to indicate that the file needs to be uploaded, and at the same time makes the upload request carry For the file to be uploaded, when the main shard server receives the upload request carrying the file to be uploaded, determine the name...

Embodiment 2

[0115] figure 2 It shows a flow chart of another file processing method provided by Embodiment 2 of the present application, such as figure 2 As shown, the file processing method includes the following steps:

[0116] Step S401: When receiving the download request sent by the client, according to the name of the file to be downloaded and the number of file node servers, use the fourth hash remainder method to determine the second target file node server storing the file to be downloaded , wherein the download request carries the name of the file to be downloaded.

[0117] Step S402: According to the name of the file to be downloaded and the number of space slices included in the second target file node server, use the fifth hash remainder method to determine the A second target space slice of the file to be downloaded is described.

[0118] Specifically, for the specific description of step S401 and step S402, refer to the above description of step S101 and step S102, whi...

Embodiment 3

[0137] Figure 5 It shows a schematic structural diagram of a file processing device provided in Embodiment 3 of the present application, as shown in Figure 5 As shown, the above-mentioned file processing device includes:

[0138] The first determining module 501 is configured to use the first hash remainder method to determine the user according to the name of the file to be uploaded and the number of file node servers when receiving the upload request sent by the client and carrying the file to be uploaded. Store the first target file node server of the file to be uploaded;

[0139] The second determining module 502 is configured to determine the first target file using a second hash remainder method according to the name of the file to be uploaded and the number of space slices included in the node server of the first target file The node server is used to store the first target space fragment of the file to be uploaded;

[0140] The third determination module 503 is co...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a file processing method and device, equipment and a storage medium. The method comprises the following steps: determining a first target space fragment in a first target file node server used for storing a to-be-uploaded file when an uploading request which is sent by a client and carries the to-be-uploaded file is received; according to the size of the to-be-uploaded file and the first target number, determining the name of each to-be-uploaded sub-file by using a third Hash remainder method; for each to-be-uploaded sub-file, judging whether a first target sub-file with the same name as the to-be-uploaded sub-file exists in a disk included in the first target space fragment or not; and if the first target sub-file does not exist, storing the to-be-uploaded sub-file in a disk. According to the method, the mode of multiple times of small-amount uploading is adopted, and the uploading efficiency of the large file and the success rate of complete uploading of the large file in the application server can be improved.

Description

technical field [0001] The present application relates to the field of application services of file data, in particular, to a file processing method, device, equipment and storage medium. Background technique [0002] With the development of network services, the demand for uploading or downloading file data in application servers has become more and more important. The memory occupied by the data is getting larger and larger, and the amount of large file data is also increasing. The efficiency of the application server when uploading or downloading large file data is also becoming more and more prominent. [0003] In the process of uploading a large file, if the large file is successfully uploaded in the application server, it mainly reflects that the large file is successfully stored in the application server, but the large file occupies a large amount of memory, so the storage process is slow. When the problem of network interruption occurs during the storage of a large ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/16G06F16/172
CPCG06F16/16G06F16/172
Inventor 耿亮亮梁军民孔令波高恩宇
Owner 北京微纳星空科技有限公司