Method and device suitable for cloud storage of large batches of small files

A small file, cloud storage technology, applied in file systems, file/folder operations, electrical components, etc., can solve problems such as high cost and difficulty in implementation, and achieve utilization of storage space, increase upload speed, and facilitate file update and access. Effect

Active Publication Date: 2020-12-01
北京亿智云科技有限公司
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In the above scheme, the former adopts the method of file merging, although it can reduce the number of files, but because the file merging is a continuous sequence of bytes, if a file needs to be changed, the cost is relatively high, so this method is only suitable for Occasions with fewer updates; and the latter, which uses the method of continuous disk space, also has certain defects: in cloud storage, due to the virtualization of storage, it is difficult to implement during the process of putting into use

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device suitable for cloud storage of large batches of small files
  • Method and device suitable for cloud storage of large batches of small files
  • Method and device suitable for cloud storage of large batches of small files

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0039] Such as figure 1 , this embodiment discloses a method suitable for cloud storage of large batches of small files, including the following steps:

[0040] S1: File upload: According to the file splicing method, the files are selectively spliced ​​to obtain the processed file and uploaded;

[0041] Specifically, such as figure 2 , the file splicing method is:

[0042] Determine the size of the file. When the size of the file is larger than the preset size, it is considered as a non-small file and uploaded independently; when the size of the file is smaller than or equal to the preset size, it is considered as a small file and needs to be spliced; Files larger than 512k are generally not considered small files, so the default size in this embodiment is set to 512k.

[0043] Among them, the splicing method is: combining small files into medium-sized processing files whose maximum size does not exceed the set threshold;

[0044] The specific splicing method is as follow...

Embodiment 2

[0076] Such as image 3 , this embodiment is similar to Embodiment 1, the difference is that in this implementation, in step S2, when there is a processing file that needs to be stored, according to the current processing file, a data block with a suitable storage grid is preferentially searched for or established for the current Process files for storage.

[0077] A suitable storage grid means that the storage capacity occupied by the currently processed file is exactly or close to the capacity provided by a storage grid, that is, the currently processed file can be stored in a storage grid. Of course, when the size of the processed file is not When the integer multiple of 8k is used, the size of the grid created or searched will be slightly larger than the size of the processed file.

[0078] That is to say, the size of the storage grid searched or established by this embodiment is equal to or nearly equal to the size of the processed file.

[0079] A suitable storage grid...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method and device suitable for cloud storage of large-scale small files. The method comprises the following steps of: S1, file uploading: selectively splicing files according to a file splicing manner to obtain a processed file and uploading the processed file; S2: storage grid establishment or search: dividing a data block, the size of which is greater than a preset threshold value, into a plurality of storage grids with same sizes, or searching a data block, the residual storage grids of which are enough to store the processed file in the step S1; and S3, analyzing the processed file in the step S1 and storing the processed file in one or more storage grids in the step S2. According to the method and device, small files are uploaded through a combination method, so that the connection establishing frequency is decreased and the uploading speed is improved; and each file is stored by using a proper storage space, so that the file updating and access are more convenient.

Description

technical field [0001] The invention belongs to the technical field of computer applications, and in particular relates to a method and device suitable for cloud storage of large batches of small files. Background technique [0002] The cloud storage of files uses the RESTful API interface for uploading, which essentially uses the HTTP protocol. If each file is uploaded sequentially, a lot of time is consumed in the process of establishing an HTTP connection, and the actual data transmission takes very little time. Therefore, it is necessary to reduce HTTP connections Build times. In addition, when storing, a large number of small files occupy a large amount of storage resources, which is not economical and affects access performance. In order to solve the above technical problems, people have proposed the following solutions: [0003] 1. The optimization strategy for a large number of small files generally includes merging and storing small files. For example, Facebook’s o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/16G06F16/172G06F16/182H04L29/08
CPCG06F16/16G06F16/172G06F16/1824H04L67/02H04L67/06
Inventor 郑晟
Owner 北京亿智云科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap