Unlock instant, AI-driven research and patent intelligence for your innovation.

Write aggregation and read aggregation method, system and client for small files

An aggregation method and small file technology, applied in the transmission system, text database clustering/classification, electrical components, etc., can solve the problems of consumption, multi-reading and writing time, and achieve the effect of solving the reading time

Active Publication Date: 2019-03-26
ZTE CORP
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The main purpose of the present invention is to provide a small file write aggregation, read aggregation method and system, aiming to solve the problem that it takes a lot of time to read and write in the process of writing aggregation and reading aggregation of small files

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Write aggregation and read aggregation method, system and client for small files
  • Write aggregation and read aggregation method, system and client for small files
  • Write aggregation and read aggregation method, system and client for small files

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0070] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0071] Based on the above problems, the present invention provides a write aggregation method for small files.

[0072] refer to figure 1 , figure 1 It is a schematic flowchart of the first embodiment of the write aggregation method for small files in the present invention.

[0073] In this embodiment, the write aggregation method of the small file includes:

[0074] Step S10, the client initiates a small file write request;

[0075] In this embodiment, the file size of a small file is less than 1MB, and the client initiates a small file write request, and the client writes the content of the small file into the local cache of the client.

[0076] Step S20, the metadata server assigns a globally unique number ino and a unique storage area number ono to the small file;

[0077] After the client writes the content ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Disclosed in the present disclosure are a file write-aggregation method and system. The write-aggregation method comprises: a client initiates a write operation of a small file; the client calculates an aggregation position of the small file in an object storage device (OSD) according to a globally unique serial number and a unique serial number of a storage region allocated by a metadata server to the small file; and the client sends a small file aggregation request carrying the aggregation position to the object storage device (OSD), wherein the small file refers to a file with a size smaller than a threshold value.

Description

technical field [0001] The present invention relates to the technical field of distributed storage, in particular to a method and system for writing aggregation and reading aggregation of small files. Background technique [0002] With the development of cloud computing, mobile Internet and other technologies, the amount of data that needs to be stored and read is increasing, and the storage and reading methods of different data are different. For example, small files with only a few thousand bytes are widely used. Random aggregation, table lookup index for storage and reading. Due to the aggregation strategy, when small files are aggregated, it is necessary to create additional mapping tables for these small files, and read these small files by looking up the mapping table, so it takes a lot of time to read and write small files. Contents of the invention [0003] The main purpose of the present invention is to provide a small file write aggregation and read aggregation ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08G06F16/35
CPCG06F16/00
Inventor 杨洪章王志坤罗圣美
Owner ZTE CORP