File writing method and system for distributed storage system

A distributed storage and file technology, applied in transmission systems, electrical components, special data processing applications, etc., can solve the problems of request blocking and back-end storage delay, and achieve the effect of improving performance and reducing interaction

Inactive Publication Date: 2017-09-22
ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
View PDF6 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] When a large number of files are written, the client needs to frequently interact with M

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • File writing method and system for distributed storage system
  • File writing method and system for distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] The core of the present invention is to provide a method and system for writing files in a distributed storage system.

[0035] In order to make the above objects, features and advantages of the present invention more comprehensible, the specific implementation manners of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0036] In the following description, specific details are set forth in order to provide a thorough understanding of the present invention. However, the present invention can be implemented in many other ways than those described here, and those skilled in the art can make similar extensions without departing from the connotation of the present invention. Accordingly, the invention is not limited to the specific implementations disclosed below.

[0037] Please refer to figure 1 , figure 1 It is a flowchart of a method for writing files in a distributed storage system provided by the present invent...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a file writing method and system for a distributed storage system. The method comprises the following steps: a client sends a metadata request to a metadata server; the client judges whether the length of data to be written is larger than a preset data length threshold or not according to information of the data to be written in a message returned by the metadata server; if the length of data to be written is larger than the preset data length threshold, after the data to be written is written into a cache of the client, a file handle of the data to be written is immediately released, and dirty data is written into an object-based storage device (OSD); and if the length of data to be written is not larger than the preset data length threshold, after the data to be written is written into the cache of the client, the file handle of the data to be written is added into a delayed release link list, and when the number of file handles in the delayed release link list is larger than a preset handle number threshold, the file handles in the delayed release link list are released, and the dirty data is written into the OSD. The method and system adopting the technical scheme has the advantages that interaction between the client and the writing OSD is reduced during writing of a large number of small files, so that the small file writing performance is improved.

Description

technical field [0001] The invention relates to the technical field of distributed storage, in particular to a method and system for writing files in a distributed storage system. Background technique [0002] With the rapid development of network and information technology, the production speed of data is getting faster and faster. In the era of big data, the requirements for data storage and access speed are getting higher and higher. Traditional data storage methods are obviously unable to meet the growing demand for data storage, and distributed storage systems emerge as the times require. [0003] A distributed storage system stores data dispersedly on multiple independent devices, while a network storage system uses a centralized storage server to store all data. [0004] Most of the information on the Internet is a large number of small files. At present, when storing a large number of small files in a distributed storage system, there are still problems such as low...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08G06F17/30
CPCH04L67/1097G06F16/182H04L67/561
Inventor 张书扬
Owner ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap