Data processing method and device for distributed file system

A data processing device and distributed file technology, applied in the direction of electrical digital data processing, special data processing applications, data processing input/output process, etc., can solve the problems of low storage system performance, long waiting time, etc., and achieve improved System performance, reducing waiting time, and reducing the impact of read-write locks on performance

Active Publication Date: 2018-12-18
ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
View PDF6 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In view of this, the embodiment of the present application provides a data processing method and device for a distributed storage system, which can solve the problem of long waiting time and poor storage system performance caused by frequent locking and unlocking in the prior art. high problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device for distributed file system
  • Data processing method and device for distributed file system
  • Data processing method and device for distributed file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041]In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiment of the application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiment of the application. Obviously, the described embodiment is only It is a part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0042] For ease of understanding, the following first introduces the specific application scenarios of the present application.

[0043] In object storage (OBS), at least one storage node is included, and multiple OSD management modules run on each storage node (or storage host) to manage the OSD on the storage node and establish corresponding network links , to re...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A method and an apparatus for data processing of a distributed file system are disclosed in the embodiment of the present application, depending on the network link subtable for the different source addresses, the method comprises: in response to a processing request for a network link corresponding to a target OSD management module, applying a target lock of a target network link sub-table corresponding to the target OSD management module; and splitting a read-write lock of the network link sub-table corresponding to the target OSD management module. When the target lock is obtained, a processing operation corresponding to the processing request is performed on the target network link sub-table. The read-write locks of each network linked sub-table do not affect each other, which can greatly reduce the impact of the read-write locks on the performance, reduce the waiting time, and improve the system performance.

Description

technical field [0001] The present application relates to the technical field of distributed storage, and in particular to a data processing method and device for a distributed file system. Background technique [0002] Object storage, also known as object-based storage (OBS), is a combination of the advantages of network attached storage (network attached storage, NAS) and storage area network (storage area network, SAN), while having the advantages of SAN High-speed direct access and NAS data sharing advantages, providing high reliability, cross-platform and secure data sharing storage architecture. [0003] Among them, an object is the basic unit of object storage. Each object is a combination of data and data attribute sets, including file data and related attribute information, and can be self-managed. An object-based storage device (OSD) is a collection of objects. Each OSD is a smart device with its own storage medium, processor, memory, and network system. It is re...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06G06F17/30
CPCG06F3/0622G06F3/0643G06F3/0644G06F3/067
Inventor 王庆海
Owner ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap