Unlock instant, AI-driven research and patent intelligence for your innovation.

Data processing method and device for distributed file system

A data processing device and a technology for distributed files, which are applied in file systems, digital data processing, and input/output processes of data processing, etc., can solve the problems of long waiting time and low performance of storage systems, and reduce The effect of improving system performance and reducing the impact of read-write locks on performance

Active Publication Date: 2021-08-10
ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In view of this, the embodiment of the present application provides a data processing method and device for a distributed storage system, which can solve the problem of long waiting time and poor storage system performance caused by frequent locking and unlocking in the prior art. high problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device for distributed file system
  • Data processing method and device for distributed file system
  • Data processing method and device for distributed file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041]In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiment of the application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiment of the application. Obviously, the described embodiment is only It is a part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0042] For ease of understanding, the following first introduces the specific application scenarios of the present application.

[0043] In object storage (OBS), at least one storage node is included, and multiple OSD management modules run on each storage node (or storage host) to manage the OSD on the storage node and establish corresponding network links , to re...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the present application discloses a data processing method and device for a distributed file system. According to the network link sub-table of different source addresses, the read-write lock of the network link table is split, which is equivalent to each network link The subtable corresponds to a read-write lock, and the method includes: in response to the processing request of the corresponding network link of the target OSD management module, applying for the target lock of the target network link subtable corresponding to the target OSD management module; The target network link subtable executes the processing operation corresponding to the processing request. The read-write locks of each network link subtable do not affect each other, which can greatly reduce the impact of read-write locks on performance, reduce waiting time, and improve system performance.

Description

technical field [0001] The present application relates to the technical field of distributed storage, and in particular to a data processing method and device for a distributed file system. Background technique [0002] Object storage, also known as object-based storage (OBS), is a combination of the advantages of network attached storage (network attached storage, NAS) and storage area network (storage area network, SAN), while having the advantages of SAN High-speed direct access and NAS data sharing advantages, providing high reliability, cross-platform and secure data sharing storage architecture. [0003] Among them, an object is the basic unit of object storage. Each object is a combination of data and data attribute sets, including file data and related attribute information, and can be self-managed. An object-based storage device (OSD) is a collection of objects. Each OSD is a smart device with its own storage medium, processor, memory, and network system. It is re...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06G06F16/13
CPCG06F3/0622G06F3/0643G06F3/0644G06F3/067
Inventor 王庆海
Owner ZHENGZHOU YUNHAI INFORMATION TECH CO LTD