Management method and device of distributed file system and server

A distributed file and management method technology, applied in the field of distributed file system management method device and server, can solve the problems of complex implementation, generating a lot of overhead, limiting performance, etc.

Inactive Publication Date: 2020-06-30
西安奥卡云数据科技有限公司
View PDF14 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Various common factors become apparent when analyzing distributed data management systems: implementations are complex, locking models limit performance, locking models limit scale-out, deadlocks are common system downtime, and locking and heartbeat traffic create significant overhead

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Management method and device of distributed file system and server
  • Management method and device of distributed file system and server
  • Management method and device of distributed file system and server

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 2

[0103] There is a common numerology that spans all data cloud resources and relies on a single disk database. The goal is that all resources can be detected and queried by external AI / BI tools, and storage elements from different sources can be seamlessly mixed and matched without accessing the applications that generated the raw data.

[0104] There are multiple service components such as message receivers, schedulers, worker queues and cleaner services. These services all provide an external queue that allows external services to add requests. The external queue service is in a multi-threaded construct and thus requires a spinlock for serialization. Internal queues are private to each service and therefore cannot be accessed from the outside.

[0105] Such as Figure 7 As shown, each message in the data cloud contains a common prefix (1.1) with an opcode, an operation sequence number, and a digital object stamp. If a service node sends a message to another service node (...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a management method of a distributed file system, which comprises the following steps of enabling a router to receive information to be processed, wherein theinformation to be processed refers to an operation to be processed, and putting the to-be-processed information into a waiting queue; enabling the scheduler to extract features of the to-be-processedinformation to serve as target features, and select a method for processing the to-be-processed information according to the target features to obtain a preset method; and processing the to-be-processed information by using a preset method to obtain output data; and storing the output data into the configuration distribution network, and updating the data of the configuration distribution networkto obtain updated data; and configuring the distribution network to output the update data except that the client sending the to-be-processed information accesses the update data. Synchronization is carried out when a plurality of users have to access the same data at the same time, so that it is ensured that updating and deleting of the data at the same place can be automatically mapped to otherplaces storing the data.

Description

technical field [0001] The invention relates to the technical field of distributed file systems, in particular to a management method, device and server of a distributed file system. Background technique [0002] In traditional filesystems, locking primitives exist, such as write locks on directories, or file and record locks, to serialize competing requests for the same resource. A file system's stateful implementation must provide similar functionality, and the mechanism for doing so is a per-cabinet queue, which implicitly implements resource serialization. [0003] Traditional serialization mechanisms include the following aspects: spin locks, mutexes, freeze locks, distributed locks, heartbeat mechanisms, and network legal mechanisms. There are various computing models, and the most common model is threaded with resource locks. In distributed computing, this extends to distributed lock managers and heartbeat networks, which extend the single-node concept across multipl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08G06F16/182
CPCG06F16/182H04L67/1097
Inventor 约翰·阿尔伯特·卡迈克尔陆博
Owner 西安奥卡云数据科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products