Distributed file system-based data reading method and device and distributed file system-based data writing method and device

A distributed file and data reading technology, which is applied in the direction of file system, file access structure, electronic digital data processing, etc., can solve the problems of poor performance of distributed file system, and achieve the effect of solving poor performance

Active Publication Date: 2018-06-22
XIAMEN JIWEI TECH CO LTD
View PDF5 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The present invention provides a data reading and writing method and device based on a distributed file system to at least solve the technical problem of poor performance of a distributed file system in the related art when multi-regional cluster storage

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed file system-based data reading method and device and distributed file system-based data writing method and device
  • Distributed file system-based data reading method and device and distributed file system-based data writing method and device
  • Distributed file system-based data reading method and device and distributed file system-based data writing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] In order to enable those skilled in the art to better understand the solutions of the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only It is an embodiment of a part of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

[0030] It should be noted that the terms "first" and "second" in the description and claims of the present invention and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used are interchangeable under appropriate ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed file system-based data reading method and device and a distributed file system-based data writing method and device. The data reading method comprises the following steps of: receiving a reading request sent by client equipment by a first storage node, belonging to a first area, in a distributed file system, wherein the reading request is used for requesting to-be-read data; judging whether a first storage position corresponding to the to-be-read data has a preset sign or not; and when the judging result is positive, reading the to-be-read data from a second storage node, wherein the second storage node is located in the second area and the second area is different from the first area. According to the data reading method and device and the data writing method and device, the technical problem that distributed file systems are bad in performance when carrying out multi-regional cluster storage in correlation techniques is solved.

Description

technical field [0001] The invention relates to the field of distributed file storage, in particular to a method and device for reading and writing data based on a distributed file system. Background technique [0002] Ceph is a distributed storage, such as figure 1 As shown, it divides the file and distributes it evenly and randomly on each node. Ceph uses the CRUSH algorithm to determine the storage location of the object. As long as there is the current cluster topology, the Ceph client can directly calculate the storage location of the file. Directly communicate with the OSD (daemon process) node to obtain the file without asking the central node to obtain the file location, thus avoiding a single point of risk. [0003] If you do not consider the limitations of the network and distribution, the performance of the Ceph cluster is superior to that of Swift (object storage) and HDFS (distributed file system). [0004] Although Ceph supports multi-regional deployment, in ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/13G06F16/182
Inventor 林子皇靳春孟杨清强严晓杰
Owner XIAMEN JIWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products