Unlock instant, AI-driven research and patent intelligence for your innovation.

Distributed storage system and its data processing method and device

A data processing device and distributed storage technology, applied in the direction of electrical digital data processing, input/output process of data processing, instruments, etc., can solve the problem of slow writing files

Active Publication Date: 2021-03-19
SHENZHEN IPANEL TECH LTD
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, when the writing speed of the writing user is relatively slow, and the capacity of m data blocks cannot be filled for a long time, it is difficult for the reading user to read new content from the disk in a timely manner.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed storage system and its data processing method and device
  • Distributed storage system and its data processing method and device
  • Distributed storage system and its data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0043] see figure 1 , the embodiment of the present invention discloses a data processing method of a distributed storage system, including:

[0044] Step S01: Receive the original data sent by the client.

[0045] Specifically, the distributed storage system stores data on the disks of multiple servers. These disks are divided into multiple groups. The smallest unit for reading / writing data on a disk is called a data block. Each data block on the same disk is ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The application discloses a distributed storage system and its data processing method and device, so that readers can read new content from a disk in a timely manner. The method includes: receiving the original data sent by the client, and writing it into a virtual block; when receiving the fflush() function call request sent by the client, determining the first block area and the second block area, Perform data encoding on the first block area, and write the obtained encoded data into the second block area; for the area occupied by the original data on the original data block of the virtual block, all the original data blocks on the virtual block The areas together form a first strip area, and the areas on all encoded data blocks of a virtual block jointly form a second strip area; writing the original data and the encoded data into a physical block, The positions of the original data and the encoded data on the physical chunk are the same as on the virtual chunk.

Description

technical field [0001] The present invention relates to the technical field of distributed storage, and more specifically, to a distributed storage system and its data processing method and device. Background technique [0002] Distributed storage system means that the data is distributed and stored on the disks of multiple servers, and each server is interconnected through the network to provide storage services as a whole. These disks are divided into multiple groups. The smallest unit for reading / writing data on a disk is called a data block. Each data block on the same disk is numbered sequentially. Data blocks with the same number on a group of disks are collectively called a block. The block adopts the m+n mode, that is, the block contains m+n data blocks, m>0, n>0, and the m data blocks are used to store original data, which are called original data blocks, and the rest The n data blocks of are used to store coded data, which are called coded data blocks. [0...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/0631G06F3/064G06F3/0665G06F3/067G06F3/0676
Inventor 徐佳宏李银
Owner SHENZHEN IPANEL TECH LTD