Data storage method, data storage equipment and distributed storage system

A distributed storage and data storage technology, applied in the computer field, can solve the problems of high overhead of redundant copies, high storage service costs, and reduced data reliability, saving storage space, reducing the proportion of redundant data, and ensuring data security. The effect of reliability

Inactive Publication Date: 2014-04-02
BEIJING QIHOO TECH CO LTD +1
View PDF1 Cites 70 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] From the realization of the existing technology, a data record is stored in Cassandra. In fact, three data copies need to be stored, which takes up a lot of storage space. The overhead of redundant c...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method, data storage equipment and distributed storage system
  • Data storage method, data storage equipment and distributed storage system
  • Data storage method, data storage equipment and distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0057]In order to solve the existing problems of using multi-copy storage in the distributed storage system in the prior art, excessive redundancy copy overhead and high storage service cost, the embodiment of the present invention provides a data storage solution, in the distributed storage system such as The access node of the Cassandra system divides the data block into several data fragments, and calculates several verification ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data storage method, data storage equipment and a distributed storage system. The method, the equipment and the system belong to the technical field of computers. The data storage method comprises the steps that access nodes of the distributed storage system cut a data block which is written in by a user into a plurality of data fragments with preset sizes; a plurality of check fragments corresponding to the data fragments which are obtained by cutting are calculated through a redundancy check algorithm; the data fragments and the check fragments are stored into the data nodes of the distributed storage system, and each data fragment and each check fragment only store one copy. According to the data storage method, the data storage equipment and the distributed storage system, the proportion of redundant data can be reduced on the premise of ensuring data reliability, so as to save the storage space.

Description

technical field [0001] The invention relates to the technical field of computers, in particular to a data storage method, a data storage device and a distributed storage system. Background technique [0002] Cassandra is a typical distributed storage system with a ring structure without a central node and implemented by distributed hash table (Distributed Hash Table, DHT) technology. DHT is a distributed storage technology. Without the need of a central node, each storage node is responsible for a small range of routing and is responsible for storing a small part of data, thereby realizing the addressing and storage of the entire DHT distributed cluster. [0003] Cassandra's data storage space can be abstracted into a ring structure, and data is dispersed in this ring storage space through hash. Each node of the distributed storage system is responsible for managing a certain continuous range (also called Range) on this ring storage space, and the data falling in this Range...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F12/06G06F11/08
Inventor 王锋
Owner BEIJING QIHOO TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap