Unlock instant, AI-driven research and patent intelligence for your innovation.

Data processing method in storage cluster, storage cluster, storage node and equipment

A storage node and storage cluster technology, applied in the computer field, can solve the problems of consuming storage resources, computing resources and network resources, etc., and achieve the effect of low latency and guaranteed performance

Pending Publication Date: 2022-04-01
ALIBABA (CHINA) CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Repeated storage of the same data not only consumes storage resources, but also consumes computing resources and network resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method in storage cluster, storage cluster, storage node and equipment
  • Data processing method in storage cluster, storage cluster, storage node and equipment
  • Data processing method in storage cluster, storage cluster, storage node and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] Before introducing the various embodiments of the present application, a brief description of the nouns involved in this document is given first.

[0046] Deduplication: A technique for eliminating duplicate data. Data deduplication technology can find duplicate data from already stored data, not store duplicate data, only store new data.

[0047] In addition, what needs to be added here is: the difference between duplicate data and multi-copy strategies. The difference between duplicate data and multi-copy strategies is that duplicate data refers to two data with the same content appearing in the same system, two copies of the same data stored are equivalent, and there is no disaster recovery between the two copies of the same data function, only one copy can be stored. The multi-copy redundancy strategy is to store another or two copies of the same data on different storage nodes, and data redundancy can be achieved between these copies. When a copy fails, other co...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a data processing method in a storage cluster, the storage cluster, a storage node and equipment. According to the technical scheme provided by the embodiment of the invention, in the first stage, repeated data in the storage node is eliminated with low delay; in order to guarantee the performance of the storage cluster, the second stage can be executed in a non-blocking mode, and whether second data repeated with the first data is stored in other storage nodes in the storage cluster is checked; and when the verification result shows that the storage exists in the storage cluster, the first storage node executes the deduplication operation for the first data, that is, the performance of the storage cluster is not greatly influenced while the deduplication of the repeated data is realized, and the efficiency of infrastructures such as calculation, storage and network of the storage cluster is improved.

Description

technical field [0001] The present application relates to the field of computer technology, and in particular to a data processing method in a storage cluster, a storage cluster, a storage node and a device. Background technique [0002] Cloud storage technology brings convenient storage services to users. In the cloud storage system, users can purchase and utilize storage resources according to their needs. Cloud Storage Providers (Cloud Storage Providers, CSPs) usually provide virtualized environments to decouple hardware differences from the capacity used by cloud users. At the same time, with the development trend of CSP outward expansion, in order to meet the increasing storage capacity and data reliability requirements, distributed storage clusters are often used as the back-end deployment. Storage capacity and bandwidth consumption lead to cost growth, an issue that becomes even more critical when cloud users create large amounts of data to be stored over time. How ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/06
Inventor 李舒
Owner ALIBABA (CHINA) CO LTD