Data archiving method and device and storage system

A data archiving and storage system technology, applied in transmission systems, electrical digital data processing, special data processing applications, etc., can solve the time-consuming problem of rewriting file metadata, improve data migration efficiency, and solve duplicate data block queries Effect

Active Publication Date: 2013-12-25
HUAWEI TECH CO LTD
View PDF4 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] In view of this, the technical problem to be solved by the present invention is how to solve the problem of time-consuming operations such as repeated data block query and rewriting of file metadata during the data block migration process in the archiving scenario

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data archiving method and device and storage system
  • Data archiving method and device and storage system
  • Data archiving method and device and storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0042] The data archiving method according to an embodiment of the present invention is applied to such as figure 1 In the shown storage system, the storage system is divided into multiple storage tiers according to the data access speed of the storage medium, specifically, it can be divided into an active tier (Active tier) and multiple retention tiers (Retention tier). Wherein, the data access speed of the storage tier as the active tier is higher than that of the storage tier as the reserved tier, and the data access speeds of the storage tiers as the reserved tier are also different. In a possible implementation manner, the active layer stores data written to the storage system within 90 days, and the reserved layer stores data written to the storage system for a longer period of time, for example, data from 90 days to 1 year or 1 year to 7 years. Deduplication data is stored in various storage levels with different data access speeds according to storage time and access ...

Embodiment 2

[0061] In the case that the access reference information of the container is updated due to writing, deleting, and / or reading of files in the storage system, the flow chart of the data archiving method is as follows Figure 6 As shown in , it is judged based on the updated access reference information of the container whether the container needs to be migrated to a storage level with a high data access speed, where the high data access speed is relative to the data access speed of the storage level where the container is located If the container needs to be migrated to a storage layer with high data access speed, the migration process of the container is completed.

[0062] Among them, the so-called situation of updating the access reference information of the container due to the writing, deletion, and / or reading of the file includes: when the file is written into the storage system, the file is first divided into blocks according to a certain algorithm, and divided into multi...

Embodiment 3

[0074] Figure 8 A flowchart showing a data archiving method according to yet another embodiment of the present invention. Figure 8 Winning mark and Figure 6 The same reference numerals have the same functions, and detailed descriptions of these reference numerals are omitted for brevity. Figure 8 The data archiving method shown is the same as Figure 6 The main difference of the data archiving method shown is that judging whether to migrate to a storage layer with high data access speed is not triggered by updating the access reference information of the container, but is performed periodically.

[0075] In one possible implementation, such as Figure 8 As shown, the step before step S620 is S810, that is, for the container, periodically determine whether the container needs to be migrated to a storage layer with high data access speed based on the access reference information of the container.

[0076] Specifically, the background scanning process of each storage leve...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data archiving method and device and a storage system. The data archiving method is applied to the storage system with at least two storage tiers different in data access speed, and each tier contains containers. The data archiving method includes: judging whether the first container is needed to be transferred to the second storage tier based on access reference information in the first container of the first storage tier or not, if yes, determining the second container in the second storage tier, transferring a data block stored in the first container to the second container, and modifying a container address corresponding to a container number of the first container into a container address of the second container. Due to the fact that each storage tier of the storage system is taken as the same repeated delete domain, time-consuming operations such as repeated data block queries and rewriting of file metadata during transferring of the block data are omitted and efficiency of data block transferring under an archiving setting is effectively improved.

Description

technical field [0001] The invention relates to the field of data storage, in particular to a data archiving method and device and a storage system. Background technique [0002] Generally, devices with deduplication function can be used to reduce storage space and accommodate more data. Deduplication refers to the deduplication of data, that is, each file is cut into multiple data blocks according to a specific algorithm, and it is judged which data blocks are already stored in the storage system and which data blocks are not in the storage system. , and store the unstored data blocks in the container included in the storage system; then modify the metadata of the file to point to the data blocks in the container. Wherein, the metadata of a file refers to a description file corresponding to each file, which describes which data blocks the file consists of and which containers these data blocks are stored in. [0003] In order to save data maintenance costs, data archiving...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06F12/08H04L29/08
Inventor 谢勇付旭东
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap