A saving-type deduplication method in cloud storage system

A technology of data deduplication and cloud storage system, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of no consideration, enhanced data dynamics, unsuitable cloud storage system, etc., and achieve storage load balance , the effect of relieving access pressure

Inactive Publication Date: 2018-05-08
中智云福(杭州)医疗科技有限公司
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Existing technologies are generally oriented to backup and archiving systems with relatively static data, avoiding duplicate data uploads from the source and not considering whether the data in the storage system will be modified, while the data in the cloud storage system is shared by multiple users. Modifying data leads to enhanced data dynamics, so it is not suitable for cloud storage systems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A saving-type deduplication method in cloud storage system
  • A saving-type deduplication method in cloud storage system
  • A saving-type deduplication method in cloud storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] For the convenience of description, the present invention provides the architecture diagram of the cloud storage deduplication system, as shown in the attached figure 1shown. The system consists of m clients (Client), 1 metadata server (Metadata Server, MS), 1 secondary metadata server (Secondary Metadata Server, SMS) and n storage nodes (Storage Node, Snode). . Among them, the client is mainly the object that initiates operations such as file upload, access, modification, and deletion; the metadata server mainly stores all metadata information of the file system and provides the basis for access control and global deduplication, which is equivalent to the entire system architecture of the center. The secondary metadata server is mainly responsible for synchronizing backup metadata image files and operation logs; the storage node is responsible for storing actual data blocks. In addition, there is a close relationship between the various components in the system and ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for saving repeated data deletion in a cloud storage system. The cloud storage system comprises a client for file operation, a metadata server for storing metadata information of the file system, and a mirror file for synchronizing and backing up metadata. The secondary metadata server of the log and the storage nodes that store the data blocks are composed together. The five steps of the method are aimed at the dynamic nature of the data in the cloud storage system, considering the characteristics of the data itself, and divide the data into hot data and non-hot data. Different data use different deduplication timings to ensure better system performance and better reduction of system response time.

Description

technical field [0001] The invention relates to the field of computer data storage, in particular to a method for saving duplicate data in a cloud storage system. Background technique [0002] In recent years, the increasing popularity of technologies such as cloud computing, mobile computing, and the Internet of Things has led to an explosive growth of data, and cloud storage technology has emerged as the times require. According to statistics from the International Data Corporation IDC, the total amount of global data in 2011 has reached 1.8ZB (1ZB=10 9 TB), it is estimated that by 2020, the total amount of information generated globally will reach 35ZB. The storage pressure of the system is also increasing day by day. IDC survey also found that there are nearly 75% of redundant data in information systems, a large amount of redundant data wastes a lot of storage resources, and deduplication technology can effectively reduce data. [0003] Data de-duplication technology...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06G06F17/30
Inventor 徐小龙涂群李涛徐佳朱洁
Owner 中智云福(杭州)医疗科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap