Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Method and device for processing data

A data processing device and data processing technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve problems such as inability to delete, low average deduplication performance, and many interactions between nodes, so as to improve flexibility , improve performance and deduplication rate, and reduce costs

Active Publication Date: 2013-04-17
HUAWEI TECH CO LTD
View PDF6 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, the cluster backup system either adopts intra-node deduplication or inter-node deduplication, but no matter which method is used, it has its own advantages and disadvantages.
[0004] Intra-node deduplication is only performed within the node. This method is simple to implement and has high deduplication performance, but the deduplication rate of the entire cluster system is not high. If there is data duplication between nodes, it cannot be deleted; duplicate data between nodes Deletion is performed on all nodes in the entire cluster domain. This method can ensure that there is no duplicate data in the entire cluster, but the data deletion speed is relatively slow, and there are many interactions between nodes. The average deduplication performance of the cluster with deduplication between nodes Lower than on-node deduplication

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for processing data
  • Method and device for processing data
  • Method and device for processing data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] In order to make the purposes, technical solutions and advantages of the embodiments of the application clearer, the technical solutions in the embodiments of the application will be clearly and completely described below in conjunction with the drawings in the embodiments of the application. Obviously, the described embodiments It is a part of embodiment of this application, and is not all embodiment. Based on the implementation manners in this application, all other implementation manners obtained by persons of ordinary skill in the art without creative efforts fall within the scope of protection of this application.

[0033] The data processing method provided in the embodiments of the present application may be implemented on a storage system. figure 1 , figure 2 A schematic diagram of the system architecture of the data processing method provided for the implementation of this application, such as figure 1 as well as figure 2As shown, the storage system includ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

An embodiment of the invention discloses a method and a device for processing data. The method for processing data includes: judging whether a memory system is within business online time, on yes judgment, deleting repeated data in nodes, on no judgment, judging whether memory property of the memory system reaches a preset property threshold, on no judgment, deleting repeated data among the nodes, and on yes judgment, finishing deleting of the repeated data. By means of the method, a characteristic that the memory system has business online and offline time is fully used, deleting of the repeated data in the nodes is conducted during online, deleting of the repeated data among the nodes is conducted during offline, flexibility of deleting of the repeated data in a cluster is improved, and simultaneously repeated data deleting performance and repeated data deleting rate are improved.

Description

technical field [0001] The invention relates to a data processing method and device. Background technique [0002] With the development of information technology, especially the rapid update of network technology, the amount of data has increased dramatically, and the amount of data that needs to be backed up has also doubled. Therefore, although the cost per unit of storage space continues to decrease, the amount of data that enterprises need to store or back up continues to rise, resulting in endless cost investment in disk storage space for enterprises. [0003] Data deduplication technology is a data reduction technology that can greatly reduce the amount of backup data and reduce costs. There are two main ways to deduplicate data: intra-node deduplication (Local deduplication) and inter-node deduplication (Global deduplication). At present, the cluster backup system either adopts intra-node deduplication or inter-node deduplication, but either way has its own advantag...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 杜宇旻田鉴
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com