Duplicated data deleting method and apparatus

A technology of deduplication and data, applied in the field of data processing, can solve the problems of occupying huge data storage space, transmitting data with multiple network bandwidth, and consumption.

Active Publication Date: 2015-09-23
常州横塘科技产业有限公司
View PDF3 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] At present, the total amount of data in the network is increasing exponentially, which not only needs to

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Duplicated data deleting method and apparatus
  • Duplicated data deleting method and apparatus
  • Duplicated data deleting method and apparatus

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0044] The terms "first", "second", "third", "fourth", etc. (if any) in the description and claims of the present invention and the above drawings are used to distinguish similar objects and not necessarily Describe a specific order or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances such that the embodiments of the invention described herein are, for example, capable of practice in sequences other than thos...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention discloses a duplicated data deleting method and apparatus, which are applied to the technical field of data processing. According to the present invention, programs stored in a storage are called by a processor; data to be processed is partitioned into a plurality of data streams, so that a hardware accelerator can simultaneously and respectively calculate identification information of data blocks which the data streams comprise; and then the processor, according to the identification information, carries out duplicated data deleting processing. The duplicated data deleting apparatus disclosed by the present invention can partition the data to be processed into a plurality of data streams so as to carry out processing of deleting duplicated data on the data streams in parallel, and thus, efficiency of deleting the duplicated data can be improved. In addition, according to the present invention, partial functions in the duplicated data deleting process are realized by adopting a hardware structure instead of calling software of the programs, so that efficiency of the duplicated data deleting process can be effectively improved.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a method and device for deduplication of data. Background technique [0002] At present, the total amount of data in the network is increasing exponentially, which not only needs to consume more and more network bandwidth to transmit data, but also takes up huge data storage space. In order to reduce the total cost of ownership (English: Total Cost of Ownership, abbreviation: TCO) of computer data storage systems and computer networks, enterprises have begun to adopt data deduplication technology. [0003] Data deduplication (Data deduplication) technology has become a mainstream and extremely important technology in the field of computer systems. Its working principle is to identify duplicate data from the data stream, keep only one backup of the duplicate data, delete other redundant data, and refer to the position where the duplicate data is deleted, thereby saving a ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/00G06F9/44
Inventor 张亮陆承涛刘屹葛雄资吴俊
Owner 常州横塘科技产业有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap