Duplicated data delete method

A data and database technology, applied in electrical digital data processing, special data processing applications, instruments, etc., can solve problems such as low data deduplication efficiency, and achieve the effect of reducing scale, reducing dependence, and improving comparison efficiency

Active Publication Date: 2015-03-04
HUNAN GOKE MICROELECTRONICS
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The data deduplication efficiency of the above method is low. In order to ensure normal business execution, the above technology cannot be used in the normal business process, unless a dedicated data deduplication proces

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Duplicated data delete method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0012] The following takes the storage device as a storage array and the host as a server to illustrate the specific implementation process of the technical solution:

[0013] 1) In the process of delivering business data, the server first establishes a sample database on the server according to steps 1, 2, and 3 of the present invention;

[0014] 2) Servers and storage arrays send the data in the sample database to each array through custom manufacturer commands or other data commands of standard protocols (such as SCSI / SATA / SAS / FC).

[0015] 3) After receiving the comparison data request from the server, each storage array compares the received data with the data stored in the array. That is, process according to step 4 of the present invention.

[0016] After the specific implementation of the above three steps, the duplicate data of each storage array will be processed and deleted at the same time, and the normal business data processing between the server and the array w...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a duplicated data delete method. Data comparison scale is limited in each storing device, the data comparison scale is reduced, meanwhile, concurrence comparison of each storing device can be achieved, the comparison efficiency is increased, and dependence on host resources can be reduced. Each storing device triggers corresponding data comparison operation according to business pressure or host requirements, and the duplicated data delete method can be used during normal business processes without limit to business scenes such as special backups.

Description

technical field [0001] The invention relates to a data deduplication method. Background technique [0002] In the prior art, in the process of sending data, the hash fingerprint of the data is first extracted from the storage system such as the file system or database, and put into the host memory or a dedicated system for data comparison, and the duplicate data is deleted through the comparison result And mark the index, add the non-duplicate data to the hash fingerprint database, and then send the processed data to the data storage device, so as to effectively eliminate the duplicate data. [0003] The data deduplication efficiency of the above method is low. In order to ensure normal business execution, the above technology cannot be used in the normal business process, unless a dedicated data deduplication processor is used to share the CPU pressure of the host, and the existing technology has no impact on the host. Memory has high requirements, so the existing technol...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/215
Inventor 吕辉姜黎马翼
Owner HUNAN GOKE MICROELECTRONICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap