A data deduplication method and system applied to a boss system

A deduplication and data technology, which is applied to the redundancy in the operation for data error detection, response error generation, electrical digital data processing, etc. It can solve the problems of redundant data and low storage space utilization. The effect of reducing storage space usage, reducing data volume, and shortening monthly backup time

Active Publication Date: 2018-01-09
北京思特奇信息技术股份有限公司
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0011] The technical problem to be solved by the present invention is to provide a data deduplication method and system applied to the BOSS system, which is used to solve the technical problems of redundant data and low storage space utilization in the BOSS system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data deduplication method and system applied to a boss system
  • A data deduplication method and system applied to a boss system
  • A data deduplication method and system applied to a boss system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The principles and features of the present invention will be described below with reference to the accompanying drawings. The examples cited are only used to explain the present invention, and are not used to limit the scope of the present invention.

[0034] Such as figure 1 As shown, this embodiment provides a data deduplication method applied to the BOSS system, including:

[0035] Step 1. Load the business files generated by the BOSS system into the preset deduplication mechanism, and process the loaded business files based on the file-level deduplication method or the memory-level deduplication method in the deduplication mechanism to generate the deduplication data file ;

[0036] Step 2. Divide the deduplicated data file into several data blocks by means of fixed length or slider;

[0037] Step 3: Perform a hash operation on each divided data block to generate a corresponding hash value;

[0038] Step 4. Select or add a data block, and compare its corresponding hash value...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a data duplication deleting method and system applied to a BOSS system. The method comprises the steps that (1) service documents generated in the BOSS system are loaded into a preset duplication deleting mechanism, and the loaded service documents are processed in the duplication deleting mechanism on the basis of a document duplication deleting mode or a memory duplication deleting mode to generate duplication deleting data documents; (2) the duplication deleting documents are partitioned into a plurality of data blocks in a fixed-length mode or a sliding-block mode; (3) Hash computing is carried out on each partitioned data block to generate a corresponding Hash value; (4) when one data block is selected or a new data block is added, the Hash value corresponding to the data block is compared with Hash values corresponding to the other data blocks; if the Hash value corresponding to the data block is equal to the Hash value corresponding to any data block, the data block is deleted; if not, the data block is stored. According to the data duplication deleting method and system applied to the BOSS system, the duplication deletion system is introduced into the BOSS system, so that the memory space usage rate of the BOSS system and the data amount needing to be prepared monthly are greatly reduced.

Description

Technical field [0001] The invention relates to the field of BOSS systems, in particular to a data deduplication method and system applied to the BOSS system. Background technique [0002] With the rapid development of operators’ business, business support pressure is increasing. The storage of business data faces greater pressure in time and space, which is mainly reflected in the increasingly tight space and the longer and longer monthly backup time. If things go on like this, there will be problems that cannot be solved by adding storage. [0003] The main reasons for the shortage of storage space and long monthly backup time are as follows: [0004] 1) The redundant data between modules is huge [0005] Such as pre-processing entrance, exit, wrong order, and weight removal, the repetition frequency of key elements of billing in each link is extremely high. [0006] 2) The redundant data in the module is huge [0007] Some fields in a link can only have several value ranges, and the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30G06F11/14
CPCG06F3/0641G06F16/1752
Inventor 朱云章
Owner 北京思特奇信息技术股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products