Internal memory and file system mixing rearrangement method based on HASH algorithm

A file system and memory technology, applied in prepaid phone systems, computing, electrical components, etc., can solve the problems of strong database system dependence, low efficiency of reloading modules, low processing efficiency, etc., and achieve strong system dependence and resource utilization. The effect of increased consumption and large resource consumption

Inactive Publication Date: 2009-07-29
LINKAGE SYST INTEGRATION
View PDF2 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Solve the problem of low efficiency of the previous weight removal module
Solve the problem of high efficiency of database resources and strong dependence on the database system; solve the problem of low processing efficiency; enhance the function of deduplication; improve versatility

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Internal memory and file system mixing rearrangement method based on HASH algorithm
  • Internal memory and file system mixing rearrangement method based on HASH algorithm
  • Internal memory and file system mixing rearrangement method based on HASH algorithm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] The present invention will be further described below in conjunction with the accompanying drawings and embodiments. Deduplication based on memory and file system is an independent module in the billing system, and its standard software model is as follows: image 3 shown

[0038] The specific implementation steps are:

[0039] ●Configuration information

[0040] Step 1 Configure information, configure the deduplication type (full deduplication, cross deduplication, no deduplication) and filter information acquisition method according to the deduplication business requirements of each business.

[0041] Step 2 Plan and create a file directory for storing files of filtering information.

[0042] Step 3 Set the time window parameters for memory storage according to the real-time degree of the business and the memory size.

[0043] ●During the implementation process, the configuration parameters of the deduplication system are saved in files in XML format. According t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an implement method based on mixed tautology removal of an HASH algorithm memory and a file system, which adopts the combination of the tautology removal of the memory and the tautology removal of the file system so as to achieve a win-win result of data storage use space and processing efficiency. The implement method has the procedure that tautology removal information in a certain period of time is loaded into the memory and the tautology removal of the memory is adopted, and beyond the time the tautology removal of the document is adopted. The implement method mainly has the following steps: step 1. tautology removal configuration information (record format information, tautology removal types) is loaded into the memory; step 2. the tautology removal information in a certain period of time (configurable) is loaded into a private memory; step 3. the tautology removal of memory is performed, i.e., the tautology is removed according to the filtering information in the memory; and step 4. tautology removal of a file is performed, the tautology is removed according to the historical filtering information in the file. The storage structure of the information of the tautology removal in the memory has two characteristics of HASH lists and time window.

Description

1. Technical field [0001] The invention relates to the field of deduplication processing in the billing system of the telecommunication industry, in particular to a deduplication technology based on HASH algorithm memory and file system mixing. 2. Background technology [0002] With the rapid increase of business volume in the telecommunication industry, the deduplication part is an important part of the entire billing system process, and its performance will inevitably affect the performance of the entire billing system. How to maximize the performance of the weight removal module is an urgent problem to be solved. The purpose of deduplication is to remove heavy single (repeated record) in the file; The applicant has proposed CN200610038375 based on the filter sheet memory deduplication method and CN200610085767 based on memory-based massive call list fast cross deduplication method, but the deduplication efficiency is still There is a need to improve. [0003] In the pre...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30H04M15/00H04M17/00H04W4/24
Inventor 张有根高将飞梁斌李华顾恺宇陈杰刘星张晓乐
Owner LINKAGE SYST INTEGRATION
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products