Unlock instant, AI-driven research and patent intelligence for your innovation.

Data sheet based data eliminating method and device

A data table and data technology, applied in the field of data elimination method and device based on data table, can solve the problems of increasing background load, large data capacity, slowing down of related thread processing speed, etc., and achieve the effect of reducing load and improving operating efficiency

Active Publication Date: 2017-05-17
BEIJING QIHOO TECH CO LTD
View PDF6 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, the inventor found in the process of realizing the present invention that the above-mentioned method in the prior art has at least the following defects: since the data capacity stored in the hard disk is relatively large, setting a special elimination thread will undoubtedly increase the load of background operation, Slows down the processing speed of related threads in the background, thereby reducing the efficiency of data processing in the background and affecting the running speed of the background

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data sheet based data eliminating method and device
  • Data sheet based data eliminating method and device
  • Data sheet based data eliminating method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0026] figure 1 A flow chart of a data table-based data elimination method provided by Embodiment 1 of the present invention is shown. Such as figure 1 As shown, the method includes the following steps:

[0027] Step S110: When performing data consistency detection, traverse the data in each data table to detect whether the data in each data table is consistent.

[0028] Specifically, when data is stored (that is, written) into the corresponding data table, since the data will be copied into multiple copies and each piece of data will be divided into multiple data pieces for fragmentation storage, different data The table will correspond to data fragments with the same storage content. Consistency detection refers to: in order to strictly ensure the accuracy of the data fragment content stored in each data table and reduce the error probability when writing data in each data table, set a regular or Irregular traversal process. During this traversal process, the verificatio...

Embodiment 2

[0035] figure 2 A flow chart of the data elimination method based on the data table provided by Embodiment 2 of the present invention is shown. Such as figure 2 As shown, the method includes the following steps:

[0036] Step S210: Set the execution cycle of data consistency detection in advance according to the data elimination cycle of each data table.

[0037] Specifically, the data elimination period is a corresponding data elimination period set for each data table by those skilled in the art according to the characteristics of data stored in each data table. For example, if the information aging period of the data stored in data table 1 is 4h, the data elimination period of data table 1 is set to 4h for the information aging of data table 1. The execution cycle of data consistency detection is the cycle of traversing each data in the data table when detecting data consistency. For example, the execution cycle of the data consistency check can also be set to 4 hours...

Embodiment 3

[0055] image 3 A structural block diagram of a data table-based data elimination device provided by Embodiment 3 of the present invention is shown. Such as image 3 As shown, the device includes: a detection module 31 , a determination module 32 , an elimination module 33 , a first preprocessing module 34 , an adjustment module 35 , a second preprocessing module 36 , a partition creation module 37 and a setting module 38 .

[0056] The detection module 31 is adapted to traverse the data in each data table when performing data consistency detection, so as to detect whether the data in each data table is consistent.

[0057] Wherein, when detecting whether the data in each data table is consistent, the detection module 31 can extract the data with the same key value in each data table, calculate the data verification value corresponding to the data with the same key value, and determine whether each data is consistent according to the calculation result . Specifically, when ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data sheet based data eliminating method and device. The technical problem that when stale data is eliminated in the prior art, due to the fact that a special elimination thread is arranged on a background and accordingly increases the operating load of the background, the operating speed of the background becomes low can be solved at least. The method comprises the steps that data in data sheets is traversed to detect whether the data in the data sheets is consistent or not when data consistency detection is executed; for any data sheet in the traversing process, whether the data in the data sheets is needed to be eliminated or not is further determined according to data elimination rules corresponding to the data sheets; the data needed to be eliminated in the data sheets are eliminated.

Description

technical field [0001] The invention relates to the field of communication technology, in particular to a method and device for eliminating data based on a data table. Background technique [0002] At present, when the background system eliminates expired data, it sets a elimination thread specially for the expired data in the hard disk in the background, and scans and deletes the expired data that needs to be eliminated in the hard disk through the elimination thread. [0003] However, the inventor found in the process of realizing the present invention that the above-mentioned method in the prior art has at least the following defects: since the data capacity stored in the hard disk is relatively large, setting a special elimination thread will undoubtedly increase the load of background operation, It slows down the processing speed of related threads in the background, thereby reducing the processing efficiency of data in the background and affecting the running speed of ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50G06F9/48
CPCG06F9/4843G06F9/5027
Inventor 王文铎
Owner BEIJING QIHOO TECH CO LTD