Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Automatic cleaning method and device for historical data

A historical data and automatic cleaning technology, applied in the field of data cleaning, can solve problems such as non-configurability, data confusion, difficulty in ensuring data table consistency, etc., to achieve the effect of ensuring data consistency

Active Publication Date: 2018-07-24
BANK OF CHINA
View PDF3 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Shortcomings and deficiencies in Method 1: This method is difficult to ensure the consistency between data tables, and is prone to errors, resulting in data confusion
[0007] Shortcomings and deficiencies of method 2: not configurable
Once you need to adjust the data cleaning rules or increase the range of cleaning tables, you need to modify the program, so the maintenance work becomes cumbersome and error-prone

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automatic cleaning method and device for historical data
  • Automatic cleaning method and device for historical data
  • Automatic cleaning method and device for historical data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0062] see figure 2 , a preferred embodiment of S101 includes:

[0063] S201: Read the data cleaning general control parameter table, and obtain the global control parameters of historical data cleaning, the historical data cleaning global control parameters include cleaning execution control effective flag, latest cleaning date and cleaning frequency;

[0064] S202: When the clearing execution control effective flag is effective, judge whether the historical data needs to be cleared according to the current date, the latest clearing date and the clearing frequency;

[0065] If yes, execute S203, S203: read the data table to be cleaned, obtain the current main data table to be cleaned, read the cleaning rule table, obtain each cleaning rule of the current main data table to be cleaned, and read the consistency rule table, obtain The associated table corresponding to the main data table currently to be cleaned;

[0066] If not, return to S202.

[0067] It should be noted th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an automatic cleaning method and device for historical data. The method comprises the steps that a data cleaning general control parameter list, a cleaning rule list, a consistency rule list and a to-be-cleaned data list are read to obtain a current to-be-cleaned data main list, an association list corresponding to the current to-be-cleaned data main list and each cleaningrule of the current to-be-cleaned data main list; according to the current to-be-cleaned data main list and each cleaning rule of the current to-be-cleaned data main list, relevant historical dada ofthe current to-be-cleaned data main list and association list corresponding to the current to-be-cleaned data main list is cleaned. According to a configurable cleaning rule, historical data is automatically cleaned, and the data consistency among the data lists is ensued during the cleaning of the historical data.

Description

technical field [0001] The present invention relates to the technical field of data cleaning, and more specifically, to an automatic cleaning method and device for historical data. Background technique [0002] Business data in computer systems usually accumulates continuously. If the large-scale business historical data is not cleaned up in time, it will take up too much disk space and affect the system response performance. Therefore, it is very necessary to clean up the historical data beyond a certain period in time. [0003] In existing application systems, two methods are generally used for historical data cleaning: [0004] Method 1: Manually issue the SQL TRUNCATE or SQLDELETE or SQL DROP\CREATE TABLE command for each data table that needs to be cleaned up for data cleaning; [0005] Method 2: Realize data cleaning by programming. Define and use database cursors in the cleaning program, and start from the main table to delete records one by one for each associate...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/219G06F16/2365
Inventor 谢小兵林楷坤
Owner BANK OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com