Normalized data cleaning method

A data cleaning and normalization technology, applied in the field of database cleaning, can solve problems such as unrollable operations, dependence on manual operations, long query time, etc., to achieve the effects of improving security, avoiding data confusion, and reducing the risk of misoperation

Active Publication Date: 2017-05-10
湖北省农村信用社联合社网络信息中心
View PDF4 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The present invention aims to solve one of the technical problems existing in the prior art. Therefore, one purpose of the present invention is to provide a normalized data cleaning method, which can effectively solve the problems of long query time, unrollable operation, and security problems. Low, and all rely on manual operations and other issues

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Normalized data cleaning method
  • Normalized data cleaning method
  • Normalized data cleaning method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] Embodiments of the present invention are described in detail below. The embodiments described below by referring to the figures are exemplary only for explaining the present invention and should not be construed as limiting the present invention.

[0045] Such as figure 1 As shown, the normalized data cleaning method includes the following steps:

[0046] S1. Construct a data container conversion system;

[0047] S2, performing data separation;

[0048] S3, data processing;

[0049] S4. Complete data integration;

[0050] S5. Realize the automatic maintenance system.

[0051] In the normalized data cleaning method described in the present invention, the step S1 includes:

[0052] S101. Build a new partition table whose table definition is the same as that of the existing physical table;

[0053] S102. Export data from the current physical table;

[0054] S103. Load data into the newly created partition table;

[0055] S104. Establish necessary indexes and const...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a normalized data cleaning method. The normalized data cleaning method comprises the following steps of 1 constructing of a data container conversion system, wherein the system is used for achieving data conversion processing, querying, deleting and regulating operations taking day as a unit; 2 data separating, wherein data separating is conducted on data in the data container conversion system, and separated data is obtained; 3 data processing, wherein data processing is conducted on the separated data according to business logic, and processed data is obtained; 4 data integrating, wherein the processed data is integrated to ensure the integrity of the data; 5 automatic system maintaining. According to the method, the labor cost that people participate in operation is reduced, and the misoperation risks of implementers in the maintenance process are reduced.

Description

technical field [0001] The invention belongs to the technical field of database cleaning, and in particular relates to a method for normalizing data cleaning of a database. Background technique [0002] Database cleaning is to clear the data in the database. The traditional method of database cleaning is generally to strip historical data from the existing database through manual cleaning. Traditional manual cleaning methods mainly include DELETE and Truncate. [0003] The DELETE method is a command to implement the delete function in programming, and is used to create a delete query that can delete records from one or more tables listed in the FROM clause. When this method is executed, the database log will be recorded, and data rollback is allowed in case of misoperation (some database products support flashback) and data security improvement. But its disadvantage is that the method consists of two parts, 1. Query and filter the desired target; 2. Delete the selected tar...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/215
Inventor 高天翔杨志云付毅汪源陈广涛杨欣周新刘麟杨建设吴宇光陈胜
Owner 湖北省农村信用社联合社网络信息中心
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products