Parameterized online data cleaning method and device
A data cleaning and parameterization technology, applied in the field of data processing, can solve the problems of batch cleaning methods such as inflexible running time and methods, waste of system resources, etc.
Inactive Publication Date: 2019-11-15
BANK OF CHINA
View PDF5 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
The running time and method of the batch cleaning method are not flexible enough. Usually, one type of batch cleaning job can only clean up one type of data according to the uniform cycle and frequency, and it is difficult to make personalized adjustments according to the business background and data conditions.
The method of batch cleaning will clean up the overdue data on the cleaning day. If the subsequent overdue data is no longer used, it will also be cleaned up, thus causing a waste of system resources
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0017] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, not all of them. the embodiment. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.
[0018] To facilitate the understanding of this embodiment, a parameterized online data cleaning method disclosed in the embodiment of the present invention is firstly introduced in detail.
[0019] The embodiment of the present invention provides a parameterized online data cleaning method, see figure 1 A flow chart of a parameterized online data cleaning method is shown, the method...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a parameterized online data cleaning method and device. The method comprises the steps of: obtaining pre-configured cleaning parameters, wherein the cleaning parameters at leastcomprise a cleaning data type, a cleaning period starting date, a cleaning period, a cleaning frequency and a cleaning mode; judging whether the online data needs to be cleared or not according to the clearing period starting date, the clearing period and the clearing frequency, the online data being data generated in the case of online transaction; and if so, cleaning the online data according to the cleaning data type and the cleaning mode. According to the invention, the cleaning parameters are configured; different cleaning modes of different cleaning periods, cleaning frequencies and different types of data are cleaned; whether the online data needs to be cleared or not is judged when the transaction occurs, namely before the data is used, so that the online data to be used is cleared, the clearing timeliness and flexibility can be greatly improved, and the consumption of system resources is reduced.
Description
technical field [0001] The invention relates to the technical field of data processing, in particular to a parameterized online data cleaning method and device. Background technique [0002] There are a lot of time-sensitive data in the banking system, and these data will become redundant data after the expiration date. If these data are not cleaned up and updated in time, continuing to use expired data will cause subsequent banking business processing errors. [0003] At present, the common cleaning method in the banking system is batch and regular cleaning. That is, on a fixed date, through a batch program, all data that exceeds the validity period in a certain type of data are cleaned up. The running time and method of batch cleaning methods are not flexible enough. A type of batch cleaning job can usually only clean up a type of data at a uniform cycle and frequency, and it is difficult to make personalized adjustments based on business background and data conditions. ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/215G06Q40/02
CPCG06Q40/02G06F16/215
Inventor 刘基南刘宝成张靖
Owner BANK OF CHINA