Data cleaning and merging method and device based on multi-source system and readable medium
A data cleaning and source system technology, applied in the field of data cleaning, can solve the problems of data inconsistency and scattered information in multiple business systems, and achieve the effect of improving the overall structure, improving management and control capabilities, and solving pain points
Pending Publication Date: 2022-03-04
厦门信息港建设发展股份有限公司
View PDF0 Cites 2 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0012] In view of the above-mentioned problems such as inconsistent data and scattered information in multiple business systems
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0050] In order to make the purpose, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only some of the embodiments of the present invention, rather than all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.
[0051] figure 1 Shown is an exemplary device architecture 100 to which the method for cleaning and merging data based on a multi-source system or the device for cleaning and merging data based on a multi-source system according to an embodiment of the present application can be applied.
[0052] Such as figure 1As shown, the device architecture 100 may include terminal devices 101 , 102 , 103 , a network 104 and a server 105 . The net...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a data cleaning and merging method and device based on a multi-source system and a readable medium, and the method comprises the steps: building a business library, monitoring the data change information of a plurality of source systems, and generating a task scheduling list; obtaining a task scheduling list according to warehousing configuration of the business library to generate an information task scheduling queue, and cleaning the information task scheduling queue to obtain an effective information task scheduling queue; a storage table is generated according to the effective information scheduling task queue, and a transfer relation and an information storage type between the source system and the business library are established in the storage table; obtaining data of the source system according to the task scheduling list, obtaining change information based on an information mapping relationship between the source system and the business library, and writing the change information into storage information in a storage list; and changing metadata in the meta-model of the business library according to the storage information and the information storage type. Therefore, the changed data in the multi-source system can be effectively cleaned, and unified management of the data of the source system is facilitated.
Description
technical field [0001] The invention relates to the field of data cleaning, in particular to a data cleaning and merging method, device and readable medium based on a multi-source system. Background technique [0002] At present, in order to make transaction processing more convenient and fast, many places will establish multiple online business management systems. With the establishment and use of various business systems, the problem of "data islands" has affected the daily use of users and management units. Currently facing the following pain points: [0003] 1. Repeated entry of information: Each system maintains its own data, resulting in repeated maintenance workload, and due to different business operators, it leads to incomplete data and high probability of data errors. [0004] 2. The information is not interoperable: the information is not managed uniformly, which leads to the inability to control the business. For example, the status of moving in and out of the c...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F16/215G06F16/22G06F16/23G06Q10/10G06F9/48G06F9/54
CPCG06F16/215G06F16/2282G06F9/546G06F16/23G06Q10/103G06F9/4881G06F2209/548
Inventor 李卫江陈军刘龙辉庄祖川卢衍科严璐琳
Owner 厦门信息港建设发展股份有限公司