Method and system for loading abstract data based on data warehouse
A technology for abstracting data and data loading. It is applied in database management systems, database models, multi-dimensional databases, etc. It can solve problems such as non-homogeneous problem planning and management, single analysis and modification, and poor program maintainability, so as to improve development timeliness. , reduce labor costs and improve the accuracy of analysis
Active Publication Date: 2020-08-28
INDUSTRIAL AND COMMERCIAL BANK OF CHINA
View PDF6 Cites 6 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0002] Due to the rapid development of big data technology, the database software is also constantly updated. The data in the data warehouse is frequently switched between the SAS platform, Teradata platform, Hadoop platform, and GaussDB platform. To adapt to the characteristics of the new technology platform, it is inevitable that a large number of manual writing and modification of the loading program will occur. Although a unified template loading tool has been formed in the later stage of the technology platform formation, the large number of manual loading programs in the early stage has caused the program. Poor maintainability, relying heavily on manual search programs for single analysis and modification, unable to conduct unified planning and management of homogeneous issues such as loading specification standards and technical platform characteristics
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0038] Embodiments of the present invention provide a method and system for abstract data loading based on a data warehouse.
[0039] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.
[0040] A data warehouse is a subject-oriented, integrated, relatively stable data collection that reflects historical changes, providing data support for business analysis and management decisions. In order to reflect these characteristics, as shown in Table 1, the loading operation of the topic model of the current data warehouse has the f...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a method and system for loading abstract data based on a data warehouse. The method comprises the steps of preprocessing an operation script to obtain an actual service script;extracting an association relationship among a target table, a source table field and an insertion content used by statement analysis in the actual service script, and extracting predicate informationin the actual service script; determining an association relationship between a loading program and a loading algorithm by utilizing the predicate information and loading algorithm standard information; and according to the incidence relation of the target table, the source table field and the insertion content and the incidence relation of the loading program and the loading algorithm, performing data loading on the input operation. According to the method, disordered management of a large number of manual loading programs of the data warehouse on different technical platforms is overcome, and the defects that the logic corresponding relation of the data warehouse model depends on manual search and cannot be accurately obtained are overcome, and the loading program development time efficiency is improved, and the labor cost is reduced, and the positioning problem analysis time efficiency is improved, and the analysis accuracy is improved.
Description
technical field [0001] The invention relates to the technical field of data loading, in particular to a method and system for abstract data loading based on a data warehouse. Background technique [0002] Due to the rapid development of big data technology, the database software is also constantly updated. The data in the data warehouse is frequently switched between the SAS platform, Teradata platform, Hadoop platform, and GaussDB platform. To adapt to the characteristics of the new technology platform, it is inevitable that a large number of manual writing and modification of the loading program will occur. Although a unified template loading tool has been formed in the later stage of the technology platform formation, the large number of manual loading programs in the early stage has caused the program. Poor maintainability, relying heavily on manual search programs for single analysis and modification, unable to conduct unified planning and management of homogeneous issu...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25G06F16/28
CPCG06F16/254G06F16/283
Inventor 李湘玲聂冬琴唐一帆
Owner INDUSTRIAL AND COMMERCIAL BANK OF CHINA