Method and device for importing data
A data import and metadata technology, applied in the computer field, can solve the problems of lack of guiding logical relationship processing and integration testing, cumbersome manual configuration, cumbersome failure handling, etc., to maximize the efficiency of error checking, improve accuracy, The effect of restoring cost minimization
Active Publication Date: 2011-11-09
SHENZHEN TENCENT COMP SYST CO LTD
View PDF4 Cites 34 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0011] In an environment where Internet companies have a lot of business and changes rapidly, manual configuration is so cumbersome that it is almost an impossible task; operations are fragmented and difficult to manage, and multiple logins to complex environment configurations are required in multiple data sources and heterogeneous environments; Instructive front-back logical relationship processing and integration testing, the incompatibility of front-back configuration can only be postponed to the implementation stage to find out; the failure handling of configuration errors is cumbersome, and the correct part cannot be skipped and directly recovered from the error scene
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0045] Aiming at the problems of cumbersome manual configuration, scattered processing steps and scattered places in the prior art, in the technical solution provided by the present invention, metadata generation, database table creation, adding partitions and empowering are realized in the process of data access in the form of workflow , as well as functions such as adapting various businesses, the background automatically generates and deploys running programs, which can support multiple data sources and data terminals such as multiple databases and distributed systems. In the environment of complex enterprise-level data warehouse business, complex metadata, and various programs and plug-ins that are cumbersome and error-prone, a new solution for frequent access to large amounts of data without manual intervention is given.
[0046]In the technical solution provided by the present invention, the minimum subset that is variable for the business is extracted and provided in the...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a method for importing data. The method comprises the following steps: obtaining service files from a service system, generating static meta data according to the service files and ensuring the static meta data to access a target database corresponding to the service system; and using the static meta data for converting the formats of the service data in the target database and importing the data subjected to format conversion into a target data storage area. The method has the following advantage: the accuracy, usability and efficiency of data import are improved. The invention also discloses a device applying the method.
Description
technical field [0001] The invention relates to the field of computer technology, in particular to a data import method and device. Background technique [0002] In the process of enterprise information construction, due to the phased, technical, and other economic and human factors in the construction of various business systems and the implementation of data management systems, the enterprise has accumulated a large amount of business data in different storage methods during the development process. , and the data management systems used for business data are also very different, from simple file databases to complex network databases, which constitute the heterogeneous data sources of enterprises. [0003] Heterogeneous data sources refer to data between different database management systems. The heterogeneity of enterprise data sources is mainly manifested in: [0004] 1. System heterogeneity, that is, the difference between the business application system, database man...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06Q10/00
Inventor 蒲刚周小平杨晓青
Owner SHENZHEN TENCENT COMP SYST CO LTD