Data extraction method and device, electronic equipment, storage medium and program product

A data extraction and data storage technology, applied in the computer field, can solve the problems of cumbersome operation and maintenance work and low development efficiency.

Pending Publication Date: 2021-05-04
LAKALA PAYMENT CO LTD
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

A common practice is to map a table in the production system to a data extraction script in the big data cluster platform. Whenever a new data table is added to the production system, the background management personnel of the big data cluster platform need to perform data extraction once. The development of extraction scripts is extremely inefficient, and the operation and maintenance work is extremely cumbersome

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data extraction method and device, electronic equipment, storage medium and program product
  • Data extraction method and device, electronic equipment, storage medium and program product
  • Data extraction method and device, electronic equipment, storage medium and program product

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0138] Hereinafter, exemplary embodiments of embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily realize them. Also, for clarity, parts not related to describing the exemplary embodiments are omitted in the drawings.

[0139] In the embodiments of the present disclosure, it should be understood that terms such as "comprising" or "having" are intended to indicate the presence of features, numbers, steps, acts, components, parts or combinations thereof disclosed in this specification, and are not intended to The possibility that one or more other features, numbers, steps, acts, parts, parts or combinations thereof exist or be added is excluded.

[0140] In addition, it should be noted that, in the case of no conflict, the embodiments in the present disclosure and the features in the embodiments can be combined with each other. Embodiments of the present disclosure will be descr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Embodiments of the invention disclose a data extraction method and apparatus, an electronic device, a storage medium and a program product. The method comprises the steps of receiving a data extraction request from a client, wherein the data extraction request comprises an identifier and configuration parameters of the target data extraction template; utilizing the configuration parameters to configure the target data extraction template; running an execution script of the target data extraction template so as to obtain data from one or more production systems by utilizing the configured target data extraction template; and storing the data acquired from the production system to a big data cluster system. According to the technical scheme, the data extraction efficiency of the big data cluster system is improved, the script development time in the data extraction process is saved, and the operation and maintenance process of the big data cluster system is simplified.

Description

technical field [0001] Embodiments of the present disclosure relate to the field of computer technology, and in particular to a data extraction method, device, electronic equipment, storage medium, and program product. Background technique [0002] The big data cluster platform needs to centralize the data of the core production system, but in some large enterprises, there may be more than one production system, there may be hundreds, and the data tables generated by the production system may be tens of thousands of levels, so in the production system The data centralization process encountered an adjustment. A common practice is to map a table in the production system to a data extraction script in the big data cluster platform. Whenever a new data table is added to the production system, the background management personnel of the big data cluster platform need to perform data extraction once. The development of extraction scripts is extremely inefficient, and the operatio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25
CPCG06F16/254
Inventor 不公告发明人
Owner LAKALA PAYMENT CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap