Data processing method and device, electronic equipment and computer readable storage medium

A data processing and data storage technology, applied in the communication field, can solve problems such as poor processing effect, and achieve the effects of storage performance guarantee, query performance guarantee, and processing effect guarantee

Pending Publication Date: 2021-06-15
BEIJING QIYI CENTURY SCI & TECH CO LTD
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Embodiments of the present invention provide a data processing method, device, electronic equipment, and computer-readable storage medium, so as to solve the problem of poor processing effect when ETL processing is performed in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device, electronic equipment and computer readable storage medium
  • Data processing method and device, electronic equipment and computer readable storage medium
  • Data processing method and device, electronic equipment and computer readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0022] see figure 1 , which shows a flowchart of a data processing method provided by an embodiment of the present invention. The method can be applied to electronic equipment, including but not limited to servers, computer systems, etc., such as figure 1 As shown, the method may include the following steps:

[0023] In step 101, data attribute information of first data to be processed by ETL is obtained.

[0024] It should be noted that the first d...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data processing method and device, electronic equipment and a computer readable storage medium. The method comprises the steps of obtaining data attribute information of first data to be subjected to ETL processing; inputting the data attribute information into a strategy determination model to obtain an ETL strategy output by the strategy determination model; and according to the ETL strategy, performing extraction and transposition processing on the first data to obtain second data, and storing the second data in the target database. Compared with the prior art, in the embodiment of the invention, the model is determined based on the data attribute information and the strategy, so that the processing effect during ETL processing of the data can be improved.

Description

technical field [0001] The present invention relates to the technical field of communications, and in particular to a data processing method, device, electronic equipment, and computer-readable storage medium. Background technique [0002] Generally speaking, data development mainly includes two parts: data ETL and data display; among them, ETL is the abbreviation of English Extract-Transform-Load, which is used to describe the process of extracting, transposing, and loading data from the source. (load) to the destination process. At present, when performing ETL processing of data, it is generally necessary to manually select how to perform ETL processing, and manual selection is often highly subjective, which will lead to poor processing effects of ETL processing. Contents of the invention [0003] Embodiments of the present invention provide a data processing method, device, electronic equipment, and computer-readable storage medium, so as to solve the problem of poor p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25G06F16/2455
CPCG06F16/254G06F16/258G06F16/2455
Inventor 康林段效晨赵艳杰秦占明易帆
Owner BEIJING QIYI CENTURY SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap