Data warehouse data updating method and device, electronic device and storage medium

A data warehouse and data update technology, applied in database update, relational database, database index and other directions, can solve the problems of waste of computer resources, high time cost, slow data update speed, etc., to achieve incremental update and improve data update timeliness Effect

Pending Publication Date: 2021-03-05
CHINA LIFE INSURANCE COMPANY
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of this, the purpose of one or more embodiments of this specification is to propose a data warehouse data update method, equipment, electronic equipment and storage media to solve the waste of computer resources caused by the Hive data warehouse data update, slow data update speed, The problem of high time cost

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data warehouse data updating method and device, electronic device and storage medium
  • Data warehouse data updating method and device, electronic device and storage medium
  • Data warehouse data updating method and device, electronic device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] In order to make the purpose, technical solutions and advantages of this specification more clear, the following will further describe this specification in detail in combination with specific embodiments and with reference to the accompanying drawings.

[0038] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present specification shall have ordinary meanings understood by those skilled in the art to which the present disclosure belongs. "First", "second" and similar words used in the present disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components. "Comprising" or "comprising" and similar words mean that the elements, objects or method steps appearing before the word cover the elements, objects or method steps listed after the word and their equivalents, without excluding other elements, objects or method steps. Method steps. Words such ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

One or more embodiments of the invention provide a data warehouse data updating method and device, an electronic device and a storage medium, and the method comprises the steps: storing target data into a temporary table of a data warehouse, and determining the feature information of the target data; converting the target data into a data extraction file in a specific data exchange format according to the feature information; and calling a data warehouse tool through an agent script to perform data extraction on the data extraction file, and updating the data extraction file from the temporarytable to a formal table of a data warehouse. One or more embodiments of the present specification convert target data into a data extraction file in a specific data exchange format based on feature information of the target data, and then call a data warehouse tool through an agent script to perform data extraction on the data extraction file to update data of a data warehouse. Therefore, incremental updating of the stock data of the data warehouse can be realized, and the data updating timeliness is improved.

Description

technical field [0001] One or more embodiments of this specification relate to the technical field of data storage, and in particular to a method, device, electronic device, and storage medium for updating data in a data warehouse. Background technique [0002] Hive is a data warehouse built on top of Hadoop. Using Hive for data storage involves a data update problem. Currently, Hive supports only two operations of overwriting and appending data tables. The coverage described here is not the data coverage of a certain record, but the full coverage of the entire table data. Appending does not mean updating part of the original data or adding changes, but adding the data as a whole to the existing data set. [0003] Hive does not support data update and deletion operations, and can only add content, and uses the full coverage method to update data. When faced with a huge amount of data, such as a data volume of more than 100 million, it will consume a lot of computing resourc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/23G06F16/22G06F16/27G06F16/28
CPCG06F16/2282G06F16/23G06F16/27G06F16/285
Inventor 白龙陈辰张浩王厚玉黄艳袁慧斌胡帅
Owner CHINA LIFE INSURANCE COMPANY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap