Data increment and merging method and device for achieving method

An incremental and data technology, applied in the database field, can solve the problems of computing resource consumption and uncontrollable performance, achieve the effect of simple structure, ensure controllable performance, and reduce the amount of data

Inactive Publication Date: 2014-03-26
ALIBABA GRP HLDG LTD
View PDF4 Cites 42 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of this application is to solve the problems of computing resource consumption and uncontrollable per

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data increment and merging method and device for achieving method
  • Data increment and merging method and device for achieving method
  • Data increment and merging method and device for achieving method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] The technical solutions of the present application will be described in further detail below in conjunction with the accompanying drawings and embodiments, and the following embodiments do not limit the present application.

[0046] The flow of a method for incrementally merging massive data in this application is shown in Figure 1, which is used to incrementally merge the full tables of the data warehouse with massive data, including steps:

[0047] Step 101, setting a partition field.

[0048] The data table in the data warehouse contains records, and each record contains multiple flag fields. For example, a payment record usually includes the creation time field, payment time field, payment content, payment amount, etc., and the records are usually fixed. The date field of the record can be set as a partition field, or a certain field of the record can be set as a partition field according to the specific conditions of the record. The partition field is mainly used ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data increment and merging method and a device for achieving the method. The method comprises the steps of putting subarea fields of extracted incremental data in order by setting the subarea fields, confirming specific subarea identifications, performing subarea filtering on a full scale according to the subarea identifications, extracting subarea data tables corresponding to the subarea identifications, then merging the incremental data and the subarea data tables and finally inserting the merged subarea data tables back to the full scale so as to achieve increment and merging. By adopting the data increment and merging method and the device for achieving the method, the data volume of the data increment and merging operation is decreased, computing resources are saved, and meanwhile the data accuracy is improved.

Description

technical field [0001] The present application relates to the technical field of databases, in particular to a method and device for incrementally merging data. Background technique [0002] With the popularization of the Internet and the rapid development of digital information technology, massive amounts of electronic data are generated almost every day, and it is difficult to measure the total amount of electronic data stored in today's society. Nowadays, not only the amount of electronic data generated and stored is huge, but also the data itself is becoming more and more complex. The processing of massive data has attracted more and more attention. [0003] In the processing of massive data, the incremental merging technology of massive data is a method that every enterprise with large amount of data will adopt. Massive data incremental merging technology is to capture the new and updated data of the day from the production system database, and merge it with the full a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/215
Inventor 朱晓克
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap