Unlock instant, AI-driven research and patent intelligence for your innovation.

Data increment processing method and apparatus

A data and incremental technology, applied in the Internet field, can solve the problem of low processing efficiency and achieve the effect of improving efficiency

Active Publication Date: 2017-04-19
BEIJING GRIDSUM TECH CO LTD
View PDF6 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the present invention provides a method and device for incremental data processing, which can solve the problem of low processing efficiency when processing data warehouses and SSAS data inconsistencies

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data increment processing method and apparatus
  • Data increment processing method and apparatus
  • Data increment processing method and apparatus

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0024] The embodiment of the present invention provides a method for incremental data processing, such as figure 1 As shown, the method includes:

[0025] 101. Before performing the current automatic data processing, acquire the processing identifier of the last automatic data processing recorded in the first database.

[0026] Wherein, the automatic data processing is periodically updating the data in the second database to the f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data increment processing method and apparatus, which relates to the technical field of the internet and can solve the problem of low processing efficiency when a processed data warehouse is inconsistent with SSAS (Sql Server Analysis Service) data. The method comprises the steps of obtaining a processing identifier of most recent data automatic processing recorded in a first database before current data automatic processing is carried out, wherein the processing identifier comprises a time identifier and a position identifier; obtaining a time field from metadata of the first database; judging whether contents in the time identifier are the same as contents in the time field or not; if a judgment result is that the contents in the time identifier are the same as the contents in the time field, performing increment processing according to the position identifier; and if a judgment result is that the contents in the time identifier are different from the contents in the time field, performing full-processing on a corresponding partition to be subjected to data automatic processing. The method and the apparatus are suitable for a scene in which an SSAS extracts incremental data from the data warehouse.

Description

technical field [0001] The present invention relates to the technical field of the Internet, in particular to a method and device for incremental data processing. Background technique [0002] The data warehouse is used to store data, and the data analysis system is used to analyze the data in the database or data warehouse. Among them, the commonly used data analysis system is SSAS (Sql Server Analysis Service, database analysis service). [0003] In practical applications, the data in the data warehouse will be updated in real time (that is, new data will be added), and SSAS will perform incremental processing periodically, that is, the latest data will be periodically extracted from the data warehouse and stored in SSAS. However, after SSAS performs this incremental processing and before the next incremental processing, managers sometimes need to analyze the latest data, so they will manually perform full processing on SSAS, that is, delete all data currently stored in S...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/21
Inventor 洪超
Owner BEIJING GRIDSUM TECH CO LTD