Data warehouse monitoring method and system

A data warehouse and data technology, applied in the field of database processing, can solve problems such as the inability to effectively guarantee the stability of the data warehouse, and achieve the effect of ensuring stability

Inactive Publication Date: 2018-05-29
KE COM (BEIJING) TECHNOLOGY CO LTD
View PDF5 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, the existing technology does not provide an early warning of possible abnormal output due to changes in the routine data volume of the business, and conducts all-round monitoring of the data volume of each data table in the data warehouse, which cannot effectively guarantee the stability of the data warehouse

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data warehouse monitoring method and system
  • Data warehouse monitoring method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] The specific implementation manners of the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. The following examples are used to illustrate the present invention, but are not intended to limit the scope of the present invention.

[0040] see figure 1 , is a flowchart of a monitoring method for a data warehouse according to an embodiment of the present invention, including: S1, obtaining any data table in the data warehouse, and predicting the data table within a fixed time period of the forecast day according to the autoregressive integral sliding average model Data increment, the data increment is the number of data increments in the data table; S2, calculate the actual data increment of the forecast day within a fixed time period, compare the actual data increment with the predicted data increment, and monitor the data Whether the table performs early warning.

[0041] Specifically, the autoregr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data warehouse monitoring method. The method comprises the steps of S1, obtaining any data table in a data warehouse, and according to an auto-regressive integrated moving average model, predicting a data increment of the data table in a fixed time period of a prediction day, wherein the data increment is the number of increased pieces of data in the data table; and S2, calculating an actual data increment in the fixed time period of the prediction day, comparing the actual data increment with the predicted data increment, and monitoring whether the data table is subjected to early warning or not. By comparing the actual increment of the data collected in the data warehouse with the increment predicted by the auto-regressive integrated moving average model, the early warning is performed when a deviation between the actual increment and the predicted increment is excessively large, and the data quantity of each data table in the data warehouse is comprehensively monitored, so that the stability of the data warehouse can be effectively guaranteed.

Description

technical field [0001] The present invention relates to the technical field of database processing, and more specifically, to a monitoring method and system for a data warehouse. Background technique [0002] A data warehouse corresponds to multiple business data sources. As the business continues to deepen, the data that needs to be analyzed is also increasing. Correspondingly, the data warehouse has many tasks. A large amount of new data is stored in the data warehouse every day. If an exception occurs during the daily task processing, it will affect the quality of the data and may affect the data in the future. Therefore, abnormalities in the data processing process are found in time and processed. It is very important for the data warehouse. [0003] The prior art provides a data monitoring method for data warehouses. By performing scheduled monitoring tasks and a series of related configurations, the data status of the tables updated daily in the data warehouse can b...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/2282G06F16/283
Inventor 王勇
Owner KE COM (BEIJING) TECHNOLOGY CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products