Service monitoring method and system based on cloud native data warehouse

A monitoring system and business technology, applied in the Internet field, can solve the problems of limited data volume and computing power, large amount of index data, scattered index data, etc., to solve the bottleneck problem of computing and storage resources, reduce human and material resources, and facilitate follow-up. processing effect

Pending Publication Date: 2021-08-17
上海数禾信息科技有限公司
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, the total amount of index data in various business fields is huge, which is difficult to aggregate and integrate in real time, and cannot provide unified and real-time query and analysis capabilities, which makes the index data scattered and forms data islands to a certain extent. At the same time, data sources are diverse and require customized processing and conversion logic , the indicator data is reported by itself, which is cumbersome, and there is no unified indicator production path. The indicator iteration needs to be regularly scheduled and developed, resulting in a long incremental indicator iteration cycle. At the same time, the indicator data production is limited by the data volume and computing power, and the indicator data cannot be guaranteed. real-time production
[0004] Based on the above problems, how to realize real-time business indicator data production, real-time alarm and real-time business report, so that it is impossible to find Internet business problems in a timely manner, and provide real-time data support for business pain point review and analysis, has become a must in the Internet business monitoring process. problem to be solved

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Service monitoring method and system based on cloud native data warehouse
  • Service monitoring method and system based on cloud native data warehouse
  • Service monitoring method and system based on cloud native data warehouse

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0043] see figure 1 , the embodiment of the present invention provides a cloud-native data warehouse-based business monitoring method, including:

[0044] Synchronize data generated in various business areas to the cloud-native data warehouse;

[0045] Based on the preset indicator calculation configuration data, query the corresponding data from the cloud-native data warehouse and perform indicator calculation to generate indicator data;

[0046] Calculate the indicator data according to the preset alarm rules, obtain the alarm information, and notify the alarm receiver when the alarm information reaches the preset alarm threshold.

[0047] The monitoring method disclosed in the present invention is based on the massive and real-time analysis capabilities of the cloud-native data warehouse, which technically ensures the real-time performance of index production; based on the isolation of computing resources and the elastic expansion and contraction capabilities of the cloud-...

Embodiment 2

[0061] see Figure 6 , an embodiment of the present invention provides a cloud-native data warehouse-based business monitoring system, including a configuration module, a cloud-native data warehouse, an indicator calculation module, and a monitoring module, wherein,

[0062] The configuration module is used to set the indicator calculation configuration data;

[0063] Cloud Native Data has built-in multiple data synchronization tools, which are used to clean and synchronize data generated in various business fields to the Cloud Native Data Warehouse;

[0064] The indicator calculation module includes multiple indicator calculation units, and each indicator calculation unit is used to perform one or more indicator calculation tasks. The indicator calculation tasks include: querying the corresponding data from the cloud-native data warehouse based on the indicator calculation configuration data and performing indicator calculation , to generate indicator data;

[0065] The mon...

Embodiment 3

[0075] A computer-readable storage medium, having computer-readable program instructions stored thereon, the computer-readable program instructions are used to execute the cloud-native data warehouse-based business monitoring method in the first embodiment above, including: The generated data is synchronized to the cloud-native data warehouse, and based on the preset indicator calculation configuration data, the corresponding data is queried from the cloud-native data warehouse and the indicator calculation is performed to generate indicator data; the indicator data is calculated according to the preset alarm rules, Obtain alarm information, and notify the alarm receiver when the alarm information reaches the preset alarm threshold.

[0076] The computer-readable storage medium provided by the embodiments of the present invention may be—but not limited to—electric, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems, or devices, or any combination th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a service monitoring method and system based on a cloud native data warehouse, and relates to the technical field of the Internet. The method comprises the steps: synchronizing data generated in each service field to the cloud native data warehouse, querying corresponding data from the cloud native data warehouse based on preset index calculation configuration data, and carrying out the index calculation to generate index data; and calculating the index data according to a preset alarm rule to obtain alarm information, and notifying an alarm receiver when the alarm information reaches a preset alarm threshold value. Compared with a traditional method, the service monitoring method and monitoring system based on the cloud native data warehouse solve the problems that the iteration period of incremental indexes is long, index data are dispersed, and the real-time performance of index calculation cannot be guaranteed.

Description

technical field [0001] The present invention relates to the field of Internet technology, in particular to a business monitoring method and system based on a cloud-native data warehouse. Background technique [0002] The rapid development of the Internet has made the use of the Internet more and more common. The Internet has not only become a communication bridge within the enterprise, but also an important channel for various business transactions between the enterprise and the outside. With the continuous innovation and improvement of the Internet service model and product structure, the Internet business is also developing continuously. Internet business has given full play to the optimization and integration role of the Internet in the allocation of production factors, deeply integrated the innovative achievements of the Internet into various economic and social fields, and formed a wider new form of economic development with the Internet as the infrastructure and realiz...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/30G06F11/32G06F16/215G06F16/245G06F16/27
CPCG06F11/302G06F11/327G06F16/215G06F16/245G06F16/275
Inventor 黄宏贵
Owner 上海数禾信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products