Method and system for optimization realization based on time dimension data real-time inquiry service

An implementation method and technology for implementing a system, which are applied in electrical digital data processing, special data processing applications, instruments, etc., and can solve problems such as constraints, unsupported big data, and high-throughput metric data query.

Active Publication Date: 2013-10-16
SHANGHAI CTRIP COMMERCE CO LTD
View PDF3 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the distributed TSD implementation based on big data is also restricted by Brewer's CAP distributed theory (see http://www.cs.berkeley.edu/~brewer/cs262b-2004

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for optimization realization based on time dimension data real-time inquiry service

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0027] Example one

[0028] The present invention provides an optimized realization method of real-time query service based on time measurement data, including the following operations on querying a database:

[0029] Store different metrics, each metric includes multiple metric data points, each metric data point includes a metric value and a label set, each label in the label set is composed of a key / value pair, and the metric in different metrics Data points have different sets of keys, but the key sets of measurement data points in the same metric are the same. Data points that belong to the same metric and contain the same key / value pair combination are classified as a basic time measurement sequence And recorded in the metadata table. Specifically, the time-based metric data is defined as follows, and each different metric i has its own name, namely metric(i). The metric data point metric_data_point(i,t), it belongs to the metric i, and the metric data point occurs at time ...

Example Embodiment

[0047] Example two

[0048] The present invention also provides another system for real-time query service optimization based on time measurement data, including a query database for storing different metrics. Each metric includes multiple metric data points, and each metric data point includes a metric value and a label. A set, each label in the label set is composed of a key / value pair, and metric data points in different metrics have different key sets, but the key sets of metric data points in the same metric are the same, The data points belonging to the same metric and containing the same key / value pair combination are classified as a basic time metric sequence and recorded in the metadata table.

[0049] Preferably, the query database uses different namespaces to slice different metrics, that is, metrics of the same type are grouped into the same namespace, and a metric can only belong to one namespace, and each namespace contains multiple metrics. , Save all metrics in the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method and a system for optimization realization based on time dimension data real-time inquiry service. The method can effectively degrade the consistency of the time dimension metadata to the ultimate consistency through TSD-based time dimension data inquiry-based distributed design, and through relevant optimization based on the design including fragmentation and downsampling, so as to support arbitrarily horizontal expansion of the dimension data; meanwhile, the inquiry service can support real-time inquiry pressure of high concurrency and high throughput, so as to realize high availability and high expansibility of the time dimension inquiry service.

Description

technical field [0001] The invention relates to the optimized design of time-based measurement data query service, and is especially suitable for real-time operation monitoring, fault warning, rapid troubleshooting, capacity planning, performance tuning and many other fields of large and medium-sized websites. The invention relates to an optimization realization method and system for real-time query service based on time measurement data. Background technique [0002] With the increase of internal applications of some large and medium-sized Internet companies, higher and higher requirements are put forward for real-time monitoring of the service quality of the entire website. In order to grasp the operation status of the entire website in real time and continuously optimize system performance, it is necessary to collect real-time measurement data at different levels of each application, and analyze and utilize them effectively. [0003] In order to support efficient trouble...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 江伟李欣李东泽张勇储诚栋
Owner SHANGHAI CTRIP COMMERCE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products