Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and system for optimization realization based on time dimension data real-time inquiry service

An implementation method and technology for implementing a system, which are applied in electrical digital data processing, special data processing applications, instruments, etc., and can solve problems such as constraints, unsupported big data, and high-throughput metric data query.

Active Publication Date: 2013-10-16
SHANGHAI CTRIP COMMERCE CO LTD
View PDF3 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the distributed TSD implementation based on big data is also restricted by Brewer's CAP distributed theory (see http: / / www.cs.berkeley.edu / ~brewer / cs262b-2004 / PODC-keynote.pdf)
Famous TSD open source implementations, such as opentsdb (see http: / / opentsdb.net / ) do not support big data and high-throughput measurement data query

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for optimization realization based on time dimension data real-time inquiry service

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0028] The present invention provides an optimized implementation method for real-time query service based on time measurement data, including performing the following operations on the query database:

[0029] Store different metrics, each metric includes multiple metric data points, each metric data point includes a metric value and a label set, each label in the label set consists of a key / value pair, and the metrics in different metrics Data points have different key sets, but the key sets of measurement data points in the same measurement are the same, they will belong to the same measurement, and the data points containing the same key / value pair combination will be classified as a basic time measurement sequence and recorded in the metadata table. Specifically, time-based metric data is defined as follows, and each different metric i has its own name, ie, metric(i). A metric data point, metric_data_point(i,t), belongs to metric i and occurs at time t. Each data measur...

Embodiment 2

[0048] The present invention also provides another optimized implementation system for real-time query service based on time measurement data, which includes a query database for storing different measurements, each measurement includes a plurality of measurement data points, and each measurement data point includes a measurement value and a label set, each label in the label set is composed of a key / value pair, and the measurement data points in different measurements have different key sets, but the key sets of the measurement data points in the same measurement are the same, Data points that belong to the same metric and contain the same key / value pair are grouped into a basic time metric sequence and recorded in the metadata table.

[0049] Preferably, the query database uses different namespaces to segment different metrics, that is, the metrics of the same type are classified into the same namespace, and a metric can only belong to one namespace, and each namespace contai...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method and a system for optimization realization based on time dimension data real-time inquiry service. The method can effectively degrade the consistency of the time dimension metadata to the ultimate consistency through TSD-based time dimension data inquiry-based distributed design, and through relevant optimization based on the design including fragmentation and downsampling, so as to support arbitrarily horizontal expansion of the dimension data; meanwhile, the inquiry service can support real-time inquiry pressure of high concurrency and high throughput, so as to realize high availability and high expansibility of the time dimension inquiry service.

Description

technical field [0001] The invention relates to the optimized design of time-based measurement data query service, and is especially suitable for real-time operation monitoring, fault warning, rapid troubleshooting, capacity planning, performance tuning and many other fields of large and medium-sized websites. The invention relates to an optimization realization method and system for real-time query service based on time measurement data. Background technique [0002] With the increase of internal applications of some large and medium-sized Internet companies, higher and higher requirements are put forward for real-time monitoring of the service quality of the entire website. In order to grasp the operation status of the entire website in real time and continuously optimize system performance, it is necessary to collect real-time measurement data at different levels of each application, and analyze and utilize them effectively. [0003] In order to support efficient trouble...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 江伟李欣李东泽张勇储诚栋
Owner SHANGHAI CTRIP COMMERCE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com