Unlock instant, AI-driven research and patent intelligence for your innovation.

Industrial time series data query processing method and system

A time series data and data query technology, which is applied in the field of data processing, can solve problems such as slow query speed, inability to execute, memory overflow, etc., and achieve the effects of narrowing the data range, saving time and computing resources, and improving data query efficiency

Active Publication Date: 2018-04-10
苏州工业大数据创新中心有限公司
View PDF7 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the field of industrial Internet, the amount of data generated by sensors is huge. Even if the Impala query based on SQL-on-Hadoop, the query speed is very slow due to the huge amount of data to be scanned and the large amount of data to be sorted. cannot execute due to overflow

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Industrial time series data query processing method and system
  • Industrial time series data query processing method and system
  • Industrial time series data query processing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0054] Those skilled in the art can understand that, unless otherwise defined, all terms (including technical terms and scientific terms) used herein have the same meaning as commonly understood by those of ordinary skill in the art to which this invention belongs. It should also be understood that terms, such as those defined in commonly used dictionaries, should be understood to have meanings consistent with the meanings in the co...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an industrial time series data query processing method and system. The method comprises the steps of determining a data partition corresponding to target data to be queried in adata distributed storage system according to query time in a data query request, wherein the data distributed storage system is divided into a plurality of data partitions in the time dimension according to the storage time of stored industrial time series data; taking the data partition as a target data scanning area, and generating a query plan for querying the target data in the target data scanning area; executing the query plan, and obtaining a query result. According to the industrial time series data query processing method and system, on the basis of the partition function of an application underlying system, the range of data to be scanned is directly narrowed without scanning the whole data; moreover, the process of total data ranking is avoided, the time and calculation resources consumed by data scanning and total data ranking are effectively saved, and the data query efficiency is improved.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a query processing method and system for industrial time series data. Background technique [0002] With the wide application of Internet technology, in the context of the technology industry and the combination of traditional industries and the Internet industry, the growth of industrial time series data is exponential. It is the most basic form of data query to perform range query on massive industrial time series data and return the original data set for a given time period. At present, in the face of massive industrial time-series data, distributed storage and computing systems based on common computers (commodity hardware) are mainstream platform architectures (such as Hadoop). In these distributed systems, it is very time-consuming and computing-resource-consuming operation to perform full sorting of a certain device data. The access to time series data naturally ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/245G06F16/24532G06F16/2474G06F16/278
Inventor 张鹏张硕陈景帅杨锐
Owner 苏州工业大数据创新中心有限公司