Unlock instant, AI-driven research and patent intelligence for your innovation.

Query processing method and system for industrial time series data

A technology for time series data and data query, applied in the field of data processing, can solve problems such as slow query speed, inability to execute, memory overflow, etc., to reduce the data range, save time and computing resources, and improve data query efficiency.

Active Publication Date: 2021-10-12
苏州工业大数据创新中心有限公司
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the field of industrial Internet, the amount of data generated by sensors is huge. Even if the Impala query based on SQL-on-Hadoop, the query speed is very slow due to the huge amount of data to be scanned and the large amount of data to be sorted. cannot execute due to overflow

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Query processing method and system for industrial time series data
  • Query processing method and system for industrial time series data
  • Query processing method and system for industrial time series data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0054] Those skilled in the art can understand that, unless otherwise defined, all terms (including technical terms and scientific terms) used herein have the same meaning as commonly understood by those of ordinary skill in the art to which this invention belongs. It should also be understood that terms, such as those defined in commonly used dictionaries, should be understood to have meanings consistent with the meanings in the co...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a query processing method and system for industrial time series data. The method includes: according to the query time in the data query request, determining the corresponding data partition of the target data to be queried in the data distributed storage system, wherein the The data distributed storage system is divided into multiple data partitions in the time dimension according to the storage time of the stored industrial time-series data; the data partitions are used as the target data scanning area, and the target data is generated in the target data scanning area. A data query plan; executing the query plan to obtain query results. Based on the application of the underlying system partition function, the present invention directly reduces the range of data that needs to be scanned without scanning the entire amount of data, and the present invention avoids the process of fully sorting the data, effectively saving the time and cost required for data scanning and full data sorting. Computing resources improve the efficiency of data query.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a query processing method and system for industrial time series data. Background technique [0002] With the wide application of Internet technology, in the context of the technology industry and the combination of traditional industries and the Internet industry, the growth of industrial time series data is exponential. It is the most basic form of data query to perform range query on massive industrial time series data and return the original data set for a given time period. At present, in the face of massive industrial time-series data, distributed storage and computing systems based on common computers (commodity hardware) are mainstream platform architectures (such as Hadoop). In these distributed systems, it is very time-consuming and computing-resource-consuming operation to perform full sorting of a certain device data. The access to time series data naturally ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/2458G06F16/245G06F16/2453G06F16/27
CPCG06F16/245G06F16/24532G06F16/2474G06F16/278
Inventor 张鹏张硕陈景帅杨锐
Owner 苏州工业大数据创新中心有限公司