Time series data storage method and time series database applied to industrial internet of things

An industrial Internet of Things, time series data technology, applied in the database field, can solve the problems of increased data processing complexity and data redundancy, increased deployment and operation and maintenance difficulty, data synchronization, and increased output process, so as to reduce the deployment and operation and maintenance difficulty. , the effect of reducing the complexity of data processing and the degree of data redundancy

Inactive Publication Date: 2020-02-14
CHINA UNITECHS
View PDF5 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Adding a new database will lead to a significant increase in the difficulty of deployment and maintenance, and due to the additional data storage, the data synchronization and output processes involved will increase, resulting in both the complexity of data processing and the degree of data redundancy.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Time series data storage method and time series database applied to industrial internet of things
  • Time series data storage method and time series database applied to industrial internet of things
  • Time series data storage method and time series database applied to industrial internet of things

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0013] In order to make the purpose, technical solutions, and advantages of the embodiments of the present application clearer, the embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings. Here, the exemplary embodiments of the application and their descriptions are used to explain the application, but not to limit the application.

[0014] Time series databases have the following characteristics:

[0015] 1. When data is written, high concurrency and continuous writing, after writing, the data is read-only and cannot be modified;

[0016] 2. When data is stored, it is stored in different regions on the disk according to the measurement, data timestamp (timestamp) and data statistical dimension (tag);

[0017] 3. When reading data, it generally queries and counts in batches based on dimensions and time periods, and rarely retrieves a single record.

[0018] The data set of the IIOT scene has the following...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a time series data storage method and time series database applied to industrial Internet of Things. The method comprises the following steps: obtaining to-be-stored time series data, and cleaning the time series data; distributing topic of the time series data according to the source of the time series data; writing the cleaned time series data into a section correspondingto a section in kafka, and caching an collection timestamp corresponding to each part of time series data and offset information of each part of time series data in the section in the writing process; organizing and combining offset information under each action, and determining an association relationship among the topic, the collection timestamp and the offset information; and persisting the incidence relation among the topic, the collection timestamp and the offset information into an index library. According to the method and the device, the data processing complexity and the data redundancy degree caused by additionally introducing a new time sequence database can be reduced.

Description

technical field [0001] The present application relates to the technical field of databases, in particular to a method for storing time-series data and a time-series database applied to the Industrial Internet of Things. Background technique [0002] This section is intended to provide a background or context to embodiments of the invention that are recited in the claims. The descriptions herein are not admitted to be prior art by inclusion in this section. [0003] In the Industrial Internet of Things (IIOT) scenario, because it involves the collection, calculation and analysis of massive databases, a Hadoop-based big data platform is almost indispensable, and due to the data characteristics of IIOT itself, usually It is also necessary to introduce time series databases such as OpenTSDB and Cassandra to manage indicator data collected from sensors or other terminals. Adding a new database will lead to a significant increase in the difficulty of deployment and maintenance, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22G06F16/215G06F16/2458G06F16/2455
CPCG06F16/2228G06F16/215G06F16/24552G06F16/2474G06F16/2477
Inventor 毛恒
Owner CHINA UNITECHS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap