Method for storing and searching mass sensor data

A sensor and mass technology, applied in the field of sensor data, can solve problems such as low efficiency, inability to support "key-value" query, and limit the scale of sensor data

Active Publication Date: 2012-08-29
INST OF SOFTWARE - CHINESE ACAD OF SCI
View PDF2 Cites 35 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this method also has many defects when dealing with sensor sampling data management.
First of all, the performance of relational database clusters in processing keyword queries is much lower than that of key-value databases, and cannot well support "key-value" queries; secondly, relational database clusters adopt strict transaction processing mechanisms (such as data locking mechanisms , multi-version mechan

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for storing and searching mass sensor data
  • Method for storing and searching mass sensor data
  • Method for storing and searching mass sensor data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] The main contents of the present invention are described below in four parts.

[0053] 1. Overall system structure of STDB-KV storage method

[0054] In sensor mass data management systems (such as Internet of Things systems, sensor monitoring systems), data centers usually need to store and query the data collected by mass sensors in real time. In order to ensure the fast query processing performance of the system, we can use the STDB-KV storage method to organize a large number of sensor spatiotemporal database nodes into a collaborative cluster storage system. The architecture of the STDB-KV storage system is as follows figure 1 shown.

[0055] Such as figure 1 As shown, the STDB-KV storage system is a database cluster system. In the STDB-KV storage system, all database nodes (including the root node and each leaf node) are sensor spatiotemporal databases (see below "2. Data types and query operations in the sensor spatiotemporal database"), sensor spatiotemporal...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for storing and searching mass sensor data and belongs to the field of sensor data. The method comprises the following steps that: two layers of storage frame, which comprise a root node and a plurality of leaf nodes, are established; a receiving server distributes sampling data sent by a sensor to the corresponding leaf nodes; each leaf node stores the historic sampling value of the same monitoring target, which is acquired by the sensor, in an element group of a leaf node database in a uniform form to form a sampling data sequence of the monitoring target; and an overall time and space distributed index and an overall key word distributed index of the two layers of storage frame are established. Quick time and space search and key word search can be supported at the same time through the overall key word index, the overall time and space index and an overall search processing mechanism. Multiple searching types of quick processing are compatible, and the defects that the current time and space database is mainly used for storing relative static space data or relative single time and space data and an efficient heterogeneous data flow representation method is lacked are overcome.

Description

technical field [0001] The invention relates to the field of sensor data and the field of temporal and spatial databases, and proposes a massive sensor sampling data storage and query processing method capable of simultaneously supporting fast space-time query and keyword query. Background technique [0002] At present, in various sensor application systems, the demand for centralized storage management and query processing of massive sensor sampling data is very strong. For example, in Internet of Things systems, intelligent transportation systems, and urban real-time monitoring systems, it is necessary The continuously dynamically uploaded sensor sampling values ​​are centrally stored in the data center, and the history and current sampling values ​​of the sensor are quickly queried and analyzed through the corresponding query interface, so as to carry out corresponding processing. [0003] However, there is currently no effective solution to the above requirements. In te...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 丁治明
Owner INST OF SOFTWARE - CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products