Multi-sensor-based automatic storage method for multiple heterogeneous data streams

Abstract

The embodiment of the invention provides a multisensor-based multivariate and heterogeneous data steam automatic storage method. The method includes the steps that a processor receives multivariate and heterogeneous data steams collected by at least two sensors; the processor judges whether the sensors corresponding to the multivariate and heterogeneous data steams exist in a sensor format information table, if yes, whether multivariate and heterogeneous data are matched with the sensor format information table is judged, and if yes, the multivariate and heterogeneous data are stored in a local steam database; if the sensors corresponding to the multivariate and heterogeneous data steams do not exist in the sensor format information table, format information of the sensors corresponding to the multivariate and heterogeneous data steams is added to the sensor format information table. Full-automatic normalized storage of the multivariate and heterogeneous data is achieved, the statistic analysis processing efficiency of the data is improved, and manpower, time and cost are reduced.

Description

technical field [0001] The embodiments of the present invention relate to the field of data processing, and in particular to a method for automatic storage of multiple heterogeneous data streams based on multiple sensors. Background technique [0002] For engineering projects, the implementation of a certain monitoring often requires many sensors to collect data together, which requires a processor to solve the problems faced by the engineering project based on the data collected by multiple sensors. [0003] Due to the variety of types and models of sensors, the collected monitoring data formats, ranges, and standards are not the same, resulting in the inability to uniformly and automatically identify and process multiple heterogeneous data streams from multiple sensors into the database. It is necessary to generate data for each sensor. Develop a special storage program for processing the data flow. At the same time, due to the influence of the use environment, the stabili...

AI Technical Summary

Problems solved by technology

[0004] However, this data processing method needs to develop a set of programs for each sensor to process the data into the database, so there are disadvantages such as poor scalability, high development costs, professional maintenance, etc., and multiple processing programs run at the same time to compete System resources, which may affect the stability of the entire data acquisition system

Images