Mass data monitoring system

A monitoring system and massive data technology, applied in digital transmission systems, transmission systems, data exchange networks, etc., can solve problems such as the difficulty of massive data collection and monitoring, and achieve faster collection and processing speed, improved data processing speed, and improved The effect of data processing capacity

Active Publication Date: 2015-11-18
XUJI GRP +3
View PDF6 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to provide a massive data monitoring system based on partition cluster technology to realize p

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mass data monitoring system
  • Mass data monitoring system
  • Mass data monitoring system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0024] The mass data monitoring system based on partition cluster technology partitions the mass data sources to be collected, and then uses cluster technology to build a three-level cluster architecture of front-end computer clusters, SCADA clusters, and worker station clusters to achieve parallel collection and monitoring of massive data. Monitor processing.

[0025] Specifically, such as figure 1 As shown, three pre-cluster servers, three SCADA cluster processing servers, two operator stations, and nine data simulation sources for partitioning are used. Here, nine data simulation sources are used instead of real data sources to complete the construction of a massive data monitoring system. Specifically, the nine data simulation sources are divided into three data source partitions according to certain physical and logical meanings, such as figure 1 As shown, data simulation sources 1, 2, and 3 are divided into data source partition A, data simulation sources 4, 5, and 6 ar...

Embodiment 2

[0032] The above-mentioned embodiment provides a kind of implementation mode of massive data monitoring system, as other implementation modes, such as figure 2 As shown, in each node of the SCADA cluster, corresponding to the real-time real-time database, a simulated real-time database is also provided in parallel. At the same time, a control service module for accessing the simulation state real-time library is also provided in the nodes of the SCADA cluster, and a control client for accessing the control service module in the SCADA cluster nodes is provided in each operator workstation. In this way, the advanced application of the upper layer is realized to conduct non-real-time data analysis and research, and make some trend predictions for the system.

Embodiment 3

[0034] The above-mentioned embodiments provide the implementation manners in which the massive data monitoring system collects and processes data in parallel. As other implementation manners, the massive data monitoring system also has a redundant function. like image 3 As shown, in each node of the pre-processing cluster, another pre-processing service module is set in parallel with the original pre-processing service module, and another data processing module is also set in parallel in each node of the SCADA cluster. Processing service module, real-time real-time database, simulation real-time database and control service module. like image 3 As shown, pre-processing service module 1 and pre-processing service module 2 are set in pre-cluster node A, pre-processing service module 1 collects data source partition A, and pre-processing service module 2 collects data source partitions B; pre-processing service module 2 and pre-processing service module 3 are set in pre-clust...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a mass data monitoring system. The mass data monitoring system has multi-level cluster architecture, and comprises a data source partitioned into a plurality of partitions, a front-end processor cluster, an SCADA cluster, an operator workstation and a communication network for connecting the operator workstation with the SCADA cluster, wherein front-end processor cluster nodes are correspondingly built in the front-end processor cluster based on each partition of the data source; SCADA cluster nodes are established correspondingly in the SCADA cluster; and each partition of the data source forms a separate data processing channel together with corresponding front-end processor cluster nodes and SCADA cluster nodes. Through adoption of the mass data monitoring system based on a partition cluster technology, the problem of great difficulty in data acquisition and monitoring due to a large data size in industrial application is solved; distributed parallel acquisition processing of data is realized; the data processing capacity of the data monitoring system is increased; the data processing speed is increased; and the application range of the system is expanded greatly.

Description

technical field [0001] The invention relates to the fields of software engineering and industrial control management, in particular to a massive data monitoring system based on partition cluster technology. Background technique [0002] With the rapid development of computer and information technology, the scale of industrial application systems is rapidly expanding, and the data generated by industrial applications is growing explosively. In the face of industry or enterprise big data that can easily reach hundreds of terabytes or even tens of hundreds of petabytes, the processing capabilities of traditional computer technology and information systems are far from enough. Partitioned cluster technology presents incomparable advantages in the acquisition and processing of massive data. It has the characteristics of good scalability, high availability, load balance and high efficiency of parallel computing, and is very suitable for the processing of massive data. [0003] In...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L12/26H04L29/08
CPCH04L43/04H04L67/10
Inventor 王建章余海溶罗开明康振全张新坡张妮张航
Owner XUJI GRP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap