Method and device for processing massive real-time generated data of thermal power plant

A processing method, technology of thermal power plants, applied in the direction of electric digital data processing, special data processing applications, digital data information retrieval, etc., can solve problems such as large amount of data, inability to write SQL statements, immature time series data storage scheme, etc.

Pending Publication Date: 2020-02-07
HUADIAN LAIZHOU POWER GENERATION +1
View PDF5 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When querying data, there may be a large amount of data and real-time changes that make it impossible to write effective SQL statements for querying, or the speed of SQL statements is too slow during query execution
Although the NoSQL database storage solution that has emerged in recent years h...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for processing massive real-time generated data of thermal power plant
  • Method and device for processing massive real-time generated data of thermal power plant
  • Method and device for processing massive real-time generated data of thermal power plant

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0039] Such as Figure 1-6 as shown, figure 1 A method for storing time series data based on a key-value data model according to an embodiment of the present invention is oriented towards real-time storage of mass production data of large-scale industrial equipment in thermal power plants. The method includes:

[0040]Step S1: Obtain the original time series data collected by the sensor. In the field of industrial production such as thermal power, a raw time series data record usually contains five fields: equipment number, sensor number, sampling time, receiving time and measurement value. Among them, the equipment number and sensor number are generally of the string type; the sampling time and the receiving time are generally of the time type; the data type of the measured value varies according to the different measurement objects of the sensor, generally speaking, there are integer type, floating point type, character type Various data types such as string type and Boole...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the field of power plant operation data processing, and particularly relates to a method and device for processing mass real-time generated data of a thermal power plant. On the basis of modeling and storing massive time series data generated in the production process of a thermal power plant based on a key value data model, the time series data is sliced according to timedimensions and stored in an HBase, and meanwhile, a SparkSQL execution process is fused to inquire the massive time series data. The Spark SQL is a module of the spark for processing the structured data, and provides a programming abstraction called DataFrame and used as a distributed SQL query engine. Data query is converted into Spark RDD, then the Spark RDD is submitted to a cluster to be executed, and extremely high data query efficiency is achieved.

Description

technical field [0001] The invention belongs to the field of power plant operation data processing, and in particular relates to a processing method and device for massive real-time generated data of thermal power plants. Background technique [0002] Time series data is data collected at different times, this type of data is collected in chronological order for situations where the described phenomenon changes over time. This type of data reflects the state or degree of a certain thing, phenomenon, etc. over time. In industrial production fields such as thermal power generation, by installing sensors in industrial equipment and production environments, sensors will collect a large amount of time-series data. Thermal power plants usually have a lot of equipment, and the sensors that collect equipment status information are large in scale. Therefore, the time series data collected during the production process generally have the characteristics of fast collection frequency a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/242G06F16/2458
CPCG06F16/2433G06F16/2471G06F16/2474
Inventor 白帆蒋蓬勃李友志王继强苏涛卢意苏京彬宋峰
Owner HUADIAN LAIZHOU POWER GENERATION
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap