A method of collecting, storing and analyzing power big data based on regular expressions

An analysis method and expression technology, applied in the direction of electrical digital data processing, data processing applications, special data processing applications, etc., to achieve high fault tolerance effect

Active Publication Date: 2018-11-23
CENT CHINA GRID +2
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the current era of big data, the process of processing large-scale data has encountered difficulties

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method of collecting, storing and analyzing power big data based on regular expressions
  • A method of collecting, storing and analyzing power big data based on regular expressions
  • A method of collecting, storing and analyzing power big data based on regular expressions

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058] This example takes the central China power market as the research object, collects relevant data of the central China power market through regular analysis, stores the relevant big data in the server in a multi-level storage method, and uses principal component analysis to analyze data association and power market big data coupling relationship.

[0059] 1. Central China electricity market information collection

[0060] Aiming at the relevant structured, semi-structured and unstructured data of the central China power market, it adopts JAVA design and multi-thread processing. The crawling rules can be carried out according to the breadth-first and depth-first strategies, and the optimal strategy is not considered for the time being. The target is based on the domain name, regardless of IP. The system uniformly maintains a URL list, and all searched URLs are here. After the crawler downloads the webpage, it finds the title, the text content in the main body, multimed...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A method for collecting, storing and analyzing electric power big data based on regular expressions, characterized in that the method includes: (1) big data collection of electric power information; (2) multi-level storage technology; (3) big data of electric power market Principal component analysis method; the principal component analysis method of big data in the electricity market adopts the multiple regression method based on principal component analysis to establish an information model of electricity sales transactions. In order to realize the data value-added service of power trading business, research methods and technologies for mining the value of big data in the power market, extract big data of trading business in power trading centers, analyze typical application scenarios, and use data integration management, data storage, data calculation, analysis and mining and other technologies to achieve model innovation and application improvement for typical business scenarios.

Description

technical field [0001] The invention belongs to the field of power information big data information mining and analysis. It involves an analysis method of multi-level stored power information big data, and solves the problem of power information big data analysis. Background technique [0002] With the continuous expansion of the scale and scope of database applications, power management departments and related enterprises use computers to enhance their ability to manage affairs, resulting in huge large-scale data sets. It is very complicated to collect and store such a large data set on the server. of. Originally, many data collection algorithms can achieve good collection results when the data set is small in size, but for large-scale data sets, the amount of calculation is too large to obtain good results within an acceptable time. [0003] In the past industrial production and commercial service fields, traditional data mining analysis algorithms can handle small-scale...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30G06Q50/06
Inventor 杨建华白顺明肖达强魏庆海代勇刘定宜高春成樊爱军方印陶力史述红王蕾李守保王清波丁鹏袁明珠任东明刘杰赵显谭翔汪涛袁晓鹏张雪
Owner CENT CHINA GRID
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products