Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Streaming type statistical definition and operation method based on configuration file

A technology of configuration files and operation methods, which is applied in the direction of program files, calculations, program control design, etc., can solve the problems of the original system, such as high intrusion, unfavorable user use, and high learning costs, and achieve small intrusion costs, flexible definition, and avoidance The effect of mutual influence

Active Publication Date: 2017-02-15
NARI TECH CO LTD +2
View PDF3 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This design method has high flexibility and wide adaptability, but the price is that adding new statistical tasks requires calling the corresponding interface to complete code editing and compiling, which is more complicated to use and high in learning costs.
For the scheduling automation system, the realization of the streaming statistics function based on the open source streaming computing framework is very intrusive to the original system in terms of deployment, and on the other hand, it is not conducive to the use of users

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Streaming type statistical definition and operation method based on configuration file
  • Streaming type statistical definition and operation method based on configuration file
  • Streaming type statistical definition and operation method based on configuration file

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] In order to make the technical means, creative features, goals and effects achieved by the present invention easy to understand, the present invention will be further described below in conjunction with specific embodiments.

[0035] see figure 1 , the present embodiment is a flow statistics definition and operation method based on a configuration file, comprising the following steps:

[0036] (1) Create a streaming statistics configuration file; the format of the configuration file name is "Test_1.conf".

[0037] In this embodiment, task numbers in configuration file names on the same node cannot be repeated, and task numbers are incremented in natural order.

[0038] (2) Edit task information; define task name, task type and task description.

[0039]In this embodiment, task name and task type are key attributes; task description is an optional attribute.

[0040] (3) Edit calculation model; calculation model includes data source definition, mode definition, statis...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a streaming type statistical definition and operation method based on a configuration file. The method comprises the following steps: creating a configuration file, wherein a content of the configuration file includes task information and a computing model; editing the task information, wherein the task information includes an attribute, a task name, a task type and a task description; editing the computing model, wherein constituent elements required by a computing model descriptive statistical process includes a data source definition, a mode definition, a statistical operation definition and an action definition; verifying the validity of the configuration file; carrying out validity management on the configuration file, wherein all streaming type statistical configuration files are uniformly managed by separate task configuration files and can take effect only being increased to the valid streaming type statistical configuration files in the task configuration file; and operating streaming type statistical tasks, wherein start parameters of a statistical service start time bandwidth include a task number, and in a statistical task execution process, all data are of a JSON format and are accessed via an attribute name. The method disclosed by the invention avoids the code maintenance, can be defined flexibly and is applied to scheduling an automation system.

Description

technical field [0001] The invention relates to a definition and operation method of flow statistics based on a configuration file, and belongs to the technical field of electric power system automation. Background technique [0002] With the development of cloud computing and big data technology, the use of big data technology to obtain potentially useful information from massive data has attracted widespread attention. Log data, as raw big data, is getting more and more attention for its value. In the scheduling automation system, the current log data only stays for the single purpose of post-event fault diagnosis, and its main analysis method still stays at the stage of manual log filtering and retrieval with simple scripts. In order to fully tap the value of the logs in the dispatch automation system, conduct data statistics on the key indicators of the dispatch automation system, and provide a data basis for assessing the health of the system in a quantitative manner, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/44G06F9/445
CPCG06F8/73G06F9/4451
Inventor 季惠英周坚葛敏辉葛朝强季学纯王兴志李昊史浩秋王昌频王玉军张瑞崔伟业卞月峰
Owner NARI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products