Data collecting and processing method based on report tool

A technology of data acquisition and processing methods, applied in the fields of electrical digital data processing, natural language data processing, special data processing applications, etc., can solve the problems of time-consuming and labor-intensive, inconsistent understanding of uploading and downloading requirements, and heavy workload of technical support personnel. , to reduce difficulty, improve integration and exchange speed

Inactive Publication Date: 2020-10-20
STATE GRID ANHUI ELECTRIC POWER CO LTD +1
View PDF10 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The data is scattered in the historical databases inside each dedicated system, and presented to the business leaders independently in the form of reports; when the leaders need to comprehensively consider the data from two or more systems, they often cannot Obtain the required comprehensive information through appropriate tools in the data source
Especially when the data sources are scattered in different security areas, it is more difficult to perform unified query statistics
These valuable data are not related to each other, so it is impossible to make a unified and complete description of various components in the power system
[0003] In the actual production process, the dispatching business of provinces, prefectures and counties is mostly contacted through telephone layers. In the process of reporting fault statistics, new high regional loads, distribution of new energy units, and grid-connected capacity, etc., telephone or email contact often occurs. Requires inconsistent understanding, time-consuming and labor-intensive, and lack of historical data preservation and statistical analysis means
When the current scheduling business uses data to query reports, business personnel and technical personnel need to communicate repeatedly, and technical personnel then generate templates to export reports according to specific business processes. In this mode, the workload of technical support personnel is heavy, and the waiting time for business personnel is long. And the format of the generated template is fixed and cannot be extended

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data collecting and processing method based on report tool

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0048] When this embodiment is in use, as shown in the figure, it is a flow chart of extracting data from company A to customize a personalized report. Here, two methods of kettle tool collection and data reporting are used to collect data. Specific steps are as follows:

[0049]1. Install the docker container, kettle tool, mysql image, etc. on the server of Company A, deploy and start the microservice-based springboot system.

[0050] 2. Enter the login URL on the client webpage of company A to log in to the system, such as 10.130.3.166:8006.

[0051] 3. Collect data through the kettle tool, including the following steps:

[0052] 3.1. Create a new label in the data label, such as the total load of the city

[0053] 3.2. Use the kettle tool to obtain the total load data of prefectures and cities. Create a job process to generate a kjb file.

[0054] 3.3. Create a transformation to generate a ktr file, process the collected data, and import the processed data into the mysq...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A data collecting and processing method based on a report tool comprises the following steps: S1, constructing a database; S2, collecting data, and storing actively and passively collected data in a database to form source data, wherein the data collection process comprises active collection and passive collection, the active collection is ETL tool collection, and the passive collection is carriedout through data reporting collection; S3, generating a report: creating a new report, inputting a report rule, and importing the source data in the database into the report according to the report rule to form the report; and S4, reading report. Two groups of data collection systems, namely an active collection system and a passive collection system, are arranged, so data distributed at all levels can be centralized into the database, the problem of information islands at all levels originally is solved, the integration degree and the exchange speed of information are improved, and the difficulty of information exchange at all levels is reduced; and meanwhile, a report engine is arranged, so that custom design of table styles and dynamic generation of table contents are realized.

Description

technical field [0001] The invention relates to the technical field of data collection and processing, in particular to a data collection and processing method based on a reporting tool. Background technique [0002] Most of the professional application systems currently in operation are managed in a vertical chimney style and run independently. There is a lack of data interaction and linkage control between systems, and there are information islands. The data is scattered in the historical databases inside each dedicated system, and presented to the business leaders independently in the form of reports; when the leaders need to comprehensively consider the data from two or more systems, they often cannot The required comprehensive information is obtained from the data source through appropriate tools. Especially when the data sources are scattered in different security areas, it is more difficult to perform unified query statistics. These valuable data are not related to ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/28G06F16/215G06F40/18G06F40/151G06F40/186
CPCG06F16/284G06F16/215G06F40/18G06F40/186G06F40/151
Inventor 谢小艳徐自力杨子张炜刘路登王海港孙飞李杨月汪春燕
Owner STATE GRID ANHUI ELECTRIC POWER CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products