Multiple source data conversion service method and apparatus thereof

Abstract

The invention relates to a service method and a service device for converting multi-source data. The device comprises a data source interface module, a data importing module, a data cleaning module, a data converting module, a consolidated data structure module, a consolidated storage type module, a consolidated exporting interface module and a flexible export setting module. The service method and the service device for converting the multi-source data have the following advantages: 1) an independent device is specially responsible for operations, such as data exchange of various advanced application systems and various basic service systems in a power dispatching center, thereby improving efficiency of data conversion, and ensuring correctness and timeliness of the data conversion; 2) each advanced application system only needs to acquire data from a data conversion service device, thereby saving complicated workload of data conversion, and saving development cost and maintenance cost; and 3) the advanced application system is separated from data conversion, thereby saving hardware resource, and improving operating efficiency and operating stability of the application system.

Description

technical field [0001] The present invention relates to a data exchange technology between advanced application systems (such as decision support, data mining, report statistics, etc.) The invention relates to a multi-source data conversion service method and device for improving data conversion efficiency, reducing development and maintenance costs of advanced application systems, and saving hardware and network resources in the information management of electric power, telecommunications, finance, aviation, retail and other industry systems. Background technique [0002] At present, the dispatching communication center of the power system has established basic business systems represented by the energy management system EMS (Energy Management System), the dispatching information management system DMIS (Dispatching Management Information System), and the power market operation system. In addition to these basic business systems, in order to meet specific work needs, each de...

AI Technical Summary

Problems solved by technology

This situation has caused difficulties for the data integration work of advanced application systems, such as:

[0004] 1) The data formats among multiple data sources are not uniform, which increases the difficulty of developing advanced application systems;

[0005] 2) Advanced application system servers need to be configured with data drivers suitable for different database types, occupying system resources and increasing the system burden;

[0006] 3) The data import work of the application program occupies system resources and affects the operating efficiency of the system;

[0007] 4) In multiple data sources, there are data omissions and bad data problems to varying degrees, which reduces the running stability of advanced applications

The installation of the driver itself will occupy the resources of the system server, and the running and version conflict of the driver will reduce the running stability of the advanced application.

[0011] 2) Each advanced application needs to collect and understand the database structure, data table format, and even the meaning of each original parameter of each business system during development, so as to understand the business database and export the required data, adding advanced applications development effort of

[0012] 3) Every advanced application needs to clean up and convert the bad data of each business data. Bad data often appears under very special conditions. In practice, advanced application systems often do not have enough budget and energy to specialize in each business Conduct special research on the bad data of the system and establish countermeasures, so it is difficult to avoid being affected by bad data and reduce the stability of the system operation

Different advanced applications all complete the same type of work one after another. These repetitive tasks are not simple. If you do not invest enough cost, you cannot guarantee the quality, and the cost will cause waste of resources.

[0016] 2) Waste of resources and operational efficiency issues

The operation of advanced application systems is bound to be affected by data integration work and reduce efficiency

If another server is additionally configured, it will cause a large waste of resources

[0018] 3) Increase in maintenance costs

From another point of view, if an advanced application system uses the data of five basic business systems, if any of the five business systems is updated, the advanced application system will have to be modified accordingly, and frequent system upgrades , will affect the normal and continuous operation of advanced application systems, and will also increase maintenance costs

Images