Multi-source data fusion power grid data processing system

Abstract

The invention provides a power grid data processing system based on multi-source data fusion. The system comprises a service system; the central processing module is connected with each service system through the data transmission module, and the central processing module is used for realizing data calling among different service systems; and the data transmission modules are respectively arranged between the business systems and the central processing module, and the data transmission modules are used for realizing data transmission between the business systems. According to the application, the central processing module calls the corresponding data transmission module based on the calling requirements of the service systems to execute data interaction and data calling between the service systems, so that efficient integration and unified scheduling of data are realized, and the problem of inflexible data processing in the data processing process of multivariate data fusion in the prior art is solved.

Description

Technical Field

[0001] The present invention relates to the technical field of data fusion, and in particular to a power grid data processing system for multi-source data fusion. Background Art

[0002] In the power grid industry, efficient management and integrated processing of data are the key to ensuring stable operation of the power grid and optimizing resource allocation. Existing power grid data management systems usually face the following technical deficiencies:

[0003] There is a strong correlation and coupling between the business systems of the power grid, but the business data is often isolated. Different business systems are responsible for different functions. Each system has its own database and data management system, which collects and stores data independently. Although these systems may be interdependent in terms of function, their data cannot be directly shared or accessed by each other due to technical and management limitations. There is data isolation, resulting in low efficiency in data integration and analysis.

[0004] Due to the inconsistent data update frequency and data format of different business systems, information conflicts and inconsistencies occur during data fusion, making it difficult to ensure the accuracy and reliability of data. Data fusion is difficult. When merging data from different business systems, existing technologies lack an automated mechanism to identify and unify the diverse data formats and standards generated by different business systems, making it difficult to achieve effective data integration. As a result, the data integration process sometimes needs to rely on manual processing intervention, which is not only time-consuming but also prone to errors.

[0005] Most existing data fusion systems lack intelligent processing capabilities and are unable to automatically adjust data fusion strategies according to business needs, resulting in inflexible and inintelligent data processing. Summary of the invention

[0006] The main purpose of the present application is to provide a power grid data processing system for multi-source data fusion, so as to at least solve the problem of inflexible data processing in the data processing process of multi-source data fusion in the prior art.

[0007] In order to achieve the above-mentioned purpose, according to one aspect of the present application, a power grid data processing system with multi-source data fusion is provided, wherein the system comprises: a business system; a central processing module, which is connected to each of the business systems via a data transmission module, and the central processing module is used to realize data retrieval between different business systems; the data transmission modules are respectively arranged between each of the business systems and the central processing module, and the data transmission modules are used to realize data transmission between business systems.

[0008] Optionally, the business system includes: a business module for implementing the business processing function of the business system; a data layer mapping module connected to the business module, the data layer mapping module is used to convert the surface data directly called by each business module in the business system into interactive layer data suitable for multi-source data fusion, and store the first mapping relationship in the data conversion process; a data acquisition module installed in each business system, connected to the business module and connected to the central processing module through the data transmission module, the data acquisition module is used to send a data acquisition request to the central processing module when the business module has the need to call data from other business systems; an interactive data storage module is connected to the data layer mapping module, and is used to receive and store the interactive layer data; a data request reading module is installed in each business system, connected to the interactive data storage module and connected to the central processing module through the data transmission module, the data request reading module is used to, when receiving the data acquisition request of the central processing module, capture the interactive layer data from the interactive data storage module according to the data acquisition request.

[0009] Optionally, the business system also includes: a reverse conversion module connected to the interactive data storage module and the business module, the reverse conversion module is used to convert the interactive layer data into the surface data when the interactive layer data of other business systems is stored in the interactive data storage module; a data fusion module connected to the reverse conversion module and the business module, the data fusion module is used to integrate the surface data from other business systems according to the request of the business module to generate data directly used by the business module; a historical data storage module is connected to the business module, and the historical data storage module backs up the data of the business module.

[0010] Optionally, the data layer mapping module is also used to reallocate numbers to various types of surface data based on the system internal numbers of various types of surface data within each of the business systems, obtain the system universal numbers of the corresponding interaction layer data, obtain the data format and data structure of the interaction layer data, construct multiple mapping rules between the surface data and the interaction layer data based on the data format and data structure of the interaction layer data, map the surface data to the interaction layer data according to the mapping rules, and construct a data dictionary according to the correspondence between the system internal numbers and the system universal numbers, wherein the system internal numbers and the system universal numbers are both data numbers, and the system universal number includes at least the system number of the business system that is the data source of the surface data.

[0011] Optionally, the data transmission module is also used to configure the data transmission protocol between each of the business systems to ensure the security and integrity of data transmission between different business systems, configure the data transmission channel based on the data transmission protocol, monitor the transmission status of the data transmission channel in real time and generate corresponding transmission logs, wherein the data transmission module and the business system include multiple parallel data transmission channels.

[0012] Optionally, the interactive layer data storage module is also used to configure the life cycle of the interactive layer data when the interactive layer data is stored in the interactive layer data storage module, traverse the storage time of the interactive layer data at intervals of a preset time, and delete the interactive layer data when the storage time is greater than the life cycle. When the interactive layer data is deleted, the interactive layer data is sent to the historical data storage module via the business module.

[0013] Optionally, the data acquisition module is also connected to the data layer mapping module, and is also used to receive a first data acquisition request sent by the business module, read the data dictionary stored in the data layer mapping module, determine the corresponding system universal number according to the system internal number, generate a second data acquisition request according to the system universal number, and send the second data acquisition request to the central processing module, wherein the first data acquisition request includes at least the system internal number of the target data, and the second data acquisition request includes at least the system universal number.

[0014] Optionally, the data request reading module is also used to read the interactive data storage module according to the system universal number to locate target data, perform data encapsulation and security verification on the target data, and transmit the target data to the central processing module via the data transmission module when receiving the second data acquisition request sent by the central processing module.

[0015] Optionally, the reverse conversion module is also connected to the data layer mapping module, and the reverse conversion module is also used to, upon receiving a data conversion request from the business module, read the data dictionary in the data layer mapping module according to the data conversion request to obtain the system universal number corresponding to the target data, read the interactive layer data storage module based on the system universal number to capture the target data, read the data layer mapping module according to the system universal number and the system internal number to determine the target mapping rule, reverse-convert the target data based on the target mapping rule to obtain the surface data corresponding to the target data, wherein the data conversion request includes at least the system internal number of the required data.

[0016] Optionally, the data fusion module is also used to, upon receiving a data fusion request from the business module, read the corresponding surface data from the reverse conversion module, pre-process the surface data, and fuse the surface data based on a preset fusion algorithm to obtain fused data directly used by the business module, wherein the data fusion request includes at least the system internal number and the data specification of the fused data, and the preprocessing includes at least data cleaning, standardization and integrity verification.

[0017] Applying the technical solution of the present application, the present application provides a multi-source data fusion power grid data processing system, the system comprising: a business system; a central processing module, connected to each of the business systems through a data transmission module, the central processing module is used to realize data retrieval between different business systems; the data transmission module is respectively arranged between each of the business systems and the central processing module, the data transmission module is used to realize data transmission between business systems. The present application calls the corresponding data transmission module based on the calling requirements of the business system through the central processing module to execute data interaction and data retrieval between business systems, realizes efficient integration and unified scheduling of data, and solves the problem of inflexible data processing in the data processing process of multi-data fusion in the prior art. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 A structural block diagram of a power grid data processing system for multi-source data fusion provided according to an embodiment of the present application is shown.

[0019] Figure 2 A structural block diagram of a power grid data processing system for multi-source data fusion provided according to an embodiment of the present application is shown.

[0020] The above drawings include the following reference numerals:

[0021] 1. Data transmission module; 2. Data layer mapping module; 3. Interactive data storage module; 4. Central processing module; 5. Data acquisition module; 6. Business module; 7. Data request reading module; 8. Reverse conversion module; 9. Data fusion module; 10. Historical data storage module. DETAILED DESCRIPTION

[0022] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0023] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.

[0024] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present application described here. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0025] As introduced in the background technology, the existing technology lacks intelligent processing capabilities and is unable to automatically adjust data fusion strategies according to business needs, resulting in inflexible and inintelligent data processing. In order to solve the problem of inflexible data processing in the data processing process of multi-source data fusion, an embodiment of the present application provides a power grid data processing system with multi-source data fusion.

[0026] The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the accompanying drawings in the embodiments of the present invention.

[0027] like Figure 1-2 As shown, according to an embodiment of the present application, a power grid data processing system for multi-source data fusion is provided. The system aims to realize centralized processing and fusion of data from different sources by integrating multiple business systems, thereby improving the efficiency and accuracy of power grid management. The system includes:

[0028] Business systems;

[0029] Specifically, business systems refer to various subsystems running in power grid management, such as distribution management system, energy management system, fault detection system, etc. These systems are responsible for different aspects of power grid management, generating and processing a large amount of structured and unstructured data.

[0030] The central processing module 4 is connected to each business system through the data transmission module 1, and the central processing module 4 is used to realize data retrieval between different business systems;

[0031] Specifically, the central processing module 4 is the core of the entire system and is responsible for unified management, retrieval and processing of data from various business systems.

[0032] The data transmission module 1 is respectively arranged between each business system and the central processing module 4 , and the data transmission module 1 is used to realize data transmission between business systems.

[0033] Specifically, the data transmission module 1 is set as a bridge between each business system and the central processing module 4, responsible for realizing reliable data transmission and ensuring the standardization and security of data transmission between different business systems. During the transmission process, the data is temporarily stored and preliminarily processed to reduce the burden of the central processing module 4 and improve the transmission efficiency, and errors or interruptions that may occur during the data transmission process are handled to ensure the final integrity and accuracy of the data transmission.

[0034] It can be seen that the present application provides a multi-source data fusion power grid data processing system, the system includes: a business system; a central processing module 4, which is connected to each business system through a data transmission module 1, and the central processing module 4 is used to realize data retrieval between different business systems; a data transmission module 1, which is respectively arranged between each business system and the central processing module 4, and the data transmission module 1 is used to realize data transmission between business systems. The present application calls the corresponding data transmission module 1 based on the calling requirements of the business system through the central processing module 4 to perform data interaction and data retrieval between business systems, realizes efficient data integration and unified scheduling, and solves the problem of inflexible data processing in the data processing process of multi-data fusion in the prior art.

[0035] As a possible implementation method, the business system of this system contains multiple modules, each of which has different functions to meet the needs of business processing and data interaction. The business system includes:

[0036] Business module 6, used to implement the business processing function of the business system;

[0037] Specifically, the business module 6 implements specific business processing functions, such as power dispatching, user management, equipment monitoring, etc. These modules are independent of each other, responsible for specific power grid management functions, and generate relevant business data.

[0038] The data layer mapping module 2 is connected to the business module 6. The data layer mapping module 2 is used to convert the surface layer data directly called by each business module 6 in the business system into the interactive layer data suitable for multi-source data fusion, and store the first mapping relationship in the data conversion process;

[0039] Specifically, the data layer mapping module 2 maps and converts the surface data generated by the business module 6 to form standardized interactive layer data that can be shared among different systems. During the data conversion process, the first mapping relationship is recorded for subsequent data tracing and management.

[0040] The data acquisition module 5 is installed inside each business system, connected to the business module 6 and connected to the central processing module 4 through the data transmission module 1. The data acquisition module 5 is used to send a data acquisition request to the central processing module 4 when the business module 6 needs to call data from other business systems;

[0041] Specifically, when the business module 6 needs to access data from other business systems, the data acquisition module 5 sends a data acquisition request to the central processing module 4, coordinates and processes data requests between different modules to ensure the timeliness and accuracy of data acquisition.

[0042] An interactive data storage module 3, connected to the data layer mapping module 2, is used to receive and store interactive layer data;

[0043] Specifically, the interactive data storage module 3 receives and stores the interactive layer data processed by the data layer mapping module 2 to facilitate subsequent access and sharing, and provides an efficient data structure to support fast data retrieval and access.

[0044] The data request reading module 7 is installed inside each business system, connected to the interactive data storage module 3 and connected to the central processing module 4 through the data transmission module 1. The data request reading module 7 is used to capture the interactive layer data from the interactive data storage module 3 according to the data acquisition request when receiving the data acquisition request from the central processing module 4.

[0045] Specifically, when the data request reading module 7 receives the data acquisition request from the central processing module 4, it is responsible for grabbing the required data from the interactive data storage module 3 and sending the grabbed data back to the central processing module 4 through the data transmission module 1 for further processing or analysis.

[0046] It can be seen that through the independence and flexibility of different modules, the system can quickly adapt and adjust to various business needs. The cooperation between the interactive data storage module 3 and the data request reading module 7 makes the management, access and retrieval of data more efficient. The business system can quickly respond to requests from the central processing module 4, support real-time data acquisition and decision-making processes, and improve the flexibility and adaptability of power grid management. This multi-source data fusion power grid data processing system can effectively integrate, process and share power data from different sources, and improve the overall management level and efficiency of the power grid.

[0047] As a possible implementation method, in order to further improve system functions and data processing capabilities, this business system also includes the following modules:

[0048] A reverse conversion module 8, connected to the interactive data storage module 3 and the business module 6, and used for converting the interactive layer data into surface layer data when the interactive layer data of other business systems are stored in the interactive data storage module 3;

[0049] Specifically, when the interaction layer data of other business systems are stored in the interaction data storage module 3, the reverse conversion module 8 converts these data into surface layer data that can be directly used by the local business module 6. Ensure real-time update and synchronization of data so that the business module 6 can obtain the latest data in a timely manner.

[0050] The data fusion module 9 is connected to the reverse conversion module 8 and the business module 6. The data fusion module 9 is used to integrate and process the surface data from other business systems according to the request of the business module 6 to generate data directly used by the business module 6;

[0051] Specifically, the data fusion module 9 integrates and processes the surface data from different sources according to the request of the business module 6 to form a single, unified usable data set, which can quickly respond to the needs of the business module 6 and ensure that the integrated data can be immediately used by the business module 6.

[0052] The historical data storage module 10 is connected to the business module 6 , and the historical data storage module 10 backs up the data of the business module 6 .

[0053] Specifically, the historical data storage module 10 performs regular or real-time backup of the data generated by the business module 6 to ensure the long-term preservation and security of the data, and can quickly restore the historical data when necessary to support data analysis, auditing and fault recovery.

[0054] In summary, the reverse conversion module 8 ensures that data from other business systems can be seamlessly converted and directly used by the local business module 6, thereby improving data availability. The addition of the data fusion module 9 enables the system to more efficiently integrate multi-source data, generate a unified usable data set, and improve data processing efficiency. The introduction of the historical data storage module 10 ensures the backup and recovery of business data, and improves the stability of the system and data integrity.

[0055] It can be seen that by adding the reverse conversion module 8, the data fusion module 9 and the historical data storage module 10, the business system has been significantly improved in terms of data processing capability, data availability and data security. This not only meets the diversified needs of the business, but also provides a solid technical foundation for the intelligent management and efficient operation of the power grid.

[0056] As a possible implementation, in order to enhance the functionality and flexibility of the data layer mapping module 2, the module will have the following functions to achieve efficient mapping between surface layer data and interaction layer data.

[0057] The data layer mapping module 2 is also used to re-assign numbers to various types of surface layer data based on the system internal numbers of various types of surface layer data within each business system to obtain the corresponding system universal numbers of the interactive layer data;

[0058] Specifically, each business system assigns a unique identity to its surface data and remaps the system's internal numbers to form a unified numbering system to facilitate data sharing and identification at the interaction layer.

[0059] The data layer mapping module 2 is also used to obtain the data format and data structure of the interactive layer data, and to construct multiple mapping rules between the surface layer data and the interactive layer data based on the data format and data structure of the interactive layer data;

[0060] Specifically, by defining the conversion relationship and processing rules between different data types and formats, the correct mapping of data can be ensured. Define the conversion relationship and processing rules between different data types and formats, the correct mapping of data can be ensured.

[0061] The data layer mapping module 2 is also used to map the surface data into the interactive layer data according to the mapping rules, and to construct a data dictionary according to the correspondence between the system internal number and the system universal number, wherein the system internal number and the system universal number are both data numbers, and the system universal number includes at least the system number of the business system of the data source of the surface data.

[0062] Specifically, through the mapping rules constructed above, the surface data is converted into data that meets the standards of the interaction layer. The correspondence between the system internal number and the system universal number is constructed to form a data dictionary to facilitate data management and query. This dictionary at least includes the system number of the business system to which the surface data belongs, so that the system universal number corresponds one-to-one with the specific business source.

[0063] It can be seen that the extended function of the data layer mapping module 2 greatly improves the data management and processing capabilities of the entire power grid data processing system, ensuring efficient connection and application between surface data from different sources and interactive layer data.

[0064] As a possible implementation, in order to ensure efficient, safe and reliable data transmission between various business systems in the power grid data processing system, the function expansion of the data transmission module 1 is implemented as follows:

[0065] The data transmission module 1 is also used to configure the data transmission protocol between each business system to ensure the security and integrity of data transmission between different business systems, configure the data transmission channel based on the data transmission protocol, monitor the transmission status of the data transmission channel in real time and generate corresponding transmission logs, wherein the data transmission module 1 and the business system include multiple parallel data transmission channels.

[0066] Specifically, the data transmission module 1 supports a variety of data transmission protocols, such as HTTP / HTTPS, FTP / SFTP, MQTT, etc., and selects a suitable protocol for configuration according to the needs and characteristics of the business system. The security of the data transmission process is guaranteed by using encryption technology (such as TLS / SSL) to prevent data from being tampered with or stolen during the transmission process. A dedicated channel is defined for data transmission between each business system to ensure data transmission efficiency and reduce the risk of mutual interference. Through the transmission monitoring tool, the real-time status of each data channel is obtained, such as bandwidth utilization, delay, packet loss rate, etc. The detailed information of each data transmission is recorded, including timestamp, transmission status, transmission volume, transmission protocol, error information, etc. The generated log is stored in a specified location, and the log is supported for query, analysis and export to help track the data transmission process and solve potential problems. Parallel processing allows multiple data transmissions to be performed simultaneously, improving the overall data transmission efficiency and reducing transmission bottlenecks.

[0067] In summary, by configuring data transmission protocols and encryption measures, the security of the data transmission process is guaranteed, and information leakage and tampering are effectively prevented. The configuration of parallel channels can significantly increase the data transmission speed and meet the high requirements of the power grid system for real-time data transmission. The real-time monitoring and logging functions provide an important basis for the audit and fault analysis of data transmission, and improve the transparency and tracking ability of system management. By expanding the functions of the data transmission module 1, the power grid data processing system can achieve efficient and secure data transmission and meet the needs of complex data exchange.

[0068] As a possible implementation, in order to enhance the flexibility and efficiency of managing interactive layer data, the interactive data storage module 3 will have the following functions:

[0069] The interactive layer data storage module 3 is also used to configure the life cycle of the interactive layer data when the interactive layer data is stored in the interactive layer data storage module, to traverse the storage time of the interactive layer data at intervals of a preset time, and to delete the interactive layer data when the storage time is greater than the life cycle. When the interactive layer data is deleted, the interactive layer data is sent to the historical data storage module 10 via the business module 6.

[0070] Specifically, the validity period of each interactive layer data is set according to the nature of the data and business needs. For example, some temporary data may only need to be saved for a few hours, while important business data may need to be saved for several days or longer. Administrators are allowed to configure different life cycles for different interactive layer data according to specific business scenarios. By setting life cycles and regular data traversal, temporary data that is no longer needed is ensured to be deleted in a timely manner, freeing up valuable storage resources.

[0071] It can be seen that the functional expansion of the interactive data storage module 3 makes the entire power grid data processing system more efficient and flexible in data life cycle management. Through the setting of the life cycle and the automated cleaning and transfer mechanism, it provides powerful data optimization capabilities for system operation and management, ensuring the efficiency and effectiveness of data storage.

[0072] As a possible implementation, in order to improve the efficiency and flexibility of the data acquisition process, the data acquisition module 5 will have the following functions:

[0073] The data acquisition module 5 is also connected to the data layer mapping module 2. The data acquisition module 5 is also used to receive a first data acquisition request sent by the business module 6, read the data dictionary stored in the data layer mapping module 2, determine the corresponding system universal number according to the system internal number, generate a second data acquisition request according to the system universal number, and send the second data acquisition request to the central processing module 4, wherein the first data acquisition request at least includes the system internal number of the target data, and the second data acquisition request at least includes the system universal number.

[0074] Specifically, the first data acquisition request sent by the business module 6 is parsed to extract key information such as the system internal number of the target data. The format of the first data acquisition request needs to be standardized so that different business modules 6 can send requests consistently. According to the system internal number in the first data acquisition request, the corresponding system universal number is queried. The data dictionary structure needs to have good scalability and be able to accommodate the mapping relationship between different system internal numbers and system universal numbers. The second data acquisition request containing the system universal number should comply with the data acquisition specification of the central processing module 4 to ensure the correctness of the request format. If necessary, other contextual information can be attached to the second data acquisition request so that the central processing module 4 can understand the request background.

[0075] As a possible implementation, in order to ensure that the data request reading module 7 can efficiently and safely obtain the target data from the storage and transmit it to the central processing module 4, the module will have the following functional extensions:

[0076] The data request reading module 7 is also used to read the interactive data storage module 3 according to the system universal number to locate the target data, perform data encapsulation and security verification on the target data, and transmit the target data to the central processing module 4 via the data transmission module 1 when receiving the second data acquisition request sent by the central processing module 4.

[0077] Specifically, the second data acquisition request is parsed to extract key information such as the system universal number to ensure the validity of the request. Before processing the request, the legitimacy of the request source is verified to ensure that only the authorized central processing module 4 can initiate the request. A quick query is performed in the interactive data storage module 3 through the system universal number to locate the corresponding interactive layer data. The functional expansion of the data request reading module 7 enables the power grid data processing system to efficiently and securely obtain the target data from the interactive data storage module 3 and transmit it to the central processing module 4.

[0078] As a possible implementation, in order to ensure that the reverse conversion module 8 can efficiently and accurately convert the underlying interaction data into the surface data required by the upper-layer business, the module will have the following functional extensions:

[0079] The reverse conversion module 8 is also connected to the data layer mapping module 2. The reverse conversion module 8 is also used to, when receiving a data conversion request from the business module 6, read the data dictionary in the data layer mapping module 2 according to the data conversion request, obtain the system universal number corresponding to the target data, read the interactive layer data storage module based on the system universal number to capture the target data, read the data layer mapping module 2 according to the system universal number and the system internal number to determine the target mapping rule, reverse transform the target data based on the target mapping rule, and obtain the surface data corresponding to the target data, wherein the data conversion request at least includes the system internal number of the required data.

[0080] It can be seen that the target data can be quickly located and converted through the mapping relationship between the system internal number and the system universal number. Through precise mapping rules and reverse conversion algorithms, it can be ensured that the underlying data is accurately converted into the format required by the upper-level business. The functional expansion of the reverse conversion module 8 enables the power grid data processing system to efficiently reverse the underlying interactive data into the surface data required by the upper-level business. This mechanism not only improves the efficiency of data processing, but also ensures the accuracy and security of data conversion. Through standardized mapping rules and reverse conversion algorithms, the system can flexibly respond to the data conversion requirements of different business modules 6, providing strong support for the intelligent operation of the power grid system.

[0081] As a possible implementation, in order to ensure that the data fusion module 9 can efficiently and accurately process the request from the business module 6 and fuse multiple surface data into final output data, the module will have the following functional extensions:

[0082] The data fusion module 9 is also used to read the corresponding surface data from the reverse conversion module 8 upon receiving a data fusion request from the business module 6, pre-process the surface data, and fuse the surface data according to the data specifications based on a preset fusion algorithm to obtain the fused data directly used by the business module 6, wherein the data fusion request includes at least the system internal number and the data specifications of the fused data, and the preprocessing includes at least data cleaning, standardization and integrity verification.

[0083] It can be seen that by reading and fusing surface data, the efficiency and accuracy of data integration can be improved. Through the preprocessing stage, data quality is ensured to reduce problems in subsequent analysis. The security of data during the fusion process is guaranteed through compliant request verification and secure data transmission mechanisms. The functional expansion of the data fusion module 9 enables the power grid data processing system to efficiently fuse surface data from multiple sources into data that can be directly used by the business module 6. This mechanism not only improves the efficiency of data processing, but also ensures data quality and security. Through the application of preprocessing and fusion algorithms and specification adaptation, the flexibility of the system is enhanced, providing strong data support for the intelligent decision-making of the power grid system.

[0084] Obviously, it should be understood by those skilled in the art that the modules of the present invention described above can be implemented by a general-purpose computing device, they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be executed in a different order than that here, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. Thus, the present invention is not limited to any specific combination of hardware and software.

[0085] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0086] From the above description, it can be seen that the above embodiments of the present application achieve the following technical effects:

[0087] The multi-source data fusion power grid data processing system of the present application includes: a business system; a central processing module 4, which is connected to each business system through a data transmission module 1, and the central processing module 4 is used to realize data retrieval between different business systems; a data transmission module 1, which is respectively arranged between each business system and the central processing module 4, and the data transmission module 1 is used to realize data transmission between business systems. The present application calls the corresponding data transmission module 1 based on the calling requirements of the business system through the central processing module 4 to perform data interaction and data retrieval between business systems, realizes efficient data integration and unified scheduling, and solves the problem of inflexible data processing in the data processing process of multi-data fusion in the prior art.

[0088] The above are only preferred embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A multi-source data fusion power grid data processing system, characterized in that: The system comprises: Business systems; A central processing module, connected to each of the business systems via the data transmission module, and used to retrieve data between different business systems; The data transmission modules are respectively arranged between each of the business systems and the central processing module, and are used to realize data transmission between business systems.

2. The system according to claim 1, characterized in that The business system comprises: A business module, used to implement the business processing function of the business system; A data layer mapping module, connected to the business module, for converting the surface layer data directly called by each business module in the business system into interactive layer data suitable for multi-source data fusion, and storing the first mapping relationship in the data conversion process; A data acquisition module installed in each of the business systems, connected to the business module and connected to the central processing module through the data transmission module, and configured to send a data acquisition request to the central processing module when the business module needs to call data from other business systems; An interactive data storage module, connected to the data layer mapping module, for receiving and storing the interactive layer data; A data request reading module is installed inside each of the business systems, connected to the interactive data storage module and connected to the central processing module through the data transmission module. The data request reading module is used to capture the interactive layer data from the interactive data storage module according to the data acquisition request when receiving a data acquisition request from the central processing module.

3. The system according to claim 2, characterized in that The business system further includes: A reverse conversion module connected to the interactive data storage module and the business module, the reverse conversion module is used to convert the interactive layer data into the surface layer data when the interactive layer data of other business systems are stored in the interactive data storage module; A data fusion module connected to the reverse conversion module and the business module, the data fusion module is used to integrate the surface data from other business systems according to the request of the business module to generate data directly used by the business module; The historical data storage module is connected to the business module, and the historical data storage module backs up the data of the business module.

4. The system according to claim 3, characterized in that The data layer mapping module is also used to reallocate numbers to various types of surface data based on the system internal numbers of various types of surface data within each of the business systems, obtain the corresponding system universal numbers of the interactive layer data, obtain the data format and data structure of the interactive layer data, construct multiple mapping rules between the surface data and the interactive layer data based on the data format and data structure of the interactive layer data, map the surface data to the interactive layer data according to the mapping rules, and construct a data dictionary according to the correspondence between the system internal numbers and the system universal numbers, wherein the system internal numbers and the system universal numbers are both data numbers, and the system universal number at least includes the system number of the business system that is the data source of the surface data.

5. The system according to claim 1, characterized in that The data transmission module is also used to configure the data transmission protocol between each of the business systems to ensure the security and integrity of data transmission between different business systems, configure the data transmission channel based on the data transmission protocol, monitor the transmission status of the data transmission channel in real time and generate corresponding transmission logs, wherein the data transmission module and the business system include multiple parallel data transmission channels.

6. The system according to claim 3, characterized in that The interactive layer data storage module is also used to configure the life cycle of the interactive layer data when the interactive layer data is stored in the interactive layer data storage module, traverse the storage time of the interactive layer data at intervals of a preset time, delete the interactive layer data when the storage time is greater than the life cycle, and when the interactive layer data is deleted, send the interactive layer data to the historical data storage module via the business module.

7. The system according to claim 4, characterized in that The data acquisition module is also connected to the data layer mapping module, and is also used to receive a first data acquisition request sent by the business module, read the data dictionary stored in the data layer mapping module, determine the corresponding system universal number according to the system internal number, generate a second data acquisition request according to the system universal number, and send the second data acquisition request to the central processing module, wherein the first data acquisition request includes at least the system internal number of the target data, and the second data acquisition request includes at least the system universal number.

8. The system according to claim 7, characterized in that The data request reading module is also used to read the interactive data storage module according to the system universal number to locate the target data, perform data encapsulation and security verification on the target data, and transmit the target data to the central processing module via the data transmission module when receiving the second data acquisition request sent by the central processing module.

9. The system according to claim 4, characterized in that The reverse conversion module is also connected to the data layer mapping module. The reverse conversion module is also used to, when receiving a data conversion request from the business module, read the data dictionary in the data layer mapping module according to the data conversion request to obtain the system universal number corresponding to the target data, read the interactive layer data storage module based on the system universal number to capture the target data, read the data layer mapping module according to the system universal number and the system internal number to determine the target mapping rule, reverse-convert the target data based on the target mapping rule to obtain the surface data corresponding to the target data, wherein the data conversion request at least includes the system internal number of the required data.

10. The system according to claim 4, characterized in that The data fusion module is also used to, upon receiving a data fusion request from the business module, read the corresponding surface data from the reverse conversion module, pre-process the surface data, and fuse the surface data based on a preset fusion algorithm to obtain fused data directly used by the business module, wherein the data fusion request includes at least the system internal number and the data specification of the fused data, and the pre-processing includes at least data cleaning, standardization and integrity verification.

Images