Distributed Metering Data Management via Broker-Buffer Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional metering data management systems face performance and reliability degradation as metering data capacity increases, leading to potential data loss and management interruptions.
Innovation Solution
A distributed metering data management system that collects and processes data in a parallel manner using a metering data transmission module, buffer servers, and a broker server to determine extraction targets based on state information, allowing for flexible capacity adjustments and error validation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If metering data capacity increases as metering technique develops, then data collection capability improves, but performance and reliability of the metering data management system degrades
Solution Approach 1:
The system segments the centralized database link method into multiple distributed buffer servers, each handling specific topics. This segmentation prevents single-point failure and distributes the load, thereby maintaining reliability while accommodating increased data capacity.
Solution Approach 2:
The broker server acts as an intermediary between data collection and processing components. It manages the distribution of metering data to appropriate buffer servers and processing servers, enabling scalable data handling without compromising system reliability.
2Device complexity
If conventional database link method is used for data collection, then system structure is simple, but performance degrades with increased data capacity
Solution Approach 1:
The system divides the monolithic database link into multiple buffer servers with topic-based assignment. Each buffer server independently handles specific data streams, enabling parallel processing and improved performance while maintaining manageable system complexity through modular architecture.
Solution Approach 2:
The system introduces a new dimension of organization by implementing topic-based categorization of metering data. This dimensional approach allows efficient routing and processing of diverse data types without increasing overall system complexity.
3Ease of operation
If centralized data processing is used, then data management is straightforward, but data loss and interruptions occur with increased capacity
Solution Approach 1:
The centralized processing model is segmented into multiple independent processing servers that can operate autonomously. This segmentation ensures that failures in one processing unit do not propagate to others, preventing data loss while maintaining ease of operation through standardized interfaces.
Solution Approach 2:
The system changes the operational parameters by implementing state information tracking for buffer servers. This enables dynamic load balancing and failover mechanisms that maintain data integrity while preserving operational simplicity.
Data Source
AI summary
The present invention relates to a metering data management system including a metering data transmission module configured to collect a piece of metering data and generate a message containing the piece of metering data and topic information corresponding to the piece of metering data, a plurality of buffer servers, each of which has a plurality of buffers to which different topics are assigned, configured to store the message in a buffer corresponding to the topic information, a metering data processing module configured to extract the piece of metering data from some of the plurality of buffer servers and process the extracted piece of metering data, and a broker server configured to determine a buffer server, which is an extraction target of the metering data processing module, among the plurality of buffer servers on the basis of state information of the plurality of buffer servers.