A smart meter data processing method and system based on regional management
By distributing smart meter data processing to regional node servers and intermediate node servers, the performance bottlenecks and safety hazards of smart meter data processing systems under large-scale users and data volumes are solved, and efficient and reliable power management and user services are achieved. .
Patent Information
- Application Number
- CN202411331761.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-24
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2044-09-24
AI Technical Summary
When the existing smart meter data processing system faces a large number of users and data increase, it is prone to performance bottlenecks, network delays, data loss and security risks. The maintenance and expansion costs are high, making it difficult to achieve efficient and reliable power management. .
Using a smart meter data processing method based on regional management, the power supply area is divided into multiple independent management areas. Each area has a regional node server for preliminary processing and summary, and the intermediate node server performs data integration and abnormal detection, and finally transmits it to The central server performs storage and analysis, and dynamically adjusts the scope of the regional node server according to the load.
Significantly reduce central server load, improve response speed and real-time and accuracy of data transmission, enhance data security and privacy protection capabilities, reduce system maintenance and expansion costs, and provide more efficient and reliable power management solutions.
Smart Images

Figure CN118860668B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of electric meter technology, and in particular to a smart electric meter data processing method, system, electronic device and non-transient computer-readable storage medium based on regionalized management. Background Art
[0002] Today, smart meter data processing methods mainly rely on centralized data collection and management systems. These systems collect electricity usage data regularly through smart meters installed in each user's home or business, and then transmit this data to a central server through the network for storage and processing. The advantage of a centralized system is that it can uniformly manage and analyze large amounts of data, thereby providing accurate electricity usage analysis and real-time monitoring. In addition, centralized systems can also support advanced functions such as remote meter reading, abnormal electricity behavior detection, and load forecasting.
[0003] However, as the number of users and the amount of data continue to increase, the processing pressure and storage requirements of the central server rise rapidly, which can easily lead to system performance bottlenecks and prolonged response time. Secondly, the data transmission process may encounter problems such as network delays, transmission interruptions or data loss, affecting the real-time and accuracy of the data. In addition, centralized systems also face challenges in data security and privacy protection. Once the centrally stored user data is attacked, it may lead to large-scale information leakage. Finally, the maintenance and expansion costs of centralized systems are high, which is not conducive to large-scale deployment and application promotion.
[0004] Therefore, smart meter data processing methods based on regional management have gradually become a hot topic in research and application. Summary of the invention
[0005] In view of the technical problems existing in the prior art, the present invention provides a smart meter data processing method, system, electronic device and non-transitory computer-readable storage medium based on regional management, which can improve the accuracy, safety and efficiency of smart meter data processing.
[0006] The technical solution of the present invention to solve the above technical problems is as follows:
[0007] The present invention provides a smart meter data processing method based on regionalized management, the method comprising:
[0008] Divide the entire power supply area into multiple independent management areas, and set up a regional node server in each management area;
[0009] Each smart meter periodically transmits power usage data to a regional node server in the area where it is located, and the regional node server performs preliminary processing on the received power usage data to obtain the total power usage in the area;
[0010] Each of the regional node servers periodically summarizes the processed total power usage in the region and transmits it to the intermediate node server, which further processes and analyzes the power usage data and integrates the data between regions to obtain integrated data;
[0011] Performing anomaly detection on the power usage data of each smart meter according to the integrated data, repairing the abnormal data, and obtaining processed data;
[0012] Transmitting the processed data to a central server for final storage and comprehensive analysis to obtain target data;
[0013] According to the target data, each of the regional node servers and the load of each of the regional node servers are determined, and each of the regional node servers and the regional range of each of the regional node servers are dynamically adjusted according to the load.
[0014] Optionally, the performing preliminary processing on the received power usage data by the regional node server to obtain the total power usage in the region includes:
[0015] Get the first adjustment coefficient and the second adjustment coefficient,
[0016] Obtaining the power usage collected by each of the smart meters and the error correction value corresponding to each of the smart meters;
[0017] The total power usage in the area is determined according to the number of smart meters in the area, the first adjustment coefficient, the second adjustment coefficient, the power usage collected by each smart meter, and the error correction value corresponding to each smart meter.
[0018] Optionally, the total power usage in the region is expressed as:
[0019]
[0020] in, is the total electricity usage in the region, N is the number of smart meters in the region, It is The electricity usage of smart meters, and β are the first adjustment coefficient and the second adjustment coefficient respectively, It is The error correction value of a smart meter.
[0021] Optionally, further processing and analyzing the power usage data by the intermediate node server and integrating the data between regions to obtain integrated data includes:
[0022] Get the number of regions to be integrated;
[0023] obtaining a first weight and a total power usage of each of the areas;
[0024] Obtaining a third adjustment coefficient;
[0025] The integrated data is determined according to the third adjustment coefficient, the number of regions, the first weight of each of the regions, and the total power usage.
[0026] Optionally, the integrated data is represented as:
[0027]
[0028] in, is the integrated data, representing the weighted average electricity usage of multiple regions, M is the number of regions, is the first weight of the jth region, is the total electricity usage of the jth region, is the third adjustment factor.
[0029] Optionally, performing abnormality detection on the power usage data of each smart meter according to the integrated data includes:
[0030] Obtaining the power usage of each of the smart meters and the integrated data;
[0031] Get the standard deviation of electricity usage in the region;
[0032] Get the fourth adjustment coefficient
[0033] Determine an abnormality detection value according to the power usage of each smart meter, the integrated data, the standard deviation of the power usage in the area, and the fourth adjustment coefficient, and perform abnormality detection on the integrated data based on the abnormality detection value
[0034] Optionally, the abnormal detection value is expressed as:
[0035]
[0036] in, is the abnormal detection value, which represents the standard deviation of the data point of the i-th smart meter. is the electricity usage of the ith smart meter, It is to integrate data. is the standard deviation of electricity usage in the region, is the fourth adjustment factor.
[0037] Optionally, the transmitting the processed data to a central server for final storage and comprehensive analysis includes:
[0038] Calculate the hash value of the processed data and perform hash verification on the processed data; wherein the hash value of the processed data is expressed as:
[0039]
[0040] Where H represents the hash value for data transmission verification. Represents the processed data to be transmitted, Indicates the timestamp, represents the key, Salt represents the salt value, Represents a join operation.
[0041] Optionally, dynamically adjusting each of the regional node servers and the regional range of each of the regional node servers according to the load includes:
[0042] According to the current load, maximum load, current response time, optimal response time and fifth adjustment coefficient of each of the regional node servers and each of the regional node servers, the initial weights of the load distribution of each of the regional node servers and each of the regional node servers are processed to obtain corresponding second weights; wherein the second weight is expressed as:
[0043]
[0044] in, is the second weight after the initial weight is adjusted, is the initial weight, is the current load of the node, is the maximum load of the node, is the current response time, is the optimal response time, is the fifth adjustment factor.
[0045] The present invention also provides a smart meter data processing system based on regionalized management, the system comprising:
[0046] A regional division module is used to divide the entire power supply area into multiple independent management areas, and a regional node server is set up in each of the management areas;
[0047] The first processing module is used for each smart meter to periodically transmit the power usage data to the regional node server in the area, and the regional node server performs preliminary processing on the received power usage data to obtain the total power usage in the area;
[0048] A second processing module is used for each of the regional node servers to regularly summarize the processed total power usage in the region and transmit it to the intermediate node server, and the intermediate node server further processes and analyzes the power usage data, and integrates the data between regions to obtain integrated data;
[0049] A third processing module, configured to perform anomaly detection on the power usage data of each smart meter according to the integrated data, repair the abnormal data, and obtain processed data;
[0050] A fourth processing module is used to transmit the processed data to a central server for final storage and comprehensive analysis to obtain target data;
[0051] The fifth processing module is used to determine each of the regional node servers and the load of each of the regional node servers according to the target data, and dynamically adjust each of the regional node servers and the regional range of each of the regional node servers according to the load.
[0052] In addition, to achieve the above objectives, the present invention also proposes an electronic device, comprising: a memory for storing computer software programs; a processor for reading and executing the computer software programs, thereby implementing a smart meter data processing method based on regionalized management as described above.
[0053] In addition, to achieve the above-mentioned purpose, the present invention also proposes a non-transitory computer-readable storage medium, in which a computer software program is stored. When the computer software program is executed by a processor, it implements a smart meter data processing method based on regionalized management as described above.
[0054] The beneficial effects of the present invention are:
[0055] (1) The present invention distributes data processing tasks to multiple regional node servers (RNS) and intermediate node servers (INS) through regional management, greatly reducing the load pressure on the central server. Each RNS and INS is responsible for data collection and preliminary processing within its jurisdiction, effectively avoiding the performance bottleneck problem of the central server due to excessive data volume, and significantly improving the overall response speed of the system.
[0056] (2) The regional node server (RNS) and intermediate node server (INS) of the present invention reduce the number of long-distance data transmissions during data processing, reduce the risk of network delays and data transmission interruptions, and improve the real-time and accuracy of data transmission. By performing preliminary data processing and verification at the RNS and INS levels, errors and losses that may occur during data transmission are reduced.
[0057] (3) The present invention effectively reduces the exposure of data during transmission through regionalized management and distributed data processing, and reduces the risk of attacks and leaks. At the same time, each regional node only stores and processes data within its management scope. Even if a node is attacked, the impact is limited to the area managed by the node, which improves the overall security of the system and the user privacy protection capabilities.
[0058] In summary, the present invention can effectively solve the various shortcomings of the existing centralized processing methods through the regionalized management of smart meter data processing methods, significantly improve the performance, security, scalability and service level of the system, and provide a more efficient and reliable solution for power management and user services. BRIEF DESCRIPTION OF THE DRAWINGS
[0059] Figure 1 A scenario diagram of a smart meter data processing method based on regionalized management provided by the present invention;
[0060] Figure 2 A flow chart of a smart meter data processing method based on regionalized management provided by the present invention;
[0061] Figure 3 A schematic diagram of the structure of a smart meter data processing system based on regional management provided by the present invention;
[0062] Figure 4 A schematic diagram of the hardware structure of a possible electronic device provided by the present invention;
[0063] Figure 5 A schematic diagram of the hardware structure of a possible computer-readable storage medium provided by the present invention. DETAILED DESCRIPTION
[0064] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.
[0065] In the description of the present invention, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.
[0066] In the description of the present invention, the term "for example" is used to mean "used as an example, illustration or explanation". Any embodiment described as "for example" in the present invention is not necessarily to be construed as being more preferred or advantageous than other embodiments. The following description is given to enable any technician in the field to implement and use the present invention. In the following description, details are listed for the purpose of explanation. It should be understood that a person of ordinary skill in the art can recognize that the present invention can be implemented without using these specific details. In other examples, well-known structures and processes will not be elaborated in detail to avoid obscuring the description of the present invention with unnecessary details. Therefore, the present invention is not intended to be limited to the embodiments shown, but is consistent with the widest scope consistent with the principles and features disclosed in the present invention.
[0067] See also Figure 1 , Figure 1 A scenario diagram of a smart meter data processing method based on regional management provided by the present invention. Figure 1 As shown, the terminal and the server are connected via a network, such as a wired or wireless network connection. The terminal may include but is not limited to portable terminals such as mobile phones and tablets installed with various network platform applications, as well as fixed terminals such as computers, query machines, and advertising machines. The server provides users with various business services, including service push servers, user recommendation servers, etc.
[0068] It should be noted that Figure 1 The scenario diagram of a smart meter data processing method based on regionalized management shown is only an example. The terminal, server and application scenario described in the embodiment of the present invention are for more clearly illustrating the technical solution of the embodiment of the present invention, and do not generate limitations on the technical solution provided by the embodiment of the present invention. Ordinary technicians in this field can know that with the evolution of the system and the emergence of new business scenarios, the technical solution provided by the embodiment of the present invention is also applicable to similar technical problems.
[0069] Among them, the terminal can be used for:
[0070] Divide the entire power supply area into multiple independent management areas, and set up a regional node server in each management area;
[0071] Each smart meter periodically transmits power usage data to a regional node server in the area where it is located, and the regional node server performs preliminary processing on the received power usage data to obtain the total power usage in the area;
[0072] Each of the regional node servers periodically summarizes the processed total power usage in the region and transmits it to the intermediate node server, which further processes and analyzes the power usage data and integrates the data between regions to obtain integrated data;
[0073] Performing anomaly detection on the power usage data of each smart meter according to the integrated data, repairing the abnormal data, and obtaining processed data;
[0074] Transmitting the processed data to a central server for final storage and comprehensive analysis to obtain target data;
[0075] According to the target data, each of the regional node servers and the load of each of the regional node servers are determined, and each of the regional node servers and the regional range of each of the regional node servers are dynamically adjusted according to the load.
[0076] See also Figure 2 , provides a flow chart of a smart meter data processing method based on regionalized management of the present invention, comprising the following steps:
[0077] Step 201: Divide the entire power supply area into multiple independent management areas, and establish a regional node server in each management area.
[0078] The regional node server may be a RNS (Regional Node Server). In some embodiments, the purpose of dividing the regional node server may be:
[0079] Distribute the load: By dividing the entire power supply area into multiple smaller independent management areas, the load of data collection and processing is dispersed to avoid the overload problem of a single central server. Improve efficiency: Independent management areas can independently process and store data, reduce data transmission delays, and improve system response speed and real-time performance. Enhance reliability: Set up node servers in different areas. Once a server in a certain area fails, it will not affect the data collection and management of the entire power supply area, improving the stability and reliability of the system.
[0080] In some embodiments, the division criteria may be: Geographic location: Dividing regions based on geographic location can facilitate data collection and management. Number of users: Dividing evenly according to the number of users to ensure that the load in each region is relatively balanced. Power demand: Dividing regions according to differences in power demand allows targeted management of regions with high power demand and regions with low power demand.
[0081] In some embodiments, the purpose of setting up a regional node server can be: Local data processing: The regional node server is responsible for collecting and processing all smart meter data in the management area, reducing the need to transmit data to the central server. Data storage: The regional node server stores data locally, providing fast access and processing capabilities for data, ensuring real-time and reliability. Preprocessing and analysis: Perform data preprocessing and preliminary analysis locally to reduce the computing burden of the central server and improve the overall efficiency of the system.
[0082] In some embodiments, the main functions of the regional node server can be: Data collection: Regularly collect users' electricity usage data through smart meters in the region and summarize them to the regional node server. Data processing: Perform local data processing tasks, such as data cleaning, verification, aggregation, etc., to ensure the accuracy and validity of the data. Abnormal detection: Real-time monitoring and detection of abnormal electricity consumption behavior, timely warning and processing, to ensure power supply safety and users' legitimate rights and interests. Data transmission: Upload the processed data to the central server regularly or in real time for further analysis and management.
[0083] As an example, assume that a city is divided into four administrative areas: East, West, South, and North. Each area has a regional node server, and the smart meters in each area regularly upload power usage data to the corresponding node server.
[0084] East District: The East District node server is responsible for collecting data from all smart meters in the East District, processing and storing it locally. When a user in the East District is found to have abnormal electricity usage behavior, the node server will immediately issue an alarm and record the relevant data. South District: The South District node server regularly uploads processed data to the central server and stores local data for power usage analysis and anomaly detection in the region.
[0085] Through the above methods, the present invention can reduce the burden of the central server by dividing multiple regional node servers: each regional node server shares the work of data collection and processing, and the central server only needs to process the aggregated data, which greatly reduces the burden on the central server. The data processing speed can be improved: since the data is processed and stored locally, the delay in data transmission is reduced, and the real-time performance of data processing is improved. The reliability of the system can be improved: the distributed regional node server structure, even if a regional server fails, will not affect the normal operation of other regions, thereby improving the overall reliability of the system. Data security can be enhanced: data is stored and processed locally in the region, reducing security risks during long-distance transmission. At the same time, the node server in each region can independently take security measures to enhance data security and privacy protection.
[0086] Through this regionalized management of smart meter data processing, power supply companies can manage large-scale power user data more efficiently and reliably, and improve the overall power supply service quality.
[0087] Step 202: Each smart meter periodically transmits power usage data to a regional node server in the area where it is located, and the regional node server performs preliminary processing on the received power usage data to obtain the total power usage in the area.
[0088] In some embodiments, step 202 may include:
[0089] Get the first adjustment coefficient and the second adjustment coefficient,
[0090] Obtaining the power usage collected by each of the smart meters and the error correction value corresponding to each of the smart meters;
[0091] The total power usage in the area is determined according to the number of smart meters in the area, the first adjustment coefficient, the second adjustment coefficient, the power usage collected by each smart meter, and the error correction value corresponding to each smart meter.
[0092] In some embodiments, the total power usage in a region is expressed as:
[0093]
[0094] in, is the total electricity usage in the region, N is the number of smart meters in the region, It is The electricity usage of smart meters, and β are the first adjustment coefficient and the second adjustment coefficient respectively, It is The error correction value of a smart meter.
[0095] In the specific implementation, is the total electricity usage in the area and is the target value used to represent the total electricity consumption of all users in a specific area.
[0096] N is the number of smart meters in the area, indicating how many independent smart meters are recording and reporting electricity usage data in the area.
[0097] It is The power usage of a smart meter is the specific power usage data of each user (or device).
[0098] and β are the first adjustment coefficient and the second adjustment coefficient, respectively, which are used to adjust the calculation of power usage and error correction value. They can be adjusted according to system requirements to optimize the calculation results.
[0099] It is The error correction value of each smart meter is calculated based on the error of the smart meter. Since each smart meter may have a certain measurement error, Used to correct these errors and ensure more accurate calculation results.
[0100] Specifically, It is the square of the electricity usage, ensuring that when the base of the correction term is large, the correction value also increases accordingly. Combining the power usage and error correction value, the adjustment factor Determines the degree of influence of the error correction value. Taking the square root makes the growth rate of the error correction value more gradual and avoids overcorrection. Finally, multiply it by the adjustment coefficient , and further adjust the final value of the error correction term to ensure that the ratio of the correction term to the actual power usage is reasonable.
[0101] Step 203: Each of the regional node servers periodically summarizes the processed total power usage in the region and transmits it to the intermediate node server, which further processes and analyzes the power usage data and integrates the data between regions to obtain integrated data.
[0102] In some embodiments, step 203 may include:
[0103] Get the number of regions to be integrated;
[0104] obtaining a first weight and a total power usage of each of the areas;
[0105] Obtaining a third adjustment coefficient;
[0106] The integrated data is determined according to the third adjustment coefficient, the number of regions, the first weight of each of the regions, and the total power usage.
[0107] In some embodiments, the integrated data is represented by:
[0108]
[0109] in, is the integrated data, representing the weighted average electricity usage of multiple regions, M is the number of regions, is the first weight of the jth region, is the total electricity usage of the jth region, is the third adjustment factor.
[0110] The intermediate node server may be an INS (Intermediate Node Server). It is integrated data that represents the weighted average electricity usage of multiple regions, reflecting the overall electricity usage situation.
[0111] M is the number of regions, indicating how many independent regions there are, and each region has its own independent data collection and processing nodes.
[0112] is the first weight of the jth region, which is used to adjust the relative importance of each region when calculating the weighted average. The weight can be determined based on factors such as the power consumption scale of the region and the number of users.
[0113] is the total electricity usage of the jth region, which represents the total electricity consumption of all users in the jth region.
[0114] is the third adjustment factor, which is used to adjust the impact of the logarithmic transformation so that the contribution of total electricity usage in the calculation is smoother.
[0115] Specifically, It is the weighted total electricity usage of each region multiplied by its logarithmic transformation. Through logarithmic transformation, the impact of large values is reduced, making the contribution of each region smoother and more stable.
[0116] It is the cumulative value of the weighted logarithmic transformation items of all regions. It reflects the comprehensive weight of each region on the logarithmic transformation item.
[0117] In summary, the present invention calculates the weighted average power usage through the ratio of the numerator and denominator of the formula: . Ensure that the total power usage and weight of each area are appropriately considered.
[0118] Step 204: perform anomaly detection on the power usage data of each smart meter according to the integrated data, repair the abnormal data, and obtain processed data.
[0119] In some embodiments, step 204 may include:
[0120] Obtaining the power usage of each of the smart meters and the integrated data;
[0121] Get the standard deviation of electricity usage in the region;
[0122] Obtaining a fourth adjustment coefficient;
[0123] An abnormality detection value is determined according to the power usage of each of the smart meters, the integrated data, the standard deviation of the power usage in the area, and the fourth adjustment coefficient, and an abnormality detection is performed on the integrated data based on the abnormality detection value.
[0124] In some embodiments, the anomaly detection value is represented by:
[0125]
[0126] in, is the abnormal detection value, which represents the standard deviation of the data point of the i-th smart meter. is the electricity usage of the ith smart meter, It is to integrate data. is the standard deviation of electricity usage in the region, is the fourth adjustment factor.
[0127] In the specific implementation, is the standard deviation of the ith data point, which is used to indicate the power usage of the ith smart meter relative to the average value. degree of deviation.
[0128] is the electricity usage of the i-th smart meter, which represents the actual electricity usage data recorded by each smart meter.
[0129] It is the aggregated data, representing the weighted average electricity usage of multiple areas. It is a representative value of the overall electricity usage.
[0130] is the standard deviation of electricity usage in the region, indicating the degree of dispersion of electricity usage data.
[0131] It is the fourth adjustment coefficient, which is used to adjust the influence of the deviation value in the calculation.
[0132] Specifically, It represents the deviation value of the power usage of the i-th smart meter relative to the average power usage. It is the adjustment term of the deviation, and the influence of the deviation value is controlled by adjusting the coefficient λ.
[0133] It can be understood that the present invention will be the deviation value Divide by the standard deviation adjustment , get the standard deviation , reflects the standardized deviation of the electricity usage of each smart meter from the average value. ∣, that is If the absolute value of exceeds a certain threshold, the data point is considered to be abnormal.
[0134] Step 205: Transmit the processed data to a central server for final storage and comprehensive analysis to obtain target data.
[0135] In some embodiments, step 205 may include:
[0136] Calculate the hash value of the processed data and perform hash verification on the processed data; wherein the hash value of the processed data is expressed as:
[0137]
[0138] Where H represents the hash value for data transmission verification. Represents the processed data to be transmitted, Indicates the timestamp, represents the key, Salt represents the salt value, Represents a join operation.
[0139] In the specific implementation, H represents the hash value of data transmission verification, which is used to verify the integrity of data during transmission and prevent tampering.
[0140] Indicates processed data to be transmitted, indicating power usage data or other related data that needs to be transmitted.
[0141] Represents a timestamp, which is used to record the specific time when data is generated or transmitted to ensure the timeliness of the data and prevent replay attacks.
[0142] Indicates a key, which is used to enhance the security of data transmission and is secret information known only to the communicating parties.
[0143] Salt represents the salt value, which is used to increase the randomness of the hash function and prevent hash collision attacks.
[0144] Represents a concatenation operation, which means concatenating the various data parts together as the input of the hash function.
[0145] Specifically, the present invention uses the connection operator The processed data to be transmitted , timestamp t, key k and salt value Salt are concatenated together to form a new string or data block.
[0146] In some embodiments, a hash function Hash() may be applied to the concatenated data blocks. The hash function may be a commonly used cryptographic hash function such as MD5, SHA-256, etc. A fixed-length hash value H is generated for data verification.
[0147] Step 206: Determine each of the regional node servers and the load of each of the regional node servers according to the target data, and dynamically adjust each of the regional node servers and the regional range of each of the regional node servers according to the load.
[0148] In some embodiments, step 206 may include:
[0149] According to the current load, maximum load, current response time, optimal response time and fifth adjustment coefficient of each of the regional node servers and each of the regional node servers, the initial weights of the load distribution of each of the regional node servers and each of the regional node servers are processed to obtain corresponding second weights; wherein the second weight is expressed as:
[0150]
[0151] in, is the second weight after the initial weight is adjusted, is the initial weight, is the current load of the node, is the maximum load of the node, is the current response time, is the optimal response time, is the fifth adjustment factor.
[0152] In the specific implementation, is the second weight after the initial weight is adjusted, and is the adjusted weight used to distribute the load to the node to ensure that the load of each node is balanced;
[0153] is the initial weight, which is the value preset by the system based on the capabilities, positions and other initial conditions of each node;
[0154] is the load of the current node, which indicates the actual load of the current node, such as the amount of data currently processed or the number of user requests;
[0155] is the maximum load of the node, which indicates the maximum load that the node can bear in theory or during design;
[0156] is the current response time, which indicates the response time of the current node to the request and is an important indicator for measuring node performance;
[0157] It is the optimal response time, which indicates the ideal response time expected or set by the system and serves as a reference standard for performance;
[0158] is the fifth adjustment factor, which is used to control the impact of response time differences on weight adjustment.
[0159] Specifically, Indicates the ratio of the current node load to the maximum load. Represents the ratio of load to residual capacity. The higher the load, the lower the residual capacity, and vice versa. By multiplying the initial weight ω by the ratio of residual capacity, the weight is initially adjusted to ensure that the weight of nodes with higher load is reduced, thereby reducing their load.
[0160] Indicates the degree of deviation of the current response time from the optimal response time. Above optimal response time , Is a positive value.
[0161] Use an exponential function to adjust the weights, ensuring that the weights of nodes with longer response times are further reduced to reduce their load. Controls the adjustment range.
[0162] In some embodiments, the initial weight adjustment and the response time adjustment can be combined to obtain the final adjusted weight This ensures that nodes with higher load and longer response time have their weight reduced and are assigned less load, and vice versa, thus achieving load balancing.
[0163] In some embodiments, when the load ratio When a certain threshold is exceeded, the load adjustment mechanism can be triggered. For example, some data processing tasks can be transferred to node servers with lighter loads.
[0164] In some embodiments, the management area can be re-divided to expand or reduce the management area of a node server. For example, when a node server is detected to be overloaded, its management area can be re-divided to expand the area range of adjacent node servers with lighter loads to reduce the burden of the overloaded node; or reduce the area range of the overloaded node to allocate some users and data to adjacent nodes.
[0165] The present invention can ensure load balancing of node servers in each region by dynamically adjusting the region range, thereby improving data processing efficiency and system reliability.
[0166] See also Figure 3 , Figure 3 A schematic structural diagram of a smart meter data processing system based on regionalized management provided by the present invention.
[0167] like Figure 3 As shown, a smart meter data processing system based on regional management proposed in an embodiment of the present invention includes:
[0168] The area division module 301 is used to divide the entire power supply area into multiple independent management areas, and a regional node server is set up in each of the management areas;
[0169] The first processing module 302 is used for each smart meter to periodically transmit the power usage data to the regional node server in the area, and the regional node server performs preliminary processing on the received power usage data to obtain the total power usage in the area;
[0170] The second processing module 303 is used for each of the regional node servers to regularly summarize the processed total power usage in the region and transmit it to the intermediate node server, and the intermediate node server further processes and analyzes the power usage data, and integrates the data between regions to obtain integrated data;
[0171] The third processing module 304 is used to perform anomaly detection on the power usage data of each smart meter according to the integrated data, repair the abnormal data, and obtain processed data;
[0172] The fourth processing module 305 is used to transmit the processed data to the central server for final storage and comprehensive analysis to obtain target data;
[0173] The fifth processing module 306 is used to determine each of the regional node servers and the load of each of the regional node servers according to the target data, and dynamically adjust each of the regional node servers and the regional range of each of the regional node servers according to the load.
[0174] See also Figure 4 , Figure 4 Schematic diagram of an electronic device provided by an embodiment of the present invention. Figure 4 As shown, an embodiment of the present invention provides an electronic device 400, including a memory 410, a processor 420, and a computer program 411 stored in the memory 410 and executable on the processor 420. When the processor 420 executes the computer program 411, the following steps are implemented:
[0175] Divide the entire power supply area into multiple independent management areas, and set up a regional node server in each management area;
[0176] Each smart meter periodically transmits power usage data to a regional node server in the area where it is located, and the regional node server performs preliminary processing on the received power usage data to obtain the total power usage in the area;
[0177] Each of the regional node servers periodically summarizes the processed total power usage in the region and transmits it to the intermediate node server, which further processes and analyzes the power usage data and integrates the data between regions to obtain integrated data;
[0178] Performing anomaly detection on the power usage data of each smart meter according to the integrated data, repairing the abnormal data, and obtaining processed data;
[0179] Transmitting the processed data to a central server for final storage and comprehensive analysis to obtain target data;
[0180] According to the target data, each of the regional node servers and the load of each of the regional node servers are determined, and each of the regional node servers and the regional range of each of the regional node servers are dynamically adjusted according to the load.
[0181] See also Figure 5 , Figure 5 A schematic diagram of an embodiment of a computer-readable storage medium provided in an embodiment of the present invention. Figure 5 As shown, this embodiment provides a computer-readable storage medium 500, on which a computer program 411 is stored. When the computer program 411 is executed by a processor, the following steps are implemented:
[0182] Divide the entire power supply area into multiple independent management areas, and set up a regional node server in each management area;
[0183] Each smart meter periodically transmits power usage data to a regional node server in the area where it is located, and the regional node server performs preliminary processing on the received power usage data to obtain the total power usage in the area;
[0184] Each of the regional node servers periodically summarizes the processed total power usage in the region and transmits it to the intermediate node server, which further processes and analyzes the power usage data and integrates the data between regions to obtain integrated data;
[0185] Performing anomaly detection on the power usage data of each smart meter according to the integrated data, repairing the abnormal data, and obtaining processed data;
[0186] Transmitting the processed data to a central server for final storage and comprehensive analysis to obtain target data;
[0187] According to the target data, each of the regional node servers and the load of each of the regional node servers are determined, and each of the regional node servers and the regional range of each of the regional node servers are dynamically adjusted according to the load.
[0188] It should be noted that in the above embodiments, the description of each embodiment has its own emphasis, and for parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0189] It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0190] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded computer, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A system that specifies the functions of a box or multiple boxes.
[0191] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a product including an instruction system, which is implemented in the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0192] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1The steps for the functions specified in one or more boxes.
[0193] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.
[0194] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.
Claims
1. A smart meter data processing method based on regional management, It is characterized in that The method comprises: Divide the entire power supply area into multiple independent management areas, and set up a regional node server in each management area; Each smart meter periodically transmits power usage data to a regional node server in the area where it is located, and the regional node server performs preliminary processing on the received power usage data to obtain the total power usage in the area, including: obtaining a first adjustment coefficient and a second adjustment coefficient, obtaining the power usage collected by each smart meter, and an error correction value corresponding to each smart meter; determining the total power usage in the area according to the number of smart meters in the area, the first adjustment coefficient, the second adjustment coefficient, the power usage collected by each smart meter, and the error correction value corresponding to each smart meter; the total power usage in the area is expressed as: Among them, P total is the total electricity usage in the region, N is the number of smart meters in the region, and P i is the electricity usage of the i-th smart meter, α and β are the first adjustment coefficient and the second adjustment coefficient, respectively, E i is the error correction value of the i-th smart meter; Each of the regional node servers periodically summarizes the processed total power usage in the region and transmits it to the intermediate node server, and further processes and analyzes the power usage data through the intermediate node server, and performs data integration between regions to obtain integrated data, including: obtaining the number of regions to be integrated; obtaining the first weight and total power usage of each of the regions; obtaining the third adjustment coefficient; determining the integrated data according to the third adjustment coefficient, the number of regions, the first weight and total power usage of each of the regions; the integrated data is expressed as: Among them, P avg is the integrated data, representing the weighted average electricity usage of multiple regions, M is the number of regions, ω j is the first weight of the jth region, P total,j is the total electricity usage of the jth region, γ is the third adjustment coefficient; According to the integrated data, anomaly detection is performed on the power usage data of each of the smart meters, and the abnormal data is repaired to obtain processed data, including: obtaining the power usage of each of the smart meters and the integrated data; obtaining the standard deviation of the power usage in the area; obtaining a fourth adjustment coefficient; determining an anomaly detection value according to the power usage of each of the smart meters, the integrated data, the standard deviation of the power usage in the area, and the fourth adjustment coefficient, and performing anomaly detection on the integrated data based on the anomaly detection value; the anomaly detection value is expressed as: Among them, Z i is the abnormal detection value, which represents the standard deviation of the data point of the i-th smart meter, P i is the electricity usage of the ith smart meter, P avg is the integrated data, σ is the standard deviation of electricity usage in the region, and λ is the fourth adjustment coefficient; The processed data is transmitted to a central server for final storage and comprehensive analysis to obtain target data, including: calculating a hash value of the processed data and performing a hash check on the processed data; wherein the hash value of the processed data is expressed as: H = Hash (P 处 ||t||k||Salt); where H represents the hash value of data transmission verification, P 处 represents the processed data to be transmitted, t represents the timestamp, k represents the key, Salt represents the salt value, and || represents the connection operation; According to the target data, the load of each intermediate node server and each regional node server is determined, and the regional range of each regional node server is dynamically adjusted according to the load, including: according to the current load, maximum load, current response time, optimal response time and fifth adjustment coefficient of each regional node server and each regional node server, the initial weight of the load distribution of each regional node server and each regional node server is processed to obtain a corresponding second weight; wherein the second weight is expressed as: Among them, ω' is the second weight after the initial weight is adjusted, ω is the initial weight, L current is the current load of the node, L max is the maximum load of the node, T response is the current response time, T optimal is the optimal response time, and δ is the fifth adjustment coefficient.
2. A smart meter data processing system based on regional management, used to execute the smart meter data processing method based on regional management as claimed in claim 1, It is characterized in that The system comprises: A regional division module is used to divide the entire power supply area into multiple independent management areas, and a regional node server is set up in each of the management areas; The first processing module is used for each smart meter to periodically transmit the power usage data to the regional node server in the area, and the regional node server performs preliminary processing on the received power usage data to obtain the total power usage in the area; A second processing module is used for each of the regional node servers to regularly summarize the processed total power usage in the region and transmit it to the intermediate node server, and the intermediate node server further processes and analyzes the power usage data, and integrates the data between regions to obtain integrated data; A third processing module, configured to perform anomaly detection on the power usage data of each smart meter according to the integrated data, repair the abnormal data, and obtain processed data; A fourth processing module is used to transmit the processed data to a central server for final storage and comprehensive analysis to obtain target data; The fifth processing module is used to determine each of the regional node servers and the load of each of the regional node servers according to the target data, and dynamically adjust each of the regional node servers and the regional range of each of the regional node servers according to the load.
