Extracting instantaneous renewable generation from net load measurements in power distribution systems

Abstract

To provide a method for extracting instantaneously renewable power generation from a pure load measurement regarding a power distribution system, and an energy disaggregation system.SOLUTION: A method includes: generating pure load time-series data via a continuous point-on wave (CPOW) measurement unit; generating a compressed latent space representation from the pure load time-series data; converting the pure load time-series data into a time frequency domain; delivering to a feature extractor time domain context information having the converted time frequency domain representation of the pure load time-series data; estimating two weight matrixes which should be multiplied by output from an encoder network; learning time measures of a specific load and photovoltaic (PV) power generation; converting weighted latent space representations of the specific load and the PV power generation into time domain representations; and predicting a specific load and PV power generation at a distribution system level from the converted time domain representations corresponding to the specific load and the PV power generation.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates generally to power systems, and more particularly to estimating instantaneous renewable generation for power distribution systems. [Background technology]

[0002] Distribution networks and their role in power supply are undergoing a paradigm shift with the increasing penetration of distributed energy resources (DERs). Knowledge of instantaneous generation and demand is critical to ensure smooth operation of such complex systems with bidirectional power flow. Many different types of DERs exist, such as photovoltaic (solar) power generation and wind power generation. This disclosure focuses on photovoltaic (PV) power generation, which uses solar energy to produce electricity.

[0003] Utilities measure net system load and are unaware of native system load and photovoltaic (PV) generation. Therefore, energy disaggregation (ED) plays a central role in increasing grid observability to support network planning and operational tasks. Low-resolution measurements obtained from advanced metering infrastructure (AMI) and substation supervisory control and data acquisition systems (SCADA) do not provide the much-needed observability for DER-rich networks. Therefore, utilities currently install continuous-point-on-wave (CPOW) measurement units to obtain measurements sampled at 1 kHz or higher. Disaggregation accuracy increases with increasing sampling rate, with the best accuracy expected for data sampling rates ranging from 1 kHz to 12 kHz. Therefore, new, computationally efficient, and accurate algorithms are needed to support ED using CPOW data.

[0004] The methodologies proposed in the existing literature for net load disaggregation can be broadly divided into two categories: model-based approaches and model-less (data-driven) approaches. The idea of ​​model-based approaches is to develop parametric models of PV generation and specific demand and statistically estimate the parameters using available net load and weather data. An example of this type of research can be found in the paper "Estimation of behind-the-meter solar generation by integrating physical with statistical models" by F. Kabir et al., published in the Proceedings of the 2019 IEEE International Conference on Communication, Control, and Computing Technologies for Smart Grids (2019, pp. 1–6). The disaggregation performance of these approaches is highly dependent on the quality of the parametric models. In contrast, model-less approaches do not require parametric models but are affected by data quality.Some of the model-free methods for ED use dictionary learning approaches, such as the work presented in the paper by W. Li et al., “Real-time energy disaggregation at substations with behind-the-meter solar generation” (IEEE Trans. Power Syst., Vol. 36, No. 3, pp. 2023-2034, 2021), or supervised machine learning methods, such as the one proposed in the paper by R. Saeedi et al., “An adaptive machine learning framework for behind-the-meter load / PV disaggregation” (IEEE Trans. Ind. Informat., Vol. 17, No. 10, pp. 7060-7069, 2021).

[0005] All of the above approaches did not consider the use of CPOW data. The inspiration for disaggregation using CPOW data can be found in single-channel blind source separation. This task is similar to ED using CPOW data because speech signals with frequencies above 1 kHz are used. Y. Luo et al. proposed an approach for time-domain source separation using deep learning methods in their paper titled "Conv-TasNet: surpassing ideal time-frequency magnitude masking for speech separation" (IEEE / ACM Trans. Audio, Speech, Language Process., Vol. 27, No. 8, pp. 1256-1266, 2019). Summary of the Invention [Problem to be solved by the invention]

[0006] Summarizing the prior art review, we note that the use of CPOW data has not been considered within all existing ED approaches. Also, ED algorithms do not consider the operational status of PV generators, which may result in disaggregation errors. Methods for source separation tasks are designed to handle granular data. However, due to the different physical properties of acoustic waves and electrical signals, these methods cannot be directly applied to ED.

[0007] Therefore, an advanced energy disaggregation approach is needed to extract instantaneous renewable generation from net load measurements for the power distribution system by using high-fidelity CPOW data. [Means for solving the problem]

[0008] overview This disclosure presents a set of energy disaggregation methods for separating distribution system-level net load measurements into inherent loads and photovoltaic (PV) generation.

[0009] A causal, context-aware, fully convolutional deep learning network, called Conv-EDNet, is presented for simultaneous PV load energy disaggregation using continuous point-on-wave measurements. The presented network uses an encoder-decoder framework combined with a separator network to perform disaggregation in the time domain. The separator network, conditioned on time-domain and time-frequency-domain features, harnesses the power of stacked dilated temporal convolutions to learn two weight functions for disaggregation using nonnegative encoder outputs. The decoder converts the weighted encoder outputs into time-domain-specific load and PV generation measurements. The developed model, Conv-EDNet, is further extended into a new model, Conv-EDNet+, by adding adversarial learning features through a gated recurrent unit (GRU)-based discriminator. The addition of an adversarial training component to Conv-EDNet further improves the model's prediction accuracy and robustness.

[0010] Compared to existing methods, the proposed deep learning-based model-free time-domain net load disaggregation framework conditions on time-frequency domain features using CPOW measurements. This framework supports scale- and context-aware disaggregation, where time-domain, time-frequency-domain, and spatiotemporal information are used to quantify the scale and context of disaggregation. It also uses a scheme for simultaneous disaggregation of inherent loads and PV components, eliminating the need to build and train two separate networks. The use of CPOW measurements with a novel deep learning-based model for distribution system-level ED is proposed for the first time.

[0011] Furthermore, by combining the convolutional energy disaggregation network with domain adaptation, Conv-EDNet+ is extended into another new model, ConvED-DAN. In ConvED-DAN, the discriminator is reused to perform the task of unsupervised domain adaptation. We modify Conv-EDNet+ by combining the concepts of adversarial learning and joint adaptation to perform the task of minimizing the distribution gap in feature space and label space between the source and target domains. This approach enables training the model on synthetic data and applying it to real-world measurement data. By using limited labeled data in the source domain and unlabeled target domain data, the proposed network can produce satisfactory results for energy disaggregation using CPOW measurements.

[0012] According to some embodiments of the present invention, a computer-implemented method is provided for performing energy disaggregation of distribution system-level net load measurements for a distribution system using continuous point-on-wave (CPOW) measurement units. The method uses a processor coupled with instructions stored in memory that implement the method using a neural network, the neural network including an encoder network, a feature extractor, a separator network, and a decoder network, stored in memory. The instructions, when executed by the processor, perform the steps of the method. The steps include generating net load time series data from voltage and current measurements via a CPOW measurement unit, generating a compressed latent space representation from the net load time series data using an encoder network, transforming the net load time series data into a time-frequency domain using a short-time Fourier transform (STFT) method, passing the time-domain context information with the transformed time-frequency domain representation of the net load time series data to a feature extractor trained to accurately extract harmonic features, estimating two weight matrices to be multiplied by the output from the encoder network using a separator network trained to assign weights to the compressed latent space representation to learn time features of the intrinsic load and photovoltaic (PV) power generation, converting the weighted compressed latent space representation corresponding to the intrinsic load and PV power generation into a time-domain representation from the output of the encoder network and the separator network using a decoder network, and predicting the intrinsic load and PV power generation at the distribution system level from the transformed time-domain representation corresponding to the intrinsic load and PV power generation using a disaggregation and adjustment method.

[0013] Additionally, some embodiments of the present invention recognize that an energy disaggregation system is provided for performing energy disaggregation of distribution system-level net load measurements for a distribution system using continuous point-on-wave (CPOW) measurement units. The energy disaggregation system may include a network interface controller configured to receive measurement data of electrical signals indicative of voltage and current measurements of substations or feeders located in the distribution system, a memory configured to store instructions for implementing the energy disaggregation method using a neural network including an encoder network, a feature extractor, a separator network, and a decoder network, and a processor coupled to the memory. The processor is configured to execute the instructions for implementing the steps of the energy disaggregation method. The steps include generating a compressed latent space representation from the net load time series using an encoder network and measurement data of the electrical signal; transforming the net load time series into a time-frequency domain using a short-time Fourier transform (STFT) method; passing the time-domain context information having the transformed time-frequency domain representation of the net load time series to a feature extractor trained to accurately extract harmonic features; estimating two weight matrices to be multiplied by the output from the encoder network using a separator network trained to assign weights to the compressed latent space representation to learn time features of the intrinsic load and photovoltaic (PV) power generation; transforming the weighted compressed latent space representation corresponding to the intrinsic load and PV power generation into a time-domain representation from the output of the encoder network and the separator network using a decoder network; and predicting the intrinsic load and PV power generation at the distribution system level from the transformed time-domain representation corresponding to the intrinsic load and PV power generation using a disaggregation post-regulation method.

[0014] The present disclosure is further described in the following detailed description with reference to the drawings, which are set forth as non-limiting examples of exemplary embodiments of the present disclosure. Like reference numerals represent like parts throughout the several views of the drawings. The drawings shown are not necessarily to scale, emphasis instead generally being placed upon illustrating the principles of the presently disclosed embodiments. [Brief explanation of the drawings]

[0015] [Figure 1] FIG. 1 is a schematic diagram illustrating an energy disaggregation process using a Conv-EDNet model, according to an embodiment of the present disclosure. [Figure 2] FIG. 1 is a schematic diagram illustrating a feature extractor network according to an embodiment of the present disclosure. [Figure 3A] FIG. 1 is a schematic diagram illustrating a separator network according to an embodiment of the present disclosure. [Figure 3B] FIG. 1 is a schematic diagram illustrating an RT-GLU block of a separator network, according to an embodiment of the present disclosure. [Figure 4] FIG. 1 is a schematic diagram illustrating a Conv-EDNet+ model according to an embodiment of the present disclosure. [Figure 5A] FIG. 1 is a schematic diagram illustrating a training algorithm for using a Conv-EDNet+ model, according to an embodiment of the present disclosure. [Figure 5B] FIG. 1 is a schematic diagram illustrating a distribution network structure for synthetic data generation, according to an embodiment of the present disclosure. [Figure 5C] FIG. 1 is a schematic diagram illustrating hyperparameter setting according to an embodiment of the present disclosure. [Figure 6A] 1 is a set of plots showing a comparison of predictions using Conv-EDNet, Conv-EDNet+, Conv-TasNet, and DAE-Net under normal operating conditions, in accordance with an embodiment of the present disclosure. [Figure 6B] 10 is a set of plots showing a comparison of predictions using Conv-EDNet, Conv-EDNet+, Conv-TasNet, and DAE-Net under PV generator fault conditions, according to an embodiment of the present disclosure. [Figure 7] FIG. 1 is a schematic diagram illustrating a comparison of performance metrics according to an embodiment of the present disclosure. [Figure 8] FIG. 1 is a schematic diagram illustrating a ConvED-DAN model according to an embodiment of the present disclosure. [Figure 9] FIG. 1 is a schematic diagram illustrating a training algorithm for a ConvED-DAN model, according to an embodiment of the present disclosure. [Figure 10A] FIG. 1 is a schematic diagram illustrating source and target domain data distributions for net load measurements, according to an embodiment of the present disclosure. [Figure 10B] FIG. 1 is a schematic diagram illustrating source and target domain data distribution for PV power generation according to an embodiment of the present disclosure. [Figure 10C] FIG. 1 is a schematic diagram illustrating source and target domain data distribution for a specific load according to an embodiment of the present disclosure. [Figure 11A] FIG. 1 is a schematic diagram illustrating domain adaptation results for load disaggregation according to an embodiment of the present disclosure. [Figure 11B] FIG. 10 is a schematic diagram illustrating domain adaptation results for PV disaggregation according to an embodiment of the present disclosure. [Figure 12A] FIG. 1 is a schematic diagram illustrating a visualization of a feature space using domain adaptation, according to an embodiment of the present disclosure. [Figure 12B] FIG. 1 is a schematic diagram illustrating a visualization of a feature space without domain adaptation, according to an embodiment of the present disclosure. [Figure 13] FIG. 1 is a block diagram illustrating an energy disaggregation system for an electrical power distribution system according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0016] While the above-described drawings set forth embodiments disclosed herein, other embodiments are contemplated, as noted in the description. This disclosure presents exemplary embodiments by way of representation and not limitation. Numerous other modifications and embodiments can be devised by those skilled in the art which fall within the scope and spirit of the principles of the embodiments disclosed herein.

[0017] Detailed Description In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure. However, it will be apparent to those skilled in the art that the present disclosure may be practiced without these specific details. In other instances, devices and methods are shown only in block diagram form to avoid obscuring the disclosure. Various changes can be made in the function and arrangement of elements without departing from the spirit and scope of the disclosed subject matter as set forth in the appended claims.

[0018] As used in this specification and claims, the terms "for example," "such as," and "e.g.," as well as the verbs "comprise," "have," and "include" and other verb forms thereof, when used in conjunction with a list of one or more components or other items, should each be construed as open-ended. That is, the list should not be considered as excluding other additional components or items. The term "based on" means based at least in part on. It should also be understood that the language and terminology employed herein are for purposes of description and should not be considered limiting. Any headings used within this description are for convenience only and have no legal or limiting effect.

[0019] Specific details are given in the following description to provide a thorough understanding of the embodiments. However, it will be understood by those skilled in the art that the embodiments may be practiced without these specific details. For example, systems, processes, and other elements in the disclosed subject matter may be shown as components in block diagram form so as not to obscure the embodiments in unnecessary detail. In other instances, well-known processes, structures, and techniques may be shown without unnecessary detail so as to avoid obscuring the embodiments. Also, the same reference numbers and names in the various drawings refer to the same elements.

[0020] Energy disaggregation refers to the separation of distribution system-level net load measurements into inherent load and photovoltaic (PV) generation. Due to the increasing deployment of PV generators and the complexity of operating such renewable energy-rich networks, accurately disaggregating measurements has become increasingly important.

[0021]

number

[0022] Figure 1 is a schematic diagram illustrating the overall process for a distribution system to perform energy disaggregation tasks using our disclosed methods in this disclosure. The distribution system first collects voltage and current measurements from a CPOW measurement unit 111 and then performs data preprocessing and cleaning 112 to convert the raw data into an efficient data format, fill missing values, remove noisy data and outliers, and resolve discrepancies. The processed data is then passed to a data processing and harmonic spectrum extraction module 113 to calculate the net load (114) (stage 1) and perform a short-time Fourier transform (STFT) (115) (stage 2). The results from module 113 are then passed to the energy disaggregation module 110 through a Convolutional Energy Disaggregation Network (Conv-EDNet) 169 (stage 3) and post-disaggregation conditioning 120 (stage 4) to obtain the final inherent load and PV generation forecast results.

[0023] Conv-EDNet: Convolutional Energy Disaggregation Network As shown in Figure 1, the Conv-EDNet framework 169 is constructed using four sub-networks: an encoder 117, a feature extractor 116, a separator network 118, and a decoder 119.

[0024] Encoder Network

[0025]

number

[0026] Feature Extractor Network Figure 2 is a schematic diagram illustrating a feature extractor network 200. The goal of the feature extractor network is to utilize net load data and complementary contextual data to assist in the disaggregation task. CPOW units 111 measure individual phase currents and voltages, from which aggregated net load values ​​are calculated (114). This data also helps supplement the disaggregation task by extracting information about harmonic content (115), which helps quantify PV generation by assisting in generator connectivity status and generator fault detection. Therefore, a separate, dedicated network 200 is developed with the sole responsibility of extracting significant features from instantaneous voltage and current measurement data along with irradiance and temperature measurements.

[0027] The feature extractor network uses the STFT method to identify harmonic signatures introduced into the distribution system by inverter-based PV generation. PV generators are connected to the distribution system through DC / AC inverters, which generate harmonics into electrical signals that can be used to identify PV generation and generator status. The inverters are used to convert power from direct current (DC) to alternating current (AC).

[0028]

number

[0029] For Conv-EDNet, a rectified linear unit (ReLU) is used as the activation function to ensure a non-negative latent space representation. Context information for temperature and irradiance 211 is each passed through a unique 1D convolutional layer 212, followed by nonlinear activations 213, to obtain a time-domain latent space representation. To obtain a reduced-dimensional latent space representation, instantaneous voltage and current STFT spectrograms 214 corresponding to three different network phases are concatenated and passed through multiple 2D convolutional layers 215 and nonlinear activations 216. Finally, the time-domain and time-frequency-domain latent space representations are concatenated 217 and passed through a 1D convolutional layer 218 and activations 219, with its hyperparameters selected so that the dimensionality of the output 220 matches the dimensionality of the encoder output.

[0030] Separator Network

[0031]

number

[0032] The separator network must learn the temporal features of the load and PV power generation. Therefore, to add a temporal learning mechanism, we propose to use a temporal convolutional network (TCN). This network consists of successive layers of stacked extended 1D TCN blocks, each consisting of a gated residual network. Within each successive layer, the TCN blocks are stacked, e.g., such that the extension factor continues to increase exponentially as a function of the number of stacked layers as the stack continues to get higher. The exponential increase of the extension factor is designed to ensure a sufficiently large temporal receptive field size to facilitate modeling of the long-term temporal features observed in the load and PV power generation time series. Conv-EDNet is a network with extension factors of 1, 2, 4, 8, …, 2. M-1The stacked sequence is then repeated R times consecutively (304, 305, and 306). A detailed representation of this design is shown in Figure 3A.

[0033] Each 1D TCN block is carefully designed using a gated linear unit (GLU) and residual learning architecture. A gating mechanism is introduced to mitigate the gradient vanishing problem during training via temporal backpropagation. We modify the GLU by incorporating TCN and residual learning into a new residual block, shown in Figure 3B. The overall combination helps address the gradient vanishing and degradation problems while adding a temporal learning component. Hereafter, this block will be addressed as the residual temporal GLU (RT-GLU) 320. The RT-GLU block has two outputs: a residual output 330 and a skip connection 331. The residual output of one RT-GLU block serves as the input to the next successive block. The skip connection outputs from the M stacked blocks of the R successive layers are summed (311) and passed to the final 1D convolutional layers 307 and 308 of the separator network. Here, the output channel count is selected as 2N, and the first and second sets of N channels form the weighting functions of the PV power generation and the inherent load, respectively.

[0034] To summarize, a concatenated coder output and a feature extractor network output 301 with dimension 2N×L are provided. Bottleneck convolutional layers 302 and 303 with B channels, kernel size K, and stride S generate an output of dimension B×L, where B < N. The first 1D convolutional layers 322 and 323 of the RT-GLU block change the input channel count from B321 to H322 while keeping the kernel size and stride fixed at K and S respectively. To ensure a fixed length L across all N channels, the outputs of the dilation convolutional layers 324 and 325 are padded. The final 1D convolutional layers 307 and 308 of all RT-GLU blocks are sized to generate an output of dimension B×L. In the proposed RT-GLU block, the output path 330 and the skip connection path 331 have the same dimension, but this is not essential and can be changed while adjusting hyperparameters. Finally, the final 1D convolutional layers 307 and 308 double the channel count to 2N to generate separate weight functions of the same dimension corresponding to PV power generation and the inherent load.

[0035] Decoder

[0036]

Number

[0037] Conv-EDNet+: Addition of Adversarial Learning to Convolutional Energy Disaggregation Network

[0038]

Number

[0039]

Number

[0040]

Number

[0041]

number

[0042] Training Conv-EDNet and Conv-EDNet+

[0043]

number

[0044]

number

[0045]

number

[0046] Post-disaggregation adjustment

[0047]

number

[0048] Case studies on Conv-EDNet and Conv-EDNet+ Numerical simulations are performed using Conv-EDNet and Conv-EDNet+. Due to the limited deployment of CPOW measurement units in distribution networks and privacy / security concerns, this type of data is not publicly available. Therefore, we rely on synthetic CPOW data obtained using Matlab-Simulink. Care has been taken to inject random noise into the synthetic data to reflect measurement errors and prevent the proposed disaggregation model from directly learning the synthetic network model.

[0049] FIG. 5B is a schematic diagram illustrating a distribution network structure for synthetic data generation according to an embodiment of the present disclosure.

[0050] As shown in Figure 5B, the constructed network model 500 includes a transmission network 510 and a substation 520 containing a CPOW-MU 521 connected to a distribution feeder 530 containing a 1MW PV generator 531 and residential loads 532. Currently, only one CPOW unit located at the feeder head is considered. The PV generator is rated at 1MW, and the peak aggregate demand is 15MW. A data sampling frequency of 3kHz is selected to meet the criteria for CPOW measurements. Next, a comprehensive synthetic dataset is obtained by considering different days of the week, different seasons, different cloud cover scenarios, and different network failure scenarios. The total training data spans 15 days, and the test data spans 5 days. Due to limited computational resource availability, we downsample the encoder input from 3kHz to 0.2kHz. However, to ensure accurate extraction of harmonic features, the feature extractor network is provided with 3kHz data without downsampling. The hyperparameters and their values ​​are shown in Figure 5C. All experiments are performed using an NVIDIA TitanX (Pascal) GPU with 12GB of RAM, using Python and Pytorch.

[0051] Here, we compare the performance of the Conv-EDNet and Conv-EDNet+ approaches with existing approaches: Conv-TasNet, proposed by Y. Luo et al. for audio source separation (see the Background section for details), and the denoising autoencoder (DAE-Net) method proposed by Kelly and W. Knottenbelt in their paper titled "Neural NILM: Deep neural networks applied to energy disaggregation" (Proceedings of the 2nd ACM International Conference on Embedded Systems for Energy-Efficient Built Environments, 2015, pp. 55–64). Models for these different methods are therefore calibrated, trained, and independently evaluated on CPOW data.

[0052] Figures 6A and 6B show the results under normal operation and PV generator fault conditions, respectively. Figure 7 shows performance metrics quantifying the predictions made by the four methods. These metrics include mean absolute error (MAE), root mean squared error (RMSE), and signal aggregate error (SAE). From Figure 7, we observe that the Conv-EDNet+ model outperforms all other compared methods, with Conv-EDNet being the second-best performing model. These results can be corroborated using Figure 6A, which shows predictions for a partly cloudy day with a cloudy-to-sunny transition. For load forecasting, similar and accurate predictions are observed for all compared methods, with Conv-EDNet+ predictions being closest to the ground truth. For PV forecasting, we observe that the Conv-EDNet and Conv-EDNet+ models can accurately detect the onset of PV generation. This may be due to the novel feature extraction module. It has improved PV power detection capabilities due to its reliance on irradiance and STFT-based harmonic features, which the remaining two methods lack, resulting in poorer performance and DAE-Net producing the least accurate results. For the rest of the PV power generation profiles, we find that Conv-EDNet+ significantly outperforms the compared methods.

[0053] Figure 6B shows forecasts for a partially cloudy winter day for a fault event in which a PV generator disconnects from the grid at noon. We observe that Conv-EDNet+, followed by Conv-EDNet with a slight time lag, can accurately detect the fault and immediately reduce PV power generation. Conv-TasNet and DAE-Net are slow to detect the fault. Therefore, even when CPOW data is used to train all approaches, Conv-EDNet and Conv-EDNet+ outperform conventional approaches. This demonstrates that the use of CPOW data combined with a dedicated network for time-frequency domain feature characterization leads to a dramatic increase in forecast accuracy.

[0054] ConvED-DAN: Combining Domain Adaptation with Conv-EDNet+ Due to the deployment of PV generators and the increasing complexity of operating such renewable energy-rich networks, accurately disaggregating measurements has become increasingly important. Model training requires diverse, detailed, labeled data for supervised deep learning networks. Collecting this detailed data is time-consuming, expensive, and often difficult to obtain from utilities due to privacy concerns. This disclosure presents a convolutional energy disaggregation network with domain adaptation (ConvED-DAN), an extension of our previously described Conv-EDNet+. Through the use of domain adaptation, the proposed energy disaggregation model can be trained using synthetic datasets but applied for predictions on real-world data.

[0055] Obtaining real-world field data is challenging in power system applications. Synthetically generated data is used to demonstrate deep learning applications for many power system applications. This data is primarily obtained using computer simulations, which may not represent the actual system. The size of the simulated data may not be adequate to ensure robust model training. To address this issue, we propose using domain adaptation, a subcategory of transfer learning. Here, training data is divided into two types: source domain data and target domain data. The source domain data is a detailed labeled dataset, while the target domain data consists primarily of training features rather than labels. Here, the synthetically generated data used to train the model is the source domain data. The unlabeled real-world data used to test the neural network model is the target domain data. Note that the source domain data and target domain data have the same feature space but different data distributions. Domain adaptation is suitable for energy disaggregation because the underlying task remains the same. The only difference is that the training data has a different distribution from the actual real-world data.

[0056]

number

[0057] Reusing discriminators to perform domain adaptation. In Conv-EDNet+, the network consists of a Conv-EDNet energy disaggregation model (generator 800) combined with a discriminator network 805 of a discriminator 830 to perform adversarial training. The generator 800 includes a feature extractor 821, an encoder 822, a separator network 823, and a decoder 824. To incorporate domain adaptation, we reuse the discriminator network to perform the task of domain adaptation. The underlying idea is that the discriminator uses a feature space instead of the disaggregated time series used in Conv-EDNet+ to adversarially train the model. The goal is to minimize the deviation between the source domain feature space and the target domain feature space. Figure 8 shows the reused Conv-EDNet+ model for performing the domain adaptation task. Since ground truth labels are available for the source domain data 810, we can calculate the mean squared error (MSE) prediction loss on the source domain data. However, we cannot do this because we assume that the target domain data 820 is unavailable. Therefore, we use an MSE loss function for the feature space to train the network parameters using the source domain data. The generator 800 is then updated using a weighted function corresponding to the MSE loss value for the source domain data and the MSE loss value for the feature space. The feature space MSE value aims to minimize the gap between the feature spaces of the source domain data 810 and the target domain data 820. Finally, the discriminator 830 is updated using a binary cross-entropy loss, which calculates the probability that the input feature space is obtained from either the source or target domain data.

[0058] Unlike Conv-EDNet+, the discriminator 830 for ConvED-DAN is primarily used to detect source and target domain data in feature space. Therefore, the discriminator does not need to be improved using time-based learning capabilities as shown for Conv-EDNet+. Therefore, we modify the discriminator to a simplified one consisting of successive fully connected layers with decreasing dimensionality. First, two successive fully connected layers are connected through an activation layer and a dropout layer. The activation function chosen is leaky ReLU. The final layer of the discriminator is a sigmoid activation function, which outputs the probability that the input data is from the source or target domain dataset. Finally, the output of the penultimate fully connected layer is used to calculate the feature space MSE loss.

[0059]

number

[0060] Figure 8 shows the framework of the ConvED-DAN model. The overall training algorithm is shown in Figure 9.

[0061] Test results for ConvED-DAN First, we begin by analyzing the data distribution. Here, since actual data is not available, we use data corresponding to the same day of the same month across two different years. The first year represents the source domain data, and the second year represents the target domain data.

[0062] Figure 10A shows the Kullback-Leibler (KL) divergence between the distributions of source domain data 1010 and target domain data 1020 for net load measurements. Figure 10B shows the KL divergence between the source domain 1030 and target domain 1040 for PV power generation data. Figure 10C shows the KL divergence between the source domain 1050 and target domain 1060 for characteristic load data.

[0063] From the above figure, we can notice a distribution shift between the target domain data and the source domain data, which validates the domain adaptation task. Next, we show the results of performing domain adaptation.

[0064] Figures 11A and 11B summarize the prediction results for disaggregated load and PV generation. First, we observe that the performance of the source domain data using a model trained on the source domain is superior. When a model is trained using source domain data and evaluated on target domain data, performance degrades. Second, when using domain adaptation (corresponding to the line labeled "Source → Target" in the figure), we observe a slight degradation in the performance of the domain-adapted model on the source domain data. However, when the target data is evaluated on the domain-adapted model, excellent predictions are obtained. This indicates that while domain adaptation slightly degrades performance on the source domain data, significant improvements are observed on the target domain data. In conclusion, training a model for domain adaptation involves a trade-off between performance on the source domain data and performance on minimizing the feature gap between the source and target domain data.

[0065] Finally, we visualize the effect of domain adaptation on the feature space. We extract the resulting feature space for the source and target domain data and reduce it to a two-dimensional space using t-distributed stochastic neighbor embedding (t-SNE).

[0066] FIG. 12A is a schematic diagram showing a visualization of a feature space using domain adaptation, where 1201 and 1202 represent the target domain data and the source domain data, respectively.

[0067] FIG. 12B is a schematic diagram showing a visualization of the feature space without domain adaptation, where 1210 and 1220 represent the target domain data and the source domain data, respectively.

[0068] As shown in FIG. 12A, by using domain adaptation, the feature spaces of the source domain data 1202 and the target domain data 1201 significantly overlap with each other.

[0069] Energy Disaggregation System for Electric Power Distribution Systems FIG. 13 is a block diagram illustrating an energy disaggregation system for a power distribution system 100, according to some embodiments of the present invention.

[0070] The energy disaggregation system 1300 includes a human machine interface (HMI) 1302 connectable to a keyboard 1311 and a pointing device / medium 1312, a processor 1310, a storage device 1320, a memory 1340, a network interface controller 1303 connectable to a network 1361 including a local area network and an internet network, a display interface 1304 connected to a display device 1364, an input interface 1305 connectable to an input device 1365, and a printer interface 1306 connectable to a printing device 1366.

[0071] The energy disaggregation system 1300 can receive electrical signals 195 indicating voltage and current measurements 166 of substations 175 or feeders 165 located in the distribution system 100, or regulation statuses 146 and 156 of renewable generation 145 and customer loads 155, via a network 1361 connected to the NIC 1303. The network 1361 is connected to an external system 1301. The external system 1301 can provide control signals to the metering devices 110 in the distribution system 100 or to controllers of generation 145 or load demand 155 for remote control of the metering devices and generation or load controllers. The energy disaggregation system 1300 can also provide the external system 1301 controlling status data (signals) via the network 1361 so that the external system 1301 can control metering, generation, or demand regulation actions located in the distribution system 100. In addition, the energy disaggregation system 1300 can be controlled from an external system 1301 by receiving control data (signals) of the energy disaggregation system 1300 via a network 1361.

[0072] Storage device 1320 includes historical load, generation, and net load data 1328 related to distribution system 100 and energy disaggregation system program module 1330. Input device / media 1365 may include a module that reads a program stored on a computer-readable recording medium (not shown). To perform energy disaggregation for distribution system 100, energy disaggregation system 1300 may receive distribution system 100 status data 166 from measurement devices 110 included in distribution system 100.

[0073] According to some embodiments of the present invention, distribution system 100 may include a substation (only the transformer secondary bus is shown in the figure), a set of feeders 165, a set of CPOW measurement devices 110, a set of renewable generators 145, and a set of customer loads 155. Energy disaggregation system 1300 uses interface 1303 to receive measured voltage and current data over network 1361 (a communications network). Memory 1340 may be loaded with a computer-executable program stored in storage 1320, the computer-executable program including historical data 1328 and an energy disaggregation system program (module) 1330 configured to perform energy disaggregation for distribution system 100.

[0074] The energy disaggregation system program (module) 1330 may include a data processing and harmonic spectrum extraction program module 113, an encoder network 117, a feature extractor network 116, a separator network 118, and a decoder network 119. At least one processor 1310 connected to the memory 1340 and the interface 1303 is used to execute the energy disaggregation system program 1330 loaded from the storage 1320. For example, if an anomalous frequency trajectory for the distribution system 100 is captured by the external system 1301, an energy disaggregation task may be triggered by the external system 1301 through the processor 1310. The energy disaggregation module 1330 further causes the processor 1310 to receive voltage and current CPOW data from measurements 195. Upon receiving these net load CPOW measurements from measurements 195, the energy disaggregation module 1330 first executes the data processing and harmonic spectrum extraction module 113 to prepare time-frequency domain features for disaggregation, and then the energy disaggregation module 1330 realizes separation of the intrinsic load and PV generation through its integrated sub-networks: decoder 119, separator network 118, feature extractor 116, and encoder 117 according to the time-frequency features generated by the data processing module 113. The processor 1310 then outputs disaggregation result data regarding the predicted renewable generation and intrinsic load for the distribution system 100 back to the external system 1301 through the NIC 1303. Then, based on the disaggregation result data, the external system 1301 can decide to flood renewable energy if an abnormal higher frequency is detected and to curtail load demand if an abnormal lower frequency is identified. The external system 1301 then transmits a corresponding regulation signal back to the generators 145 and loads 155 in the distribution system 100 .The interface (NIC) 1303 can also receive measurement signals 166 and updates 195 of generation adjustment status 146 and load adjustment status 156 from the distribution system 100 at preset intervals via the network 1361. In some cases, a command to initiate / perform a forecast of instantaneous renewable generation is sent to the energy disaggregation system 1300 using the keyboard 1311 or from the external system 1301 via the network 1361.

[0075] The above-described embodiments of the present disclosure may be implemented in any of numerous ways. For example, the embodiments may be implemented using hardware, software, or a combination thereof. If implemented in software, the software code may be executed on any suitable processor or collection of processors, whether the processors are provided in a single computer or distributed among multiple computers. Such a processor may be implemented as an integrated circuit having one or more processors in an integrated circuit component. However, the processor may be implemented using circuitry in any suitable format.

[0076] Also, the various methods or processes outlined herein may be coded as software executable on one or more processors employing any one of a variety of operating systems or platforms. Additionally, such software may be written using any of a number of suitable programming languages ​​and / or programming or scripting tools, and compiled as executable machine language code or intermediate code that runs on a framework or virtual machine. Typically, the functionality of the program modules may be combined or distributed as desired in various embodiments.

[0077] Also, embodiments of the present disclosure may be embodied as methods, examples of which are provided. The acts performed as part of the method may be ordered in any suitable way. Thus, while an example embodiment shows acts as sequential, embodiments may be constructed in which acts are performed in a different order than illustrated. Therefore, it is the object of the appended claims to cover all such variations and modifications as come within the true spirit and scope of the present disclosure.

[0078] Although the present disclosure has been described with reference to certain preferred embodiments, it should be understood that various other adaptations and modifications can be made within the spirit and scope of the present disclosure. It is, therefore, the object of the appended claims to cover all such variations and modifications as fall within the true spirit and scope of the present disclosure.

Claims

1. 1. A computer-implemented method for performing energy disaggregation of distribution system level net load measurements for a distribution system using continuous point-on-wave (CPOW) measurement units, the method using a processor coupled to instructions stored in memory that implement the method using neural networks, including an encoder network, a feature extractor, a separator network, and a decoder network, the instructions, when executed by the processor, perform steps of the method, the steps including: generating net load time series data from voltage and current measurements via the CPOW measurement unit; generating a compressed latent space representation from the net load time series data using the encoder network; transforming the net load time series data into the time-frequency domain using a short-time Fourier transform (STFT) method; passing time-domain context information comprising the transformed time-frequency domain representation of the net load time series data to said feature extractor trained to accurately extract harmonic features; using the separator network trained to assign weights to the compressed latent space representation to estimate two weight matrices to be multiplied by the output from the encoder network to learn the time characteristics of the specific load and photovoltaic (PV) generation; using the decoder network to convert the weighted compressed latent space representations corresponding to the characteristic loads and the PV generation into time domain representations from outputs of the encoder network and the separator network; and forecasting the intrinsic load and the PV generation at a distribution system level from the transformed time domain representations corresponding to the intrinsic load and the PV generation using a post-disaggregation regulation method.

2. The method of claim 1 , wherein the encoder network performs a one-dimensional (1D) convolution operation to transform the net load time series into the compressed latent space representation of net loads.

3. The method of claim 1 , wherein the feature extractor uses the STFT method to identify the harmonic features introduced into the distribution system by inverter-based PV generation.

4. the separator network learns the temporal features using a temporal convolutional network (TCN); The method of claim 1 , wherein the TCN comprises successive layers of stacked extended 1D TCN blocks, each of the stacked extended 1D TCN blocks consisting of a gated residual network.

5. The method of claim 4 , wherein the stacked expanded 1D TCN blocks are stacked on top of each other such that the expansion factor continues to increase exponentially as a function of the number of stacked layers.

6. The method of claim 5, wherein each 1D TCN block is a residual time-gated linear unit (RT-GLU) that incorporates TCN and residual learning into a new residual block.

7. 2. The method of claim 1 , wherein the decoder network uses a 1D transposed convolution to convert the weighted latent space representation back to a time-domain representation of the weighted latent space representation.

8. 2. The method of claim 1, wherein the post-disaggregation adjustment method is used to refine the disaggregated inherent load and PV generation values ​​around their predicted values ​​by minimizing a total weighted squared error to ensure that the difference between the disaggregated inherent load and the PV generation is equal to the net load measurement.

9. A discriminator is added to the reconfigured neural network as a generator to perform adversarial learning for energy disaggregation; the input of the discriminator is shuffled between a net load measurement and a net load determined based on the output of the generator; the generator is composed of the encoder network, the feature extractor, the separator network, and the decoder network; The method of claim 1 , wherein the input of the generator is actual measurement data from a CPOW unit.

10. the discriminator is a deeper network including convolutional layers for feature extraction, gated recurrent units (GRUs) for modeling the time characteristics of the net load, and successive stacked linear layers with decreasing dimensionality for outputting classification probabilities from the outputs of the GRUs; The method of claim 9 , wherein the probability indicates whether input data is the actual data from a CPOW unit or generated data from the generator.

11. the input of the discriminator is a feature space; The discriminator is trained with two different sources of pure load data, one data source being a source domain with intrinsic load and PV generation labels and the other data source being a target domain without intrinsic load and PV generation labels; The method of claim 9 , wherein during training, the deviation between the source domain feature space and the target domain feature space is minimized.

12. the discriminator is composed of successive fully connected layers with decreasing dimensionality, the final layer of the discriminator has a sigmoid activation function, The method of claim 11 , wherein the output of the sigmoid activation function is a probability of the input data being from a source domain dataset or a target domain dataset.

13. 1. An energy disaggregation system for performing energy disaggregation of distribution system level net load measurements for a distribution system using continuous point-on-wave (CPOW) measurement units, comprising: a network interface controller configured to receive measurement data of electrical signals indicative of voltage and current measurements of substations or feeders located in the distribution system; a memory configured to store instructions for implementing an energy disaggregation method using a neural network, the neural network including an encoder network, a feature extractor, a separator network, and a decoder network; a processor coupled to the memory, the processor configured to execute the instructions to perform steps of the energy disaggregation method, the steps comprising: generating a compressed latent space representation from a net load time series using the encoder network and the measurement data of the electrical signal; transforming the net load time series into the time-frequency domain using a short-time Fourier transform (STFT) method; passing the time-domain context information comprising the transformed time-frequency domain representation of the net load time series to said feature extractor trained to accurately extract harmonic features; using the separator network trained to assign weights to the compressed latent space representation to estimate two weight matrices to be multiplied by the output from the encoder network to learn the time characteristics of the specific load and photovoltaic (PV) generation; using the decoder network to convert the weighted compressed latent space representations corresponding to the characteristic loads and the PV generation into time domain representations from outputs of the encoder network and the separator network; and forecasting the inherent load and the PV generation at a distribution system level from the transformed time domain representations corresponding to the inherent load and the PV generation using a post-disaggregation regulation method.

14. 14. The energy disaggregation system of claim 13, wherein the encoder network performs a one-dimensional (1D) convolution operation to convert the net load time series into the compressed latent space representation of net load.

15. 14. The energy disaggregation system of claim 13, wherein the feature extractor uses the STFT method to identify the harmonic features introduced into the distribution system by inverter-based PV generation.

16. the separator network learns the temporal features using a temporal convolutional network (TCN); 14. The energy disaggregation system of claim 13, wherein the TCN comprises successive layers of stacked extended 1D TCN blocks, each of the stacked extended 1D TCN blocks consisting of a gated residual network.

17. 17. The energy disaggregation system of claim 16, wherein the stacked expanded 1D TCN blocks are stacked on top of each other such that an expansion factor continues to increase exponentially as a function of the number of stacked layers.

18. 18. The energy disaggregation system of claim 17, wherein each 1D TCN block is a residual time-gated linear unit (RT-GLU) that incorporates TCN and residual learning into a new residual block.

19. 14. The energy disaggregation system of claim 13, wherein the decoder network uses a 1D transpose convolution to convert the weighted latent space representation back to a time domain representation of the weighted latent space representation.

20. 14. The energy disaggregation system of claim 13, wherein the post-disaggregation adjustment method is used to refine the disaggregated inherent load and PV generation values ​​around their predicted values ​​by minimizing a total weighted squared error to ensure that the difference between the disaggregated inherent load and the PV generation is equal to the net load measurement.

21. A discriminator is added to the reconfigured neural network as a generator to perform adversarial learning for energy disaggregation; the input of the discriminator is shuffled between a net load measurement and a net load determined based on the output of the generator; the generator is composed of the encoder network, the feature extractor, the separator network, and the decoder network; The energy disaggregation system of claim 13 , wherein the input of the generator is actual measurement data from a CPOW unit.

22. the discriminator is a deeper network including convolutional layers for feature extraction, gated recurrent units (GRUs) for modeling the time characteristics of the net load, and successive stacked linear layers with decreasing dimensionality for outputting classification probabilities from the outputs of the GRUs; The energy disaggregation system of claim 21 , wherein the probability indicates whether input data is the measured data from a CPOW unit or generated data from the generator.

23. the input of the discriminator is a feature space; The discriminator is trained with two different sources of pure load data, one data source being a source domain with intrinsic load and PV generation labels and the other data source being a target domain without intrinsic load and PV generation labels; 22. The energy disaggregation system of claim 21, wherein during training, the deviation between the source domain feature space and the target domain feature space is minimized.

24. the discriminator is composed of successive fully connected layers with decreasing dimensionality, 24. The energy disaggregation system of claim 23, wherein a final layer of the discriminator is a sigmoid activation function, and an output of the sigmoid activation function is a probability that the input data is from the source domain data set or the target domain data set.

Images