Virtual power plant intelligent cooperative control system based on multi-granularity orthogonal random feature mapping
Through multi-grained orthogonal stochastic feature mapping and multi-head fusion attention structure, the problems of high computational complexity and insufficient prediction accuracy in the control system of virtual power plants are solved, efficient unified modeling and collaborative optimization of multiple time scales are achieved, and the control performance and expansion capabilities of virtual power plants are improved.
Patent Information
- Application Number
- CN202510717640.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-05-30
- Publication Date
- 2025-08-15
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The existing intelligent control methods of virtual power plants lack unified modeling and collaborative optimization for the full time scale, and the calculation complexity is high, making it difficult to meet the real-time control needs of large-scale systems, especially when dealing with virtual power plants control systems at multiple time scales.
The intelligent collaborative control system of virtual power plants based on multi-grained orthogonal stochastic feature map is adopted, including data processing, orthogonal stochastic feature map, multi-grained time scale characterization, multi-headed fusion attention structure, adaptive importance weighting and optimization strategy modules, and dynamic evaluation and optimization of different time scales are achieved through attention calculation of linear complexity and multi-grained time coding design.
It significantly reduces the computational complexity and memory consumption, improves prediction accuracy and model adaptability, and greatly reduces inference delays, meets the real-time control needs of virtual power plants, and significantly improves scalability and control effects.
Smart Images

Figure CN120497906A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of smart grid control technology, and in particular to a virtual power plant intelligent collaborative control system based on multi-granularity orthogonal random feature mapping. Background Art
[0002] As the power system transitions toward a low-carbon, decentralized, and intelligent future, the penetration of distributed energy resources (DERs), such as photovoltaic power generation, wind power generation, energy storage systems, and controllable loads, in distribution networks continues to increase. Virtual power plants (VPPs), as an innovative energy management model, use information technology to aggregate and coordinate the control of distributed DERs, enabling them to participate in power system operations and electricity market transactions as a whole. These efforts have become a key development direction for the Energy Internet. However, VPPs contain distributed resources of various types and timescales, posing significant challenges for their intelligent coordinated control. With the application of the Transformer architecture in time series forecasting, VPP control methods based on attention mechanisms have begun to attract attention. However, the existing virtual power plant control methods based on the attention mechanism still have the following key problems: First, the computational complexity of the self-attention mechanism in the traditional Transformer architecture is the quadratic length of the input sequence. When processing long sequences, the computational cost is high and the memory consumption is huge, making it difficult to apply to virtual power plant control systems that need to process multiple time scales simultaneously; Second, the existing methods lack an effective multi-time scale representation mechanism, making it difficult to simultaneously model changes in energy consumption patterns from the dynamic response of power electronic devices at the microsecond level to the seasonal level; Third, the importance of different time scales varies in different control scenarios, and the existing methods lack dynamic evaluation and adjustment capabilities; Fourth, the scale of virtual power plants continues to expand, and the existing methods face the problems of low training efficiency and slow inference speed in large-scale system applications.
[0003] In practical applications, virtual power plant control systems must simultaneously process time series data ranging from microseconds to seasonal levels. For example, the dynamic response of power electronics interfaces operates at microseconds to milliseconds, battery energy storage systems control charge and discharge at the second level, demand response operates at the minute to hour level, and energy consumption patterns fluctuate on daily, weekly, monthly, and even seasonal scales. Traditional approaches typically design control strategies for specific time scales, making it difficult to achieve cross-scale collaborative optimization.
[0004] Although the Transformer architecture can capture temporal dependencies through the attention mechanism, its quadratic computational complexity limits its application in large-scale multi-timescale systems.
[0005] Currently, research on intelligent control of virtual power plants (VPPs) both domestically and internationally focuses on optimizing decisions at a single or limited time scale, lacking unified modeling and collaborative optimization across all time scales. Furthermore, existing control methods face a sharp increase in computational complexity as VPPs scale and the number of distributed energy sources increases, making it difficult to meet real-time control requirements. To address these challenges, a collaborative VPP control approach is urgently needed that can efficiently process data at multiple time scales and possesses linear computational complexity. Summary of the Invention
[0006] In view of the shortcomings of the existing technology, the technical problem solved by the present invention is to provide a virtual power plant intelligent collaborative control system based on multi-granularity orthogonal random feature mapping, which solves the problem that the existing research on virtual power plant intelligent control mainly focuses on optimization decision-making at a single time scale or a limited number of time scales, and lacks unified modeling and collaborative optimization of all time scales.
[0007] To solve the above problems, the technical solution adopted by the present invention is: an intelligent collaborative control system for a virtual power plant based on multi-granularity orthogonal random feature mapping, comprising a data processing module, an orthogonal random feature mapping module, a multi-granularity time scale representation module, a multi-head fusion attention structure module, an adaptive importance weighting module, an optimization strategy module, and a decision output module; The data processing module is used to obtain multi-source heterogeneous data of the virtual power plant and perform preprocessing; the orthogonal random feature mapping module integrates the attention calculation mechanism of linear complexity; the multi-granularity time scale characterization module is used to establish hierarchical time features from microsecond level to seasonal level; the multi-head fusion attention structure module is used to process information of different time scales; the adaptive importance weighting module is used to dynamically evaluate and adjust the importance of different time scales; the optimization strategy module is used to optimize the calculation results; the decision output module is used to output the intelligent collaborative control decision of the virtual power plant based on the optimization results.
[0008] Furthermore, the orthogonal random feature mapping module is implemented by a feature mapping function, and the formula is as follows:
[0009] in, Represents a random orthogonal projection matrix, generated by QR decomposition, satisfying ; represents a random bias vector, ; represents the orthogonal activation function, ensuring ; represents the projection dimension; represents the Kronecker function, when 1 if yes, 0 otherwise.
[0010] Furthermore, the linear complexity attention calculation in the orthogonal random feature mapping module is as follows:
[0011] in, Represents query, key, and value matrices, with sizes , , ; represents the orthogonal kernel feature mapping function; represents a vector of all 1s; Represents the numerical stability factor, the value is .
[0012] This design converts the exponential dot product operation in the attention mechanism into an orthogonal random feature map, reducing its computational complexity from quadratic to linear while maintaining its expressive power.
[0013] Furthermore, the time encoding design formula in the multi-granularity time scale characterization module is as follows:
[0014] in, Indicates the Dimensional time coding; Indicates a point in time; represents the encoding dimension; represents the scale modulation function, which is expressed as:
[0015] in, represents the time scale parameter; represents a learnable parameter.
[0016] For different time scales, from microseconds to seasonal levels, specialized time encodings are designed and adjusted using a scale modulation function, γ(r), to form a hierarchical time representation. This design effectively captures the changing patterns of power systems at different time granularities, thereby improving the model's prediction accuracy and control effectiveness.
[0017] Furthermore, the basic multi-head attention design formula of the multi-head fusion attention structure module is as follows:
[0018]
[0019] in, Indicates the The parameter matrix of the head; represents the output projection matrix; Indicates the Time scale parameter of the head; Represents a hierarchical zoom operation; Indicates the number of attention heads; Represents the input features.
[0020] Furthermore, the hypernetwork parameter generation mechanism formula in the multi-head fusion attention structure module is as follows:
[0021] in, represents the hypernetwork parameter generator; Represents global context features; Represents the hypernetwork parameters.
[0022] The multi-head fusion attention structure module is implemented through MultiHeadFusedAttn(X), which designs specialized attention heads for different time scales and dynamically generates parameter matrices through the hypernetwork parameter generation mechanism.
[0023] Furthermore, the basic weighting mechanism formula of the adaptive importance weighting module is as follows:
[0024]
[0025] in, represents the global feature extraction function; Indicates the encoding of time scales; represents a multilayer perceptron; Indicates the Importance weight of size; Indicates the The output of an attention head; Indicates the The output projection matrix for each head.
[0026] The adaptive importance weighting module calculates the weights wᵢ of different attention heads, dynamically evaluates and adjusts the importance of different time scales, further improving the adaptability and accuracy of the model.
[0027] Furthermore, the optimization strategy module includes a mixed precision training strategy, the formula of which is as follows:
[0028]
[0029]
[0030] in, Indicates the dynamically adjusted scaling factor; Represents the operation of converting FP16 to FP32; Indicates original loss; represents the scaled loss; Represents the gradient in FP16 format; Represents gradients in FP32 format.
[0031] Furthermore, the optimization strategy module includes gradient accumulation and parameter sharding strategies, and the formula is as follows:
[0032]
[0033] in, Indicates the gradients of mini-batches; Indicates the cumulative number of steps; represents the learning rate; Indicates the Model parameters of the step; Indicates the The model parameters of the step.
[0034] The optimization strategy module includes mixed precision training strategy, gradient accumulation and parameter sharding strategy, parallel training strategy, and model compression and acceleration strategy. Through these technical means, efficient training and inference of large-scale models can be achieved to meet the real-time control requirements of virtual power plants.
[0035] Furthermore, the orthogonal random feature mapping module ensures the orthogonality of the projection matrix through regularization. The regularization loss formula is as follows:
[0036] in, represents the Frobenius norm; Represents the identity matrix.
[0037] The beneficial effects of this program are: The orthogonal random feature map module is implemented using a feature map function. This design transforms the exponential dot product operation in the attention mechanism into an orthogonal random feature map, reducing its computational complexity from quadratic to linear while maintaining expressiveness. The orthogonal random feature map ensures the orthogonality of the projection matrix through regularization.
[0038] The multi-granularity time scale representation module is implemented through a time encoding design, τᵢ(t). Specialized time encodings are designed for different time scales, from microseconds to seasonal levels, and adjusted using a scale modulation function, γ(r), to form a hierarchical time representation. This design effectively captures the variations in the power system at different time granularities, thereby improving the model's prediction accuracy and control effectiveness. The multi-granularity time scale covers ten different granularities, from microseconds to annual levels, comprehensively capturing the temporal characteristics of the power system. The multi-granularity time scale representation module simultaneously captures variations at different time scales, particularly modeling microsecond power fluctuations and seasonal variations, enabling more accurate predictions of system behavior. The RMSE for short-term predictions is reduced to 0.033, an improvement of over 42% compared to traditional solutions. This is primarily due to the orthogonal random features, which maintain linear complexity while preserving the model's expressive power through orthogonality. They even offer stronger feature extraction capabilities than the standard Transformer.
[0039] The multi-head fused attention architecture module, implemented through MultiHeadFusedAttn(X), designs specialized attention heads for different timescales and dynamically generates parameter matrices through a hypernetwork parameter generation mechanism. The adaptive importance weighting module dynamically evaluates and adjusts the importance of different timescales by calculating the weights wᵢ for different attention heads, further improving the model's adaptability and accuracy.
[0040] The optimization strategy module includes mixed precision training strategy, gradient accumulation and parameter sharding strategy, parallel training strategy, and model compression and acceleration strategy. Through these technical means, efficient training and inference of large-scale models can be achieved to meet the real-time control requirements of virtual power plants.
[0041] The proposed solution demonstrates exceptional computational efficiency, achieving an inference latency of only 0.8 milliseconds, a 97.8% reduction compared to traditional Transformer solutions and an 84.9% reduction compared to linear Transformer solutions. This achievement is primarily due to the orthogonal random feature mapping module, whose linear complexity attention mechanism reduces computational complexity from O(n²) to O(n). This module uses a carefully designed orthogonal projection matrix to map high-dimensional features to a low-dimensional space while preserving key information. The significant speed improvement, particularly in long sequence processing scenarios, fully demonstrates the method's exceptional ability to handle the massive time series data of virtual power plants.
[0042] This scheme reduces computational complexity through orthogonal random feature mapping, reducing the quadratic complexity of the traditional attention mechanism to a linear level, and improving computational efficiency by more than 90%; secondly, the linear complexity attention calculation mechanism reduces memory consumption, reducing memory usage by more than 80%; thirdly, the multi-granularity time scale representation can accurately capture the changing patterns at different time scales, and the prediction accuracy is improved by more than 30%; fourthly, the adaptive importance weighting mechanism enhances the model's adaptability to environmental changes, and the control effect is improved by more than 25%; fifthly, the optimization strategy module realizes efficient training and inference of large-scale models, and the training speed is increased by more than 50%; finally, the overall scheme has good scalability and can adapt to virtual power plants of different sizes and types, with the scalability increased by more than 40%.
[0043] By innovatively designing modules such as orthogonal random feature mapping, multi-granularity time representation, and multi-head fusion attention, the paper effectively solves technical problems such as high computational complexity, large memory consumption, insufficient prediction accuracy, and poor adaptability in the virtual power plant control system, significantly improving the performance and effect of the virtual power plant control system. It has important theoretical and practical value and can be widely used in the fields of smart grids and energy Internet. BRIEF DESCRIPTION OF THE DRAWINGS
[0044] Figure 1 This is a system architecture diagram of the virtual power plant intelligent collaborative control system based on multi-granularity orthogonal random feature mapping of the present invention; Figure 2 It is the overall flow chart of the present invention; Figure 3 Schematic diagram of the structure of the orthogonal random feature mapping module in the present invention; Figure 4 It is a hierarchical structure diagram of the multi-granularity time scale characterization module of the present invention; Figure 5 Schematic diagram of the collaborative work of the multi-head fusion attention structure module and the adaptive importance weighting module of the present invention; Figure 6 It is a functional structure diagram of the optimization strategy module implemented in the present invention. DETAILED DESCRIPTION
[0045] The following is further described in detail through specific implementation methods: Example 1 is basically as shown in the attached Figure 1-6 As shown: An intelligent collaborative control system for a virtual power plant based on multi-granularity orthogonal random feature mapping, comprising a data processing module, an orthogonal random feature mapping module, a multi-granularity time scale representation module, a multi-head fusion attention structure module, an adaptive importance weighting module, an optimization strategy module, and a decision output module; The data processing module is used to obtain multi-source heterogeneous data of the virtual power plant and perform pre-processing; it includes a data acquisition unit, a data processing unit, and a feature extraction unit; The data acquisition unit is used to collect multi-source heterogeneous data from the virtual power plant. This data includes the operating status data of various types of equipment within the virtual power plant, including the output power, irradiance, and temperature of the photovoltaic power generation system; the output power, wind speed, and wind direction of the wind power generation system; the state of charge, charge and discharge power, and remaining capacity of the energy storage system; the real-time power, power factor, and harmonic content of the power load; and key parameters such as voltage, frequency, and power flow on the grid side. The data acquisition equipment collects data at different sampling frequencies through various communication methods such as industrial Ethernet, wireless sensor networks, and power line carriers, thereby forming multi-scale time series data ranging from microseconds to seasonal levels. The data processing unit preprocesses the collected raw data, including outlier detection and processing, missing value imputation, and data standardization and normalization. Outliers are detected using an improved local anomaly factor algorithm and corrected for detected outliers in conjunction with the virtual power plant physical model. Missing values are imputed using linear interpolation (suitable for short timescales) and Gaussian process-based probabilistic interpolation (suitable for long timescales), depending on the timescale characteristics of the data.
[0046] The feature extraction unit is used to extract features and reduce the dimension of the pre-processed data. It uses a combination of principal component analysis (PCA) and adaptive wavelet transform to retain the key features of the data and reduce the dimension, thereby reducing the complexity of subsequent calculations. At the same time, the data is divided into microseconds (10 -6 seconds), milliseconds (10 -3 The paper presents a dataset of ten different time granularities, including time scale (1 second), second level (1 second), minute level (60 seconds), hour level (3600 seconds), day level (86400 seconds), week level (604800 seconds), month level (2592000 seconds), season level (7776000 seconds) and year level (31536000 seconds), to prepare for the subsequent multi-granularity time scale characterization.
[0047] like Figure 3 As shown in Figure 2, the orthogonal random feature mapping module integrates the attention calculation mechanism with linear complexity; constructs the orthogonal random feature mapping function, and generates the orthogonal projection matrix through QR decomposition to ensure the orthogonality between features. The orthogonal random feature mapping function is expressed as:
[0048] : Random orthogonal projection matrix, generated by QR decomposition, satisfies ; : random bias vector, ; : Orthogonal activation function, ensuring ; : projection dimension, which is set to 256 in this embodiment; : Kronecker function, when 1 when it is, otherwise 0; The specific steps to generate the orthographic projection matrix. First, randomly initialize the matrix , where the elements are sampled from a standard normal distribution. Then, Perform QR decomposition: ,in is an orthogonal matrix, is an upper triangular matrix. We take As an orthographic projection matrix In order to ensure numerical stability, an orthogonality regularization term is introduced: ,in represents the Frobenius norm.
[0049] In this embodiment, a combination of a sine function and a cosine function is used as an orthogonal activation function: (when is an odd number) or (when This design ensures good orthogonality between features of different dimensions, which helps to enhance the expressive power of the model.
[0050] Attention calculation with linear complexity is achieved based on orthogonal feature mapping; the traditional attention mechanism calculation formula is: , its computational complexity is ,in is the sequence length, is the feature dimension. Using orthogonal random feature maps, the attention calculation is reformulated as:
[0051] : query, key, and value matrices, with sizes , , ; : orthogonal kernel feature mapping function; : all-1 vector; : numerical stability factor, set to .
[0052] The linear complexity calculation of the attention mechanism is realized by approximating the kernel function. The exponential dot product kernel function in the traditional attention mechanism This can be approximated by an orthogonal random eigenmap: This approximation reduces the complexity of attention calculation from to , where is the projection dimension, which is usually much smaller than the sequence length .
[0053] As Figure 4 shown, the multi-granularity time-scale representation module is used to establish hierarchical time features from the microsecond level to the season level; it includes a time encoding generation unit and a hierarchical feature fusion unit; The time encoding generation unit realizes time encoding of different time scales through the following time encoding function , and the time encoding function is expressed as follows:
[0054] : The time encoding of the th dimension; : The time point; : The encoding dimension, set to 128; : The time scale parameter, corresponding to ten different time granularities respectively; : The scale modulation function Among them, the scale modulation function , which is used to adapt to time features of different granularities, is expressed as follows:
[0055] : Learnable parameters, with initial values set to 0.1 and 0 respectively The role of the scale modulation function is to dynamically adjust the frequency of time encoding according to the time scale , so that features of different time scales can be effectively distinguished in the same representation space. For a larger time scale (such as the season level), has a smaller value, making the time encoding change more slowly; for a smaller time scale (such as the microsecond level), has a larger value, making the time encoding change more rapidly.
[0056] And corresponding time encodings are generated for ten different time scales through the above function. The specific time scales include: microsecond level ( ), millisecond level ( ), second level ( ), minute level ( ), hour level ( ), day level ( ), week level ( ), month level ( ), season level ( ) and year level ( ). For each time scale , generate the corresponding time code:
[0057] The hierarchical feature fusion unit is used to fuse features of different time scales in an adaptive weighted manner:
[0058] Weight Calculated by multi-layer perceptron:
[0059] : Global temporal features, obtained by averaging the encodings of all time scales; : Multilayer perceptron, consisting of two hidden layers with dimensions of 64 and 32 respectively.
[0060] And for each time scale, design specialized feature enhancement functions , used to enhance key features at this time scale:
[0061] : A specialized feedforward neural network for time scales Optimize; : Layer normalization operation like Figure 5 As shown in the figure, the multi-head fusion attention structure module is used to process information at different time scales; it includes a basic multi-head attention mechanism construction unit, a hypernetwork parameter generation unit, a hierarchical scaling unit, an attention head specialization unit, and a cross-scale information interaction unit.
[0062] The basic multi-head attention mechanism building block extends the attention mechanism to a multi-head structure, where each attention head is responsible for a specific time granularity:
[0063]
[0064] : Input feature matrix, size is ; : No. The parameter matrix of each head has the following dimensions: , , ; : Output projection matrix, size is ; : No. Time scale parameter of the head ; : Layer scaling operations to improve training stability; : The number of attention heads is set to 10, corresponding to ten different time scales.
[0065] The hypernetwork parameter generation unit is used to enhance the expressive power of multi-head attention and uses the hypernetwork to dynamically generate parameters for attention heads of different time granularities:
[0066] : Hypernetwork parameter generator, implemented by multi-layer perceptron; : No. Time scale parameter of the head; : Global context features, by input features The specific structure of the hypernetwork is a three-layer fully connected network with hidden layer dimensions of 256, 512, and 256 respectively, and the activation function is GELU.
[0067] The hierarchical scaling unit performs hierarchical scaling operations using the following formula:
[0068] : Output of multi-head attention; : A learnable scaling parameter with an initial value of 0.1; : Hadamard product; : Original input. Improve training stability through layer scaling.
[0069] The attention head specialization unit is used to design specialized attention head structures for different time scales to enhance the ability to capture information at the corresponding scale. Specifically, for each time scale , design a specialized attention calculation function:
[0070] : Time scale specialization function, implemented by a single-layer fully connected network.
[0071] The cross-scale information interaction unit is used to capture the interdependence between different time scales. The cross-scale attention formula is as follows:
[0072] : No. The output of an attention head; : cross-scale projection matrix; : Feature dimension.
[0073] The adaptive importance weighting module is used to dynamically evaluate and adjust the importance of different time scales; it includes an adaptive importance evaluation unit, a global feature extraction unit, and a dynamic weight allocation unit; The importance evaluation unit dynamically evaluates the importance of different time scales through a multi-layer perceptron. The evaluation function is expressed as follows:
[0074] : Global feature extraction function, implemented through attention pooling; : No. encoding of time scales; : Multilayer Perceptron, consisting of two hidden layers with hidden layer dimensions of 128 and 64 respectively; : No. The importance weight of each time scale.
[0075] The global feature extraction unit extracts global features through the attention pooling mechanism. The global feature extraction function is as follows:
[0076]
[0077] : No. Characteristics of each location; : learnable parameters; : No. The attention weight of each position.
[0078] The dynamic weight allocation unit dynamically adjusts the weight allocation of different time scales based on the current input data characteristics; the weight allocation formula is as follows:
[0079] : No. The importance weight of each time scale; : No. The output of an attention head; : No. The output projection matrix for each head.
[0080] In order to avoid drastic fluctuations in weights at different time scales, a weight smoothing design is introduced. The weight smoothing formula is as follows:
[0081] : No. The original weight of the step; : No. The smoothed weight of the step; : No. The smoothed weight of the step; : Smoothing coefficient, set to 0.9.
[0082] In order to prevent the weight of a certain time scale from being too large, which leads to the neglect of information of other time scales, the weight regularization loss is introduced. The formula is as follows:
[0083] This is a negative entropy regularization term that encourages a more even distribution of weights and prevents them from being overly concentrated.
[0084] The optimization strategy module is used to optimize the calculation results; it includes a mixed precision training unit, a gradient accumulation and parameter sharding unit, a parallel training unit, and a model compression and acceleration unit; The mixed precision training unit uses mixed precision of FP16 and FP32 to reduce memory requirements and increase computing speed:
[0085]
[0086]
[0087] : Dynamically adjusted scaling factor, the initial value is set to 2048; : Convert FP16 to FP32.
[0088] Scaling Factor The dynamic adjustment strategy is: when the gradient overflow is detected, Halved; if there is no gradient overflow for 2000 consecutive steps, Doubled, the upper limit is 65536.
[0089] Reduce memory requirements through gradient accumulation and achieve distributed training through parameter sharding:
[0090]
[0091] : No. gradients of mini-batches; : Cumulative steps, set to 8; : Learning rate, the initial value is set to 0.0001, and cosine annealing is used for scheduling; : model parameters.
[0092] The gradient accumulation and parameter sharding unit evenly distributes model parameters across multiple computing devices, reducing the memory usage of a single device. During backpropagation, each device calculates the gradient of the corresponding parameter and then merges the gradients through collective communication operations (such as all-reduce).
[0093] The parallel training unit adopts a hybrid strategy of data parallelism and model parallelism, combined with pipeline parallelism to achieve efficient training and inference: Data parallelism: The training data is divided into multiple batches, and different batches are processed in parallel on different devices.
[0094] Model parallelism: Distributing different layers or parameters of a model across different devices.
[0095] Pipeline parallelism: The model is divided into multiple stages, different stages are executed on different devices, and the stages collaborate in a pipeline manner.
[0096] The specific implementation adopts an improved version of the GPipe algorithm and introduces the concept of micro-batches, which divides each large batch into multiple micro-batches. Different micro-batches are executed in parallel at different stages of the pipeline to improve equipment utilization.
[0097] The model compression and acceleration unit uses adaptive quantization and sparsification techniques to optimize inference performance: 8-bit quantization: quantize the model parameters from FP32 to INT8, and the weight quantization formula is ,in is the quantization scale factor.
[0098] Structured sparsity: Through L1 regularization and pruning techniques, the model parameters are induced to be sparse, and the sparsification loss function is ,in is the sparsification coefficient, set to 0.0001.
[0099] Knowledge distillation: Use the trained large model to guide the training of small models, such as the teacher model and the student model. The distillation loss function is , where KL represents the Kullback-Leibler divergence.
[0100] The decision output module is used to output the intelligent collaborative control decision of the virtual power plant based on the optimization results; it includes a prediction result integration unit and a control decision generation unit.
[0101] The prediction result integration unit is used to integrate the prediction results at multiple time scales. The prediction results at different time scales are weighted and fused to generate the final prediction result. The formula is as follows:
[0102] : No. Prediction results at different time scales; : No. Importance weights of time scales The control decision generation unit is used to formulate the collaborative control strategy of the virtual power plant based on the prediction results. The control strategy includes the power scheduling plan of the distributed energy unit, the charging and discharging plan of the energy storage equipment, the demand response strategy, the market transaction strategy, the fault warning and handling strategy, etc. The specific control decision generation adopts the mixed integer linear programming (MILP) method:
[0103]
[0104]
[0105]
[0106]
[0107] : Decision variables include the output power of each distributed energy unit, the charging and discharging power of the energy storage equipment, etc. : Objective function coefficient, which represents the cost or value of each decision variable; : inequality constraint matrix and vector; : equality constraint matrices and vectors; : Lower and upper bounds of decision variables; : A collection of indices of integer variables.
[0108] Considering the uncertainty of the prediction results, a robust optimization method is used to generate control decisions:
[0109]
[0110] : Uncertain parameters, such as load fluctuations, renewable energy output fluctuations, etc. : Uncertain set, defining the value range of uncertain parameters.
[0111] S7.4: Design the execution and feedback mechanism for control decisions. Distribute control decisions to each distributed energy unit, monitor the execution results in real time, and adjust the control strategy based on the feedback:
[0112] : No. Step control decision; : No. The system status of the step; : control objective function; : step size parameter; : The gradient of the objective function with respect to the control decision.
[0113] Outputs the final collaborative control decision for the virtual power plant. This includes: power scheduling time series for each distributed energy unit; charging and discharging plans for energy storage devices, including charging and discharging time, power, and capacity; demand response strategies, including load shaving and valley shifting; power market trading strategies, including trading time, power consumption, and price; and system fault warning and handling strategies, including fault type, probability, and response plan. Control decisions are output as visual charts and text reports for easy understanding and implementation by operators.
[0114] The above is only an embodiment of the present invention, and the common knowledge such as the specific structure and characteristics of the scheme is not described in detail here. It should be pointed out that for those skilled in the art, without departing from the structure of the present invention, several variations and improvements can be made, which should also be regarded as the scope of protection of the present invention, and these will not affect the effect of the implementation of the present invention and the practicality of the patent. The scope of protection required by this application shall be based on the content of its claims, and the specific implementation methods and other records in the specification can be used to interpret the content of the claims.
Claims
1. An intelligent collaborative control system for a virtual power plant based on multi-granularity orthogonal random feature mapping, characterized by: It includes data processing module, orthogonal random feature mapping module, multi-granularity time scale representation module, multi-head fusion attention structure module, adaptive importance weighting module, optimization strategy module and decision output module; The data processing module is used to obtain multi-source heterogeneous data of the virtual power plant and perform preprocessing; the orthogonal random feature mapping module integrates the attention calculation mechanism of linear complexity; The multi-granularity time scale characterization module is used to establish hierarchical time features from microseconds to seasonal levels; the multi-head fusion attention structure module is used to process information at different time scales; the adaptive importance weighting module is used to dynamically evaluate and adjust the importance of different time scales; the optimization strategy module is used to optimize the calculation results; and the decision output module is used to output the intelligent collaborative control decision of the virtual power plant based on the optimization results.
2. The intelligent collaborative control system for a virtual power plant based on multi-granularity orthogonal random feature mapping according to claim 1 is characterized by: The orthogonal random feature mapping module is implemented by a feature mapping function, and the formula is as follows: in, Represents a random orthogonal projection matrix, generated by QR decomposition, satisfying ; represents a random bias vector, ; represents the orthogonal activation function, ensuring ; represents the projection dimension; represents the Kronecker function, when 1 if yes, 0 otherwise.
3. The intelligent collaborative control system for a virtual power plant based on multi-granularity orthogonal random feature mapping according to claim 1 is characterized in that: The linear complexity attention calculation in the orthogonal random feature mapping module is calculated as follows: in, Represents query, key, and value matrices, with sizes , , ; represents the orthogonal kernel feature mapping function; represents a vector of all 1s; Represents the numerical stability factor, the value is .
4. The intelligent collaborative control system for a virtual power plant based on multi-granularity orthogonal random feature mapping according to claim 3 is characterized by: The time encoding design formula in the multi-granularity time scale representation module is as follows: in, Indicates the Dimensional time coding; Indicates a point in time; represents the encoding dimension; represents the scale modulation function, which is expressed as: in, represents the time scale parameter; represents a learnable parameter.
5. The intelligent collaborative control system for a virtual power plant based on multi-granularity orthogonal random feature mapping according to claim 1 is characterized in that: The basic multi-head attention design formula of the multi-head fusion attention structure module is as follows: in, Indicates the The parameter matrix of the head; represents the output projection matrix; Indicates the Time scale parameter of the head; Represents a hierarchical zoom operation; Indicates the number of attention heads; Represents the input features.
6. The intelligent collaborative control system for a virtual power plant based on multi-granularity orthogonal random feature mapping according to claim 1 is characterized in that: The formula for generating the hypernetwork parameters in the multi-head fusion attention structure module is as follows: in, represents the hypernetwork parameter generator; Represents global context features; Represents the hypernetwork parameters.
7. The intelligent collaborative control system for a virtual power plant based on multi-granularity orthogonal random feature mapping according to claim 1 is characterized by: The basic weighting mechanism formula of the adaptive importance weighting module is as follows: in, represents the global feature extraction function; Indicates the encoding of time scales; represents a multilayer perceptron; Indicates the Importance weight of size; Indicates the The output of an attention head; Indicates the The output projection matrix for each head.
8. The intelligent collaborative control system for a virtual power plant based on multi-granularity orthogonal random feature mapping according to claim 1 is characterized by: The optimization strategy module includes a mixed precision training strategy, and its formula is as follows: in, Indicates the dynamically adjusted scaling factor; Represents the operation of converting FP16 to FP32; Indicates original loss; represents the scaled loss; Represents the gradient in FP16 format; Represents gradients in FP32 format.
9. The intelligent collaborative control system for a virtual power plant based on multi-granularity orthogonal random feature mapping according to claim 1 is characterized in that: The optimization strategy module includes gradient accumulation and parameter sharding strategies, and its formula is as follows: in, Indicates the gradients of mini-batches; Indicates the cumulative number of steps; represents the learning rate; Indicates the Model parameters of the step; Indicates the The model parameters of the step.
10. The intelligent collaborative control system for a virtual power plant based on multi-granularity orthogonal random feature mapping according to claim 1 is characterized in that: The orthogonal random feature mapping module ensures the orthogonality of the projection matrix through regularization. The regularization loss formula is as follows: in, represents the Frobenius norm; Represents the identity matrix.