Distributed TCL Control Using Load Aggregation and Power Shifting

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Controlling a heterogeneous population of Thermostatically Controlled Loads (TCLs) in power grids is challenging due to their unique and complex dynamics, large state action space, and the need to optimize multiple competing system-level objectives simultaneously, which existing centralized control methods struggle to address effectively.

Innovation Solution

A distributed control system comprising a central Load Aggregator Controller and building-level controllers, utilizing reinforcement learning and model predictive control, with an evolutionary strategy for policy updates, and modeling each TCL as a virtual battery to simplify the control problem and optimize grid-level objectives.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If centralized control methods are used to manage TCLs, then system-level objectives can be optimized, but the complexity of controlling heterogeneous TCLs with unique dynamics increases significantly

Engineering Contradiction:
Improvesystem-level objective optimizationVSAvoidcontrol system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The control system is segmented into a central Load Aggregator Controller that manages system-level objectives and building-level controllers that handle individual building TCLs. This segmentation allows the central controller to optimize aggregate demand without directly managing the complexity of each heterogeneous TCL, while building-level controllers handle local control tasks independently.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The Load Aggregator Controller acts as an intermediary between the utility company and individual building controllers. It aggregates predicted power demand from multiple buildings, applies convolutional filters to generate target load profiles, and distributes apportioned power shifts to building-level controllers, thereby mediating the control complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If individual building controllers manage their own TCLs independently, then local control flexibility is maintained, but aggregate power demand optimization across multiple buildings becomes difficult

Engineering Contradiction:
Improvelocal control flexibilityVSAvoidaggregate power demand optimization
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system merges individual building power demand predictions into an aggregate power demand profile at the Load Aggregator Controller. By combining data from multiple buildings and applying convolutional filters, the system optimizes aggregate demand while allowing each building to maintain its own control policies and flexibility through building-level controllers.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system implements feedback loops where building-level controllers report predicted power demand to the Load Aggregator Controller, which then distributes apportioned power shifts back to individual buildings. This feedback mechanism enables coordinated optimization while preserving local control autonomy.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If the control system processes detailed individual TCL dynamics, then accurate control is achieved, but the computational burden and data processing requirements increase

Engineering Contradiction:
Improvecontrol accuracyVSAvoidcomputational energy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system uses predicted power demand data as a simplified representation (copy) of complex TCL dynamics rather than processing full detailed models. Building-level controllers generate predicted power demand profiles that capture essential behavior without requiring complete dynamic models, reducing computational burden while maintaining sufficient control accuracy.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

Building-level controllers perform preliminary processing by generating predicted power demand profiles before sending data to the Load Aggregator Controller. This preliminary action filters and summarizes detailed TCL dynamics into manageable predictions, reducing the computational burden on the central system while preserving essential control information.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12027858B2Distributed control for demand flexibility in thermostatically controlled loads
Publication Date: 2024.07.02 ROBERT BOSCH GMBH
  • US12027858B2 patent drawing
  • US12027858B2 patent drawing
  • US12027858B2 patent drawing

AI summary

A computer implemented method for controlling a load aggregator for a grid includes receiving a predicted power demand over a horizon of time steps associated with one of at least two buildings, aggregating the predicted power demand at each time step to obtain an aggregate power demand, applying a learnable convolutional filter on the aggregate power demand to obtain a target load, computing a difference between the predicted power demand of the one building with the target load to obtain a power shift associated with the one building over the horizon of time steps, apportioning the power shift according to a learnable weighted vector to obtain an apportioned power shift, optimizing the learnable weighted vector and the learnable convolutional filter via an evolutionary strategy based update to obtain an optimized apportioned power shift, and transmitting the optimized apportioned power shift to a building level controller associated with the one building.