Aggregation Optimization of Distribution Feeder Areas Considering Electric-Heating Network Constraints: A Deep Reinforcement Learning Approach

The increasing integration of distributed electricity–heat adjustable resources into distribution networks poses significant challenges for virtual power plant (VPP) dispatch, as conventional aggregation models often neglect network constraints, leading to infeasible or unsafe operation plans. To address this issue, this paper proposes a source-grid-load-storage aggregation optimization method that explicitly incorporates both distribution network power flow constraints and district heating network hydraulic–thermal coupling constraints. The network constraints are integrated into the optimization objective as penalty terms, and the dispatch problem is formulated as a Markov decision process. A deep reinforcement learning framework, combining twin delayed deep deterministic policy gradient (TD3) and deep deterministic policy gradient (DDPG) algorithms, is employed to solve the sequential decision-making problem. Simulation results demonstrate that the proposed method effectively ensures distribution network security and heating quality while maintaining economic efficiency, providing a feasible and safe dispatch strategy for VPPs in coupled electricity–heat systems.