Smart generation control based on multi-agent reinforcement learning with the idea of the time tunnel

One of the significant solutions for hazy is to reduce carbon emission by introducing renewable energy on a large scale. However, the large-scale integration of new energy will result in stochastic disturbance to power grid. Therefore it becomes a top priority to make new energy compatible with power system. The PDWoLF-PHC(λ) based on the idea of time tunnel is to be proposed in this paper. Optimal strategy could be obtained by adopting the variable learning rate in a variety of complex operating environments, and thence it can deal with stochastic disturbance caused by massive integrations of new energy and distributed energy sources to the power grid, which is difficult for traditional centralized AGC. The proposed algorithm is simulated to be effective according to the improved IEEE standard two-area load-frequency control power system model and the Central China Power Grid model. Compared with the traditional smart ones, the proposed algorithm is characterized with faster convergence and stronger robustness, which makes it able to reduce carbon emission and enhance utilization rate of the new energy.