ISA Interchange

Optimal Control in Microgrid Using Multi-Agent Reinforcement Learning

Written by ISA Transactions | May 11, 2015 2:42:37 PM

This post is an excerpt from the journal ISA Transactions.  All ISA Transactions articles are free to ISA members, or can be purchased from Elsevier Press.

Abstract: This paper presents an improved reinforcement learning method to minimize electricity costs on the premise of satisfying the power balance and generation limit of units in a microgrid with grid-connected mode. Firstly, the microgrid control requirements are analyzed and the objective function of optimal control for microgrid is proposed. Then, a state variable ‘‘Average Electricity Price Trend’’ which is used to express the most possible transitions of the system is developed so as to reduce the complexity and randomicity of the microgrid, and a multi-agent architecture including agents, state variables, action variables and reward function is formulated. Furthermore, dynamic hierarchical reinforcement learning, based on change rate of key state variable, is established to carry out optimal policy exploration. The analysis shows that the proposed method is beneficial to handle the problem of ‘‘curse of dimensionality’’ and speed up learning in the unknown large-scale world. Finally, the simulation results under JADE (Java Agent Development Framework) demonstrate the validity of the presented method in optimal control for a microgrid with grid-connected mode.

 Free Bonus! To read the full version of this ISA Transactions article, click here.

ISA membership entitles you to free access to all ISA Transactions articles plus a wealth of technical content, industry information, free webinars, training opportunities, program discounts, certification and licensure and professional networking.

Click here to join ISA ... learn, advance, succeed!

2006 Elsevier Science Ltd. All rights reserved.