Title :
Cost dependent strategy for electricity markets bidding based on adaptive reinforcement learning
Author :
Pinto, Tiago ; Vale, Zita ; Rodrigues, Fátima ; Praça, Isabel ; Morais, Hugo
Author_Institution :
GECAD - Knowledge Eng. & Decision-Support Res. Center, Polytech. of Porto (ISEP/IPP), Porto, Portugal
Abstract :
Electricity markets are complex environments, involving a large number of different entities, playing in a dynamic scene to obtain the best advantages and profits. MASCEM is a multi-agent electricity market simulator to model market players and simulate their operation in the market. Market players are entities with specific characteristics and objectives, making their decisions and interacting with other players. MASCEM provides several dynamic strategies for agents´ behavior. This paper presents a method that aims to provide market players with strategic bidding capabilities, allowing them to obtain the higher possible gains out of the market. This method uses a reinforcement learning algorithm to learn from experience how to choose the best from a set of possible bids. These bids are defined accordingly to the cost function that each producer presents.
Keywords :
learning (artificial intelligence); power markets; MASCEM; adaptive reinforcement learning; electricity markets bidding; market players; multi-agent electricity market simulator; strategic bidding; Adaptation models; Cost function; Electricity supply industry; Generators; Learning; Production; Simulated annealing; Bidding Strategies; Electricity Markets; Multiagent Simulation; Reinforcement Learning; Simulated Annealing;
Conference_Titel :
Intelligent System Application to Power Systems (ISAP), 2011 16th International Conference on
Conference_Location :
Hersonissos
Print_ISBN :
978-1-4577-0807-7
Electronic_ISBN :
978-1-4577-0808-4
DOI :
10.1109/ISAP.2011.6082167