Obtaining a Continuous Time Markov Decision Process from Statecharts

This paper proposes a strategy to associate Statecharts with a Markov Decision Process for performance evaluation. Statecharts are adapted to represent the possible decision choices and the costs incurred from decisions. Markov Decision Process is used to evaluate the long term effects of decisions. This strategy can aid users without a good knowledge of the performance evaluation process, and may participate in a more effective way in the modeling phase, providing information to make a more realistic model.