• DocumentCode
    3524920
  • Title

    Reinforcement learning call control in variable capacity links

  • Author

    Pietrabissa, Antonio

  • Author_Institution
    Comput. & Syst. Sci. Dept. (DIS), Univ. of Rome Sapienza, Rome, Italy
  • fYear
    2010
  • fDate
    23-25 June 2010
  • Firstpage
    933
  • Lastpage
    938
  • Abstract
    This paper defines a Reinforcement Learning (RL) approach to call control algorithms in links with variable capacity supporting multiple classes of service. The novelties of the document are the following: i) the problem is modeled as a constrained Markov Decision Process (MDP); ii) the constrained MDP is solved via a RL algorithm by using the Lagrangian approach and state aggregation. The proposed approach is capable of controlling class-level quality of service in terms of both blocking and dropping probabilities. Numerical simulations show the effectiveness of the approach.
  • Keywords
    Aerospace electronics; Cost function; Load modeling; Markov processes; Numerical simulation; Sun; Time frequency analysis; Call Control; Communication Networks; Markov Decision Processes; Reinforcement Learning;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Control & Automation (MED), 2010 18th Mediterranean Conference on
  • Conference_Location
    Marrakech, Morocco
  • Print_ISBN
    978-1-4244-8091-3
  • Type

    conf

  • DOI
    10.1109/MED.2010.5547750
  • Filename
    5547750