• DocumentCode
    2169617
  • Title

    Applying SAQ-Learning Algorithm for Trading Agents in Bilateral Bargaining

  • Author

    Jamali, Saeed ; Faez, Karim

  • Author_Institution
    Dept. of Electr., Comput. & IT Eng., Islamic Azad Univ., Qazvin, Iran
  • fYear
    2012
  • fDate
    28-30 March 2012
  • Firstpage
    216
  • Lastpage
    222
  • Abstract
    In this research we use a learning method called SAQ-Learning to use for agents in a single-issue bargaining process. SAQ-Learning algorithm is an improved version of Q-Learning algorithm that benefits from the Metropolis criterion of Simulated Annealing (SA) algorithm to overcome the challenge of finding a balance between exploration and exploitation. Q-Learning is one the most important types of Reinforcement Learning (RL) because of the fact that it does not need the transition model of the environment. Artificial Intelligence (AI) approaches have attracted interest in solving bargaining problem. This is because Game Theory (GT) needs some unrealistic assumptions to solve bargaining problem. Presence of perfectly rational agents is an example of these assumptions. Therefore by designing SAQ-Learning agents to bargain with each other over price, we gained higher performance in case of settlement rate, average payoff, and the time an agent needs to find his optimal policy. This learning method can be a suitable learning algorithm for automated online bargaining agents in e-commerce.
  • Keywords
    electronic commerce; game theory; learning (artificial intelligence); negotiation support systems; pricing; simulated annealing; AI; GT; Metropolis criterion; Q-learning algorithm; RL; SA algorithm; SAQ-learning algorithm; artificial intelligence; automated online bargaining agents; average payoff; bilateral bargaining; e-commerce technologies; financial transactions; game theory; rational agents; reinforcement learning; settlement rate; simulated annealing algorithm; single-issue bargaining process; trading agents; Algorithm design and analysis; Games; Genetic algorithms; Humans; Learning systems; Pricing; Strontium; Bargaining; Negotiation; Q-Learning; Reinforcement Learning; Simulated Annealing;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Computer Modelling and Simulation (UKSim), 2012 UKSim 14th International Conference on
  • Conference_Location
    Cambridge
  • Print_ISBN
    978-1-4673-1366-7
  • Type

    conf

  • DOI
    10.1109/UKSim.2012.39
  • Filename
    6205452