Resource management in multi-cloud scenarios via reinforcement learning

The concept of Virtualization of Network Resources, such as cloud storage and computing power, has become crucial to any business that needs dynamic IT resources. With virtualization, we refer to the migration of various tasks, usually performed by hardware infrastructures, to virtual IT resources. This approach allows resources to be rapidly deployed, scaled and dynamically reassigned. In the last few years, the demand of cloud resources has grown dramatically, and a new figure plays a key role: the Cloud Management Broker (CMB). The CMB purpose is to manage cloud resources to meet the user´s requirements and, at the same time, to optimize their usage. This paper proposes two multi-cloud resource allocation algorithms that manage the resource requests with the aim of maximizing the CMB revenue over time. The algorithms, based on Reinforcement Learning techniques, are evaluated and compared by numerical simulations.