A Hybrid and Secure Mechanism to Execute Parameter Survey Applications on Local and Public Cloud Resources

A parameter survey application (PSA) is a typical application running on high-performance computing (HPC) systems. A PSA consists of a lot of independent tasks with different input parameters that are executed in parallel on different CPU cores. Infrastructure-as-a-Service Cloud (IaaS Cloud) is expected to be used as an HPC infrastructure to run PSAs, and some reports have discussed hybrid execution mechanisms to utilize both local resources and IaaS Clouds. However, users still have security problems in running applications with confidential data on an IaaS Cloud. We propose a hybrid and secure execution mechanism to run PSAs utilizing both local computing resources with a batch scheduler and an IaaS Cloud. The proposed mechanism utilizes both local resources and IaaS Clouds to meet the deadline of user applications. We conducted experiments running a natural language processing application, which uses machine learning to detect abusive language on Internet bulletin board systems. The experimental results showed that the proposed mechanism effectively allocated resources and met the deadlines of the user application.