Oleg Bystrov, Ruslan Pacevič, Arnas Kačeniauskas

Cost‐ and performance‐aware resource selection for parallel software on heterogeneous cloud

  • Computational Theory and Mathematics
  • Computer Networks and Communications
  • Computer Science Applications
  • Theoretical Computer Science
  • Software
Save to CiteDrive Show PDF

SummaryCloud providers offer flexible infrastructures and on‐demand services, including the capability to deploy low cost virtual resources of many different types. However, the diversity of cloud resources followed by the important trade‐off between cost and performance makes the resource selection a challenging task for users in the case of parallel communication‐intensive software. The paper presents cost‐ and performance‐aware resource selection for parallel discrete element method (DEM) software as a service (SaaS) on heterogeneous OpenStack cloud. The developed resource selection uses preliminary application‐specific benchmarks of size smaller than targeted problems and the performance prediction based on speedup of parallel computations to obtain Pareto optimal solutions and to select the best configuration of containers from user's perspective. Hybrid parallelization of DEM software is developed by using OpenCL for shared‐memory multi‐core architectures and MPI for internode communications on distributed‐memory computer clusters. Round up and proportional pricing schemes are examined and compared from a user's perspective. Lower cost of computations obtained by using the proportional pricing scheme is always preferable for users. However, the difference approaches 1.0% of the cost calculated by using proportional pricing scheme, when long lasting computations are performed. The prediction tends to underestimate the execution time of DEM SaaS, but its accuracy is sufficient to obtain the same Pareto optimal solutions by using measured and predicted execution times. Pareto front and linear scalarization propose to select configurations of containers capable of exploiting higher memory bandwidth, which is specific to memory bandwidth bound DEM computations.

Need a simple solution for managing your BibTeX entries? Explore CiteDrive!

  • Web-based, modern reference management
  • Collaborate and share with fellow researchers
  • Integration with Overleaf
  • Comprehensive BibTeX/BibLaTeX support
  • Save articles and websites directly from your browser
  • Search for new articles from a database of tens of millions of references
Try out CiteDrive

More from our Archive