DOI: 10.12688/f1000research.177203.2 ISSN: 2046-1402

Intelligent Cloud Resource Usage Potentially to Improve Task Scheduling by the use of Artificial Intelligence

Huda Mohammed Lateef, Mohammed Abduljawad Al-Shibly, Ahmed Hadi Ali AL-Jumaili, Omar D. Madeeh, Mohammed A.S. Al-Hitawi, Deshinta Arrova Dewi, Mohd Zakree bin Ahmad Nazri, Shaima Nasir Kadhim
Show PDF Cite
Background The high variability of workloads makes it very difficult for cloud datacenters to efficiently schedule their tasks and resource allocation. The correct forecasting of future resource utilization allows us to proactively scale and implement more sophisticated scheduling policies, which eventually results in has potential to improve resource utilization and fewer failures. Methods This study uses the Google Cluster Trace v3 dataset, which contains a wealth of job and task data (start and end times, CPU and memory usage, scheduling class, and priority) to create supervised machine and deep-learning models that can predict future of CPU usage. Conclusions This study evaluates Linear Regression (LR), Support Vector Regression (SVR), Random Forest (RF), and Neural Network (NN) models for predicting future CPU usage, which are quite successful in predicting computer resource usage (94% validation accuracy and R 2 of 0.90). These results underscore the potential of data driven approach definitely machine and deep learning-based CPU demand predictions as valuable tools for cloud schedulers, improving resource management, and reducing operational costs. Also discuss the feasibility of deploying the proposed solution on distributed platforms such as Spark and Google Cloud and outline future research directions to integrate predictive models with real-time cloud resource management.

More from our Archive