INTELLIGENT SERVICE ORCHESTRATION IN MICROSERVICES USING MACHINE LEARNING FOR DYNAMIC RESOURCE OPTIMIZATION

Authors

Harun Alves Hermoni
Research Fellow, AI and Edge Computing, France.

Keywords:

Microservices, Machine Learning, Resource Optimization, Service Orchestration, Edge Computing, Dynamic Scaling, Containerization, Reinforcement Learning

Synopsis

Purpose: This study investigates the integration of machine learning (ML) in orchestrating microservices to enhance resource allocation dynamically and intelligently in distributed computing environments.

Design/methodology/approach: A comprehensive approach combining reinforcement learning, predictive analytics, and orchestration tools like Kubernetes is used. The system monitors service load, anticipates spikes, and automates scaling using ML-based decisions.

Findings: ML-based orchestration improves resource efficiency by up to 30%, reduces latency, and enhances system scalability and adaptability under fluctuating workloads.

Practical implications: These findings support the deployment of ML-enhanced orchestrators in edge-cloud systems, enabling automated, cost-efficient service management for IoT, real-time analytics, and smart city platforms.

Originality/value: Unlike static orchestration, this work emphasizes adaptive, learning-based strategies, pioneering self-optimizing microservice environments.

 

References

[1] Guerrero, C., Lera, I., & Juiz, C. (2018). Resource optimization of container orchestration: a case study in multi-cloud microservices-based applications. Journal of Supercomputing. https://doi.org/10.1007/s11227-018-2345-2

[2] Gummadi, V. P. K. (2019). Microservices architecture with APIs: Design, implementation, and MuleSoft integration. Journal of Electrical Systems, 15(4), 130–134. https://doi.org/10.52783/jes.9328

[3] Yang, Z., Nguyen, P., & Jin, H. (2019). MIRAS: Model-based reinforcement learning for microservice resource allocation. IEEE 39th International Conference on Distributed Computing Systems. https://doi.org/10.1109/ICDCS.2019.00072

[4] Rodríguez-Gracia, D. et al. (2019). Microservices and machine learning for adaptive green buildings. Sustainability, 11(16), 4320. https://doi.org/10.3390/su11164320

[5] Harun, H. (2019). AI-Based Optimization of Resource Utilization. AIJCST Journal. https://aijcst.org/index.php/aijcst/article/view/13

[6] Gummadi, V. P. K. (2020). API design and implementation: RAML and OpenAPI specification. Journal of Electrical Systems, 16(4). https://doi.org/10.52783/jes.9329

[7] Alves, J.M. et al. (2019). ML4IoT: Orchestrating ML Workflows in IoT. IEEE Access. https://doi.org/10.1109/ACCESS.2019.2942603

[8] Magableh, B., & Almiani, M. (2019). Deep Q-learning for self-adaptive microservices. IEEE Access.

[9] Felstaine, E., & Hermoni, O. (2018). ML in Containers and Microservices. Taylor & Francis.

[10] Singhal, N., Sakthivel, U., & Raj, P. (2019). Orchestration vs. Choreography. Int. J. of Web Engineering.

[11] Wang, S. et al. (2019). Delay-aware microservice coordination. IEEE Transactions on Parallel and Distributed Systems.

[12] Taherizadeh, S. et al. (2018). A capillary architecture for dynamic orchestration. Sensors, 18(9), 2938. https://doi.org/10.3390/s18092938

Published

August 20, 2023