Secure and Scalable Artificial Intelligence Platforms UsingMicroservices and Container Orchestration

Authors

Lloret Badiola Juan 
 AI Platform Engineer , United States

Keywords:

Artificial Intelligence, Microservices, Container Orchestration, Kubernetes, Scalable AI, Cloud-native Architecture

Synopsis

Purpose: This study investigates the development of secure, scalable artificial intelligence (AI) platforms using microservices architecture and container orchestration technologies.

Design/methodology/approach: Through a synthesis of prior research and architecture design patterns, this paper explores how container orchestration (e.g., Kubernetes) and microservices facilitate the flexible deployment of AI models in dynamic environments.

Findings: The integration of AI with microservices and orchestration platforms increases scalability, modularity, and resilience while enabling better resource utilization and streamlined updates.

Practical implications: These insights can be applied to designing robust, cloud-native AI platforms for industries requiring real-time learning, scalable deployment, and secure data handling.

Originality/value: This work offers a consolidated view of pre-2020 literature on microservices and orchestration in AI contexts, highlighting architectural best practices and gaps for future research.

 

References

(1) Casalicchio, E. (2018). Container orchestration: A survey. In Systems Modeling: Methodologies and Tools. Springer. https://doi.org/10.1007/978-3-319-92378-9_14

(2) Chakraborty, A., Ganguly, S., & Das, S. (2019). Architectural Pattern for Implementing XAI as a Service. Taylor & Francis. https://doi.org/10.1201/9781003592969-7

(3) Ciucu, R., Adochiei, F. C., Adochiei, I. R., & Argatu, F. (2019). Innovative DevOps for artificial intelligence. Scientific Bulletin of Electrical Engineering Faculty, 19(1), 73–80. https://doi.org/10.1515/sbeef-2019-0011

(4) Gummadi, V. P. K. (2019). Microservices architecture with APIs: Design, implementation, and MuleSoft integration. Journal of Electrical Systems, 15(4), 130–134. https://doi.org/10.52783/jes.9328

(5) Felstaine, E., & Hermoni, O. (2018). Machine Learning, Containers, Cloud Natives, and Microservices. In Artificial Intelligence for Autonomous Networks. Taylor & Francis.

(6) Guerrero, C., Lera, I., & Juiz, C. (2018). Resource optimization of container orchestration: A case study. Journal of Supercomputing, 74, 3490–3504. https://doi.org/10.1007/s11227-018-2345-2

(7) Khan, A. (2017). Key characteristics of a container orchestration platform. IEEE Cloud Computing, 4(5), 42–49. https://doi.org/10.1109/MCC.2017.4250932

(8) Rahman, J., & Lama, P. (2019). Predicting the end-to-end tail latency of containerized microservices. IEEE International Conference on Cloud Computing. https://doi.org/10.1109/CLOUD.2019.00078

(9) Rufino, J., Alam, M., & Ferreira, J. (2017). Orchestration of containerized microservices for IIoT using Docker. IEEE Conference on Emerging Technologies & Factory Automation. https://doi.org/10.1109/ETFA.2017.8247725

(10) Taherizadeh, S., Stankovski, V., & Grobelnik, M. (2018). A capillary computing architecture for dynamic IoT. Sensors, 18(9), 2938. https://doi.org/10.3390/s18092938

(11) Tien, C. W., Huang, T. Y., & Huang, T. C. (2019). KubAnomaly: Anomaly detection for the Docker orchestration platform. Engineering Reports, 1(2), e12080. https://doi.org/10.1002/eng2.12080

Published

April 19, 2021