Articles

Machine learning operations (MLOps) comprises the practices, methods, and tooling that facilitate the deployment of reliable ML models in production environments. While many aspects of cloud data platforms are designed to enable reliability, only some managed ML services support the MLOps goals of continuous integration, continuous delivery, data lineage tracking, associated reproducibility, governance, and security. Furthermore, reliability encompasses not only the fulfillment of service-level objectives, but also systematic monitoring, alerting, and incident response automation. Architectural patterns are proposed to enable reliable deployment in cloud data platforms, focusing on the implementation of continuous integration and testing pipelines for ML models and the formulation of continuous delivery and rollout strategies. Continuous integration pipelines reduce the risk of regressions and ensure sufficient model performance at the time of deployment, while continuous delivery pipelines enable rapid updates to production models within acceptable risk profiles. The landscape of publicly available MLOps frameworks, tools, and services is also examined, emphasizing the pros and cons of established and rising solutions in containerization, orchestration, model serving, and inference. Containerization and orchestration contributes to the building of reliable deployment pipelines in cloud data platforms, whether general-purpose tools (e.g. Docker and Kubernetes) or solutions tailored for ML workloads. Containerized serving frameworks designed for high-throughput, low-latency inference can benefit a wide range of business applications, while auto-scaling and model versioning capabilities enhance the ease of use of cloud-native ML services.

The banking sector has shown a strong interest in scaling out and utilizing the microservices architectural pattern within their payments domain, not only to manage increased transaction volumes, but also for compliance and risk-related control. Financial organizations are adopting containerization technologies like Kubernetes and Docker to align with the microservices paradigm. Containerization provides the foundation for automation and operational excellence of microservice-based applications by enabling continuous deployment and automated build-test-release cycles. However, deploying a Kubernetes cluster and the services it hosts in production is not sufficient to guarantee a secure and compliant operating environment. Kubernetes itself should be secured to protect workloads, and risks associated with the services being deployed must be managed continuously.