Science Publications

Sign Up
Sign In
Submit
Journal of Artificial Intelligence and Big Data
Download PDF XML
  1. Home
  2. Journals
  3. Journal of Artificial Intelligence and Big Data
  4. Archive
  5. Volume 3, Number 1, 2023
  6. Article
  7. Table 1

MLOps Frameworks for Reliable Model Deployment in Cloud Data Platforms

Table 1.

Observed Reliability and Performance Metricsfor ML Inference Services
Metric Value
Availability 0.96875
Latency p50 (ms) 45.60916859994713
Latency p95 (ms) 83.27928987399044
Latency p99 (ms) 112.2915089738782
Avg throughput (req/min) 872.2756944444444