Overview
Model serving overview
Tools for Serving
Serving of ML models in Kubeflow
KFServing
Model serving using KFServing
Seldon Core Serving
Model serving using Seldon
NVIDIA TensorRT Inference Server
Model serving with TRT Inference Server
TensorFlow Serving
Serving TensorFlow models
TensorFlow Batch Prediction
See Kubeflow v0.6 docs for batch prediction with TensorFlow models
Feedback
Was this page helpful?
Glad to hear it! Please tell us how we can improve.
Sorry to hear that. Please tell us how we can improve.
Last modified March 10, 2020: content i18n for zh (6c961064)