TensorFlow Serving

E457353

TensorFlow Serving is a flexible, high-performance system for deploying and serving machine learning models in production, particularly those built with TensorFlow.

All labels observed (2)

Label Occurrences
TensorFlow Serving canonical 6
ModelServer 1

How this entity was disambiguated

Statements (51)

Predicate Object
instanceOf TensorFlow ecosystem component
machine learning infrastructure software
model serving system
open-source software
architecture servable-based modular architecture
component Loader
Manager
ModelServer
linked to: TensorFlow Serving

Servable
Source
deploymentModel Docker container
Kubernetes
cloud virtual machines
on-premises servers
developer Google
documentation https://www.tensorflow.org/tfx/guide/serving
feature A/B testing support via multiple model versions
CPU-only serving support
GPU acceleration support
batching of inference requests
canary model deployment
dynamic model configuration
high-performance inference serving
hot model swapping without downtime
model lifecycle management
model rollback
monitoring hooks via custom servables
multi-model serving
production model deployment
versioned model management
goal provide flexible, high-performance serving of machine learning models in production
license Apache License 2.0
optimizedFor TensorFlow models in SavedModel format
partOf TensorFlow
programmingLanguage C++
Python
repository https://github.com/tensorflow/serving
supportsFramework Keras
TensorFlow
supportsLanguageBinding REST
gRPC
supportsModelFormat SavedModel
TensorFlow Hub module (via SavedModel)
linked to: TensorFlow Hub
supportsPlatform Docker-compatible platforms
Linux
supportsProtocol HTTP/JSON
gRPC binary protocol
useCase large-scale production ML systems
microservice-based ML APIs
online prediction
real-time inference

How these facts were elicited

Referenced by (7)

Full triples — surface form annotated when it differs from this entity's canonical label.

TensorFlow Extended usesLibrary TensorFlow Serving
TensorFlow Estimators compatibleWith TensorFlow Serving
TensorFlow ecosystem includesComponent TensorFlow Serving
TFX integratesWith TensorFlow Serving
Transform supports TensorFlow Serving
InfraValidator relatedTo TensorFlow Serving
TensorFlow Serving component ModelServer
linked to: TensorFlow Serving