TorchServe

GPTKB entity

Statements (35)
Predicate Object
gptkbp:instanceOf model serving framework
gptkbp:developedBy gptkb:AWS
gptkb:PyTorch
gptkbp:documentation https://pytorch.org/serve/
gptkbp:feature gptkb:REST_API
gptkb:gRPC_API
logging
GPU support
metrics
multi-threading
batch inference
model versioning
multi-model serving
custom handlers
model archiver
model management API
scalable deployment
gptkbp:firstReleased 2020
https://www.w3.org/2000/01/rdf-schema#label TorchServe
gptkbp:integratesWith gptkb:Amazon_SageMaker
gptkb:Docker
gptkb:Kubernetes
gptkbp:license gptkb:Apache_License_2.0
gptkbp:openSource true
gptkbp:programmingLanguage gptkb:Java
gptkb:Python
gptkbp:repository https://github.com/pytorch/serve
gptkbp:supports gptkb:PyTorch_models
gptkb:TorchScript_models
gptkb:ONNX_models
gptkbp:usedFor model lifecycle management
deploying machine learning models
production inference
gptkbp:bfsParent gptkb:Meta_AI
gptkbp:bfsLayer 5