Ray Serve

GPTKB entity

Statements (30)
Predicate Object
gptkbp:instanceOf gptkb:library
gptkbp:category model deployment
machine learning infrastructure
gptkbp:documentation https://docs.ray.io/en/latest/serve/index.html
gptkbp:firstReleased 2020
https://www.w3.org/2000/01/rdf-schema#label Ray Serve
gptkbp:integratesWith gptkb:TensorFlow
gptkb:Flask
gptkb:FastAPI
gptkb:PyTorch
gptkb:scikit-learn
gptkb:Hugging_Face_Transformers
right
gptkbp:license Apache 2.0
gptkbp:maintainedBy gptkb:Anyscale
gptkbp:openSource true
gptkbp:partOf right
gptkbp:programmingLanguage gptkb:Python
gptkbp:purpose model serving
scalable web serving
gptkbp:repository https://github.com/ray-project/ray
gptkbp:supports gptkb:REST_APIs
A/B testing
batch inference
multi-model serving
traffic splitting
deployment on Kubernetes
gptkbp:bfsParent gptkb:RLlib
gptkb:Ray_(distributed_computing)
gptkbp:bfsLayer 7