Pinned Loading

1. pytorch/serve pytorch/serve Public

   Serve, optimize and scale PyTorch models in production

   Java 4k 823

2. deepjavalibrary/djl-serving deepjavalibrary/djl-serving Public

   A universal scalable machine learning model deployment solution

   Java 182 59

3. triton-inference-server/server triton-inference-server/server Public

   The Triton Inference Server provides an optimized cloud and edge inferencing solution.

   Python 7.7k 1.4k

4. awslabs/multi-model-server awslabs/multi-model-server Public

   Multi Model Server is a tool for serving neural net models for inference

   Java 984 230

5. aws/deep-learning-containers aws/deep-learning-containers Public

   AWS Deep Learning Containers (DLCs) are a set of Docker images for training and serving models in TensorFlow, TensorFlow 2, PyTorch, and MXNet.

   Python 961 446

6. aws/sagemaker-inference-toolkit aws/sagemaker-inference-toolkit Public

   Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.

   Python 370 81