Pinned Loading

1. kubernetes-sigs/lws kubernetes-sigs/lws Public

   LeaderWorkerSet: An API for deploying a group of pods as a unit of replication

   Go 689 143

2. kubeflow/trainer kubeflow/trainer Public

   Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

   Go 2.1k 943

3. InftyAI/llmaz InftyAI/llmaz Public

   ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

   Go 292 45

4. llm-d/llm-d-inference-sim llm-d/llm-d-inference-sim Public

   A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual heavy models.

   Go 105 68

5. kubernetes-sigs/inference-perf kubernetes-sigs/inference-perf Public

   GenAI inference performance benchmarking tool

   Python 162 77

6. volcano-sh/volcano volcano-sh/volcano Public

   A Cloud Native Batch System (Project under CNCF)

   Go 5.4k 1.3k