Pinned Loading

1. llm-d/llm-d llm-d/llm-d Public

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell 3k 397

2. project-codeflare/codeflare project-codeflare/codeflare Public

   Simplifying the definition and execution, scaling and deployment of pipelines on the cloud.

   Jupyter Notebook 233 37

3. llm-d/llm-d-inference-scheduler llm-d/llm-d-inference-scheduler Public

   Inference scheduler for llm-d

   Go 163 153

4. llm-d/llm-d-benchmark llm-d/llm-d-benchmark Public

   llm-d benchmark scripts and tooling

   Python 55 66

5. foundation-model-stack/multi-nic-cni foundation-model-stack/multi-nic-cni Public

   Go 40 11