Pinned Loading

1. sglang sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 24.9k 4.9k

2. sgl-learning-materials sgl-learning-materials Public

   Materials for learning SGLang

   779 60

3. ome ome Public

   Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

   Go 400 66

4. genai-bench genai-bench Public

   A Rust reimplementation of genai-bench for benchmarking LLM serving systems at high concurrency with accurate timing and industry-standard metrics

   Python 283 50

5. SpecForge SpecForge Public

   Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

   Python 736 186

6. sglang-jax sglang-jax Public

   JAX backend for SGL

   Python 251 76