Pinned Loading

1. SpecForge SpecForge Public

   Forked from sgl-project/SpecForge

   Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

   Python

2. variantGPT variantGPT Public

   Python

3. NVIDIA/TensorRT-LLM NVIDIA/TensorRT-LLM Public

   TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…

   C++ 11.9k 1.8k

4. sgl-project/SpecForge sgl-project/SpecForge Public

   Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

   Python 438 99