Skip to content

@vllm-project vLLM

Change the repository type filter

All

    Repositories list

    17 repositories

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      amdcudainferencepytorchtransformerllamagptrocmmodel-servingtpu
      Python
      •
      Apache License 2.0
      •7.8k•49k•1.9k•696•Updated Jun 7, 2025Jun 7, 2025

    • vllm-ascend

      Public
      Community maintained hardware plugin for vLLM on Ascend
      inferencetransformermodel-servingmlopsascendllmllmopsllm-servingvllm
      Python
      •
      Apache License 2.0
      •183•723•150•68•Updated Jun 7, 2025Jun 7, 2025

    • production-stack

      Public
      vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization
      Python
      •
      Apache License 2.0
      •200•1.3k•56•32•Updated Jun 7, 2025Jun 7, 2025

    • aibrix

      Public
      Cost-efficient and pluggable Infrastructure components for GenAI inference
      Jupyter Notebook
      •
      Apache License 2.0
      •366•3.7k•165•15•Updated Jun 6, 2025Jun 6, 2025

    • llm-compressor

      Public
      Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
      sparsitycompressionquantization
      Python
      •
      Apache License 2.0
      •142•1.5k•50•29•Updated Jun 6, 2025Jun 6, 2025

    • vllm-spyre

      Public
      Community maintained hardware plugin for vLLM on Spyre
      Python
      •
      Apache License 2.0
      •16•24•12•11•Updated Jun 6, 2025Jun 6, 2025

    • vllm-openvino

      Public
      Python
      •
      Apache License 2.0
      •5•12•2•0•Updated Jun 5, 2025Jun 5, 2025

    • ci-infra

      Public
      This repo hosts code for vLLM CI & Performance Benchmark infrastructure.
      HCL
      •27•11•0•6•Updated Jun 5, 2025Jun 5, 2025

    • rfcs

      Public
      0•1•0•0•Updated Jun 3, 2025Jun 3, 2025

    • vllm-project.github.io

      Public
      HTML
      •16•11•0•0•Updated May 14, 2025May 14, 2025

    • flash-attention

      Public
      Fast and memory-efficient exact attention
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •1.7k•72•0•11•Updated May 3, 2025May 3, 2025

    • FlashMLA

      Public
      Cuda
      •
      MIT License
      •838•5•0•0•Updated Apr 23, 2025Apr 23, 2025

    • vllm-project.github.io-static

      Public archive
      HTML
      •
      MIT License
      •7•8•0•1•Updated Feb 7, 2025Feb 7, 2025

    • vllm_allocator_adaptor

      Public
      An adaptor to allow Python allocator for PyTorch pluggable allocator
      C++
      •
      Apache License 2.0
      •1•2•0•0•Updated Jan 5, 2025Jan 5, 2025

    • media-kit

      Public
      vLLM Logo Assets
      1•3•0•0•Updated Dec 12, 2024Dec 12, 2024

    • vllm-nccl

      Public archive
      Manages vllm-nccl dependency
      Python
      •
      Apache License 2.0
      •3•17•2•0•Updated Jun 3, 2024Jun 3, 2024

    • dashboard

      Public
      vLLM performance dashboard
      Python
      •
      Apache License 2.0
      •7•30•0•0•Updated Apr 26, 2024Apr 26, 2024