Popular repositories Loading

1. studious-engine studious-engine Public

2. nanoGPT nanoGPT Public

   Forked from karpathy/nanoGPT

   The simplest, fastest repository for training/finetuning medium-sized GPTs.

   Python

3. llama2 llama2 Public

   focus on inference of llama

4. lightllm lightllm Public

   Forked from ModelTC/LightLLM

   LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

   Python

5. swiftLLM swiftLLM Public

   Forked from interestingLSY/swiftLLM

   A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of vLLM).

   Python

6. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python