Popular repositories Loading

1. makllama makllama Public

   MaK(Mac+Kubernetes)llama - Running and orchestrating large language models (LLMs) on Kubernetes with macOS nodes.

   Go 42 3

2. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++ 3

3. containerd containerd Public

   Forked from containerd/containerd

   An open and reliable container runtime

   Go 1

4. cri cri Public

   Forked from virtual-kubelet/cri

   Go 1 1

5. ktransformers ktransformers Public

   Forked from kvcache-ai/ktransformers

   A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations

   Python 1

6. ollama ollama Public

   Forked from ollama/ollama

   Get up and running with Llama 3, Mistral, Gemma, and other large language models.

   Go