A simple C# console application that demonstrates how to run and interact with LFM model locally for conversational AI.
- .NET 8.0 SDK
- A quantized LFM model in GGUF format (e.g.,
LFM2-350M-Q4_0.gguf
). GGUF files are available at HuggingFace. - NuGet dependencies (already included in the project):
- LLamaSharp (
0.25.0
) - LLamaSharp.Backend.Cpu (
0.25.0
)
- LLamaSharp (
- Clone the repo (or copy the project files):
git clone https://github.com/yourusername/LiquidLlamaSharp.git cd LiquidLlamaSharp
- Update Program.cs with the correct model path:
string modelPath = @"C:\models\LFM2-350M-Q4_0.gguf";
- Run the project:
cd LiquidLlamaSharp dotnet run --project LiquidLlamaSharp.csproj
You can also open the project with Visual Studio.