C# · llama.cpp

model-tray

Local LLM that loads on demand.

Open on GitHubAsk about it
model-tray screenshot
Open

source

How it works

Windows tray app serving llama.cpp behind an OpenAI-compatible endpoint. Open source.