From e2443251adb9e6f5e51f881b6d4bfaee72835a16 Mon Sep 17 00:00:00 2001 From: Benson Wong Date: Mon, 9 Dec 2024 19:14:49 -0800 Subject: [PATCH] update readme --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 591f99d..e997993 100644 --- a/README.md +++ b/README.md @@ -16,6 +16,7 @@ Features: - ✅ Run multiple models at once with `profiles` - ✅ Remote log monitoring at `/log` - ✅ Automatic unloading of models from GPUs after timeout +- ✅ Use any local server that provides an OpenAI compatible API (llama.cpp, vllm, tabblyAPI, etc) ## Releases