andreas/llama-swap
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Benson Wong
2025-02-08 10:26:11 -08:00
committed by GitHub
parent eab9795bcc
commit 7ac446e6a9
1 changed files with 1 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
README.md
View File

@@ -1,8 +1,6 @@
# llama-swap
![llama-swap header image](header.jpeg) ![llama-swap header image](header.jpeg)
# Introduction # llama-swap
llama-swap is a light weight, transparent proxy server that provides automatic model swapping to llama.cpp's server. llama-swap is a light weight, transparent proxy server that provides automatic model swapping to llama.cpp's server.
Written in golang, it is very easy to install (single binary with no dependancies) and configure (single yaml file). Written in golang, it is very easy to install (single binary with no dependancies) and configure (single yaml file).