andreas/llama-swap
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
285191e655fdd0b68da6f248e0df0857b111dd87
llama-swap/misc
History
Benson Wong 4236cec03a Add Filters to Model Configuration (#174) 
llama-swap can strip specific keys in JSON requests. This is useful for removing the ability for clients to set sampling parameters like temperature, top_k, top_p, etc.
2025-06-23 10:52:29 -07:00
..
assets
Add /upstream endpoint (#30)
2024-12-17 14:37:44 -08:00
process-cmd-test
improve llama-swap upstream process recovery and restarts (#155)
2025-06-05 16:24:55 -07:00
simple-responder
Add Filters to Model Configuration (#174)
2025-06-23 10:52:29 -07:00
test-rerank
support v1/rerank endpoint
2024-12-17 21:22:25 -08:00