andreas/llama-swap
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

support v1/rerank endpoint

Browse Source
This commit is contained in:
Benson Wong
2024-12-17 21:22:25 -08:00
parent 9b4e3f307e
commit 9c8860471e
5 changed files with 42 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
misc/test-rerank/README.md Normal file
View File

@@ -0,0 +1,4 @@
The rerank-test.json data is from https://github.com/ggerganov/llama.cpp/pull/9510
To run it:
> curl http://127.0.0.1:8080/v1/rerank -H "Content-Type: application/json" -d @reranker-test.json -v | jq .