andreas/llama-swap
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
c36986fef6b0ea1fde3cfbf8c788dd9fa751ceeb
llama-swap/proxy/metrics_monitor.go
Benson Wong f58c8c8ec5 Support llama.cpp's cache_n in timings info (#287) 
Capture prompt cache metrics and surface them on Activities page in UI
2025-09-06 13:58:02 -07:00

2.0 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink