Benson Wong f58c8c8ec5 Support llama.cpp's cache_n in timings info (#287) ...

Capture prompt cache metrics and surface them on Activities page in UI

2025-09-06 13:58:02 -07:00

..

.gitignore

New UI (#157, #164)

2025-06-16 16:45:19 -07:00

config_posix_test.go

Add barebones but working implementation of model preload (#209, #235)

2025-08-14 10:27:28 -07:00

config_test.go

Add ${MODEL_ID} macro (#226)

2025-09-01 21:21:37 -07:00

config_windows_test.go

Add metrics logging for chat completion requests (#195)

2025-07-21 22:19:55 -07:00

config.go

Add ${MODEL_ID} macro (#226)

2025-09-01 21:21:37 -07:00

discardWriter.go

Add barebones but working implementation of model preload (#209, #235)

2025-08-14 10:27:28 -07:00

events.go

Add barebones but working implementation of model preload (#209, #235)

2025-08-14 10:27:28 -07:00

helpers_test.go

Add barebones but working implementation of model preload (#209, #235)

2025-08-14 10:27:28 -07:00

logMonitor_test.go

Add Event Bus (#184)

2025-07-01 22:17:35 -07:00

logMonitor.go

Fix High CPU (#189)

2025-07-15 18:04:30 -07:00

metrics_middleware.go

Support llama.cpp's cache_n in timings info (#287)

2025-09-06 13:58:02 -07:00

metrics_monitor.go

Support llama.cpp's cache_n in timings info (#287)

2025-09-06 13:58:02 -07:00

process_test.go

Strip comments before macro expansion in config (#193)

2025-07-15 10:14:16 -07:00

process.go

Add different timeout scenarios to Process.checkHealthEndpoint #276 (#278)

2025-08-28 22:03:14 -07:00

processgroup_test.go

Fix #277 race condition in ProcessGroup.ProxyRequest when swap=true

2025-08-28 21:38:40 -07:00

processgroup.go

Fix #277 race condition in ProcessGroup.ProxyRequest when swap=true

2025-08-28 21:38:40 -07:00

proxymanager_api.go

Improve Activity event handling in the UI (#254)

2025-08-15 21:44:08 -07:00

proxymanager_loghandlers.go

Add Event Bus (#184)

2025-07-01 22:17:35 -07:00

proxymanager_test.go

add /completion endpoint (#275)

2025-08-28 21:41:02 -07:00

proxymanager.go

add /completion endpoint (#275)

2025-08-28 21:41:02 -07:00

sanitize_cors_test.go

Sanitize CORS headers (#85)

2025-04-01 08:43:53 -07:00

sanitize_cors.go

Sanitize CORS headers (#85)

2025-04-01 08:43:53 -07:00

ui_embed.go

New UI (#157, #164)

2025-06-16 16:45:19 -07:00