Benson Wong 831a90d3b0 Add different timeout scenarios to Process.checkHealthEndpoint #276 (#278) ...

- add a TCP connection timeout of 500ms
- increase HTTP client timeout to 5000ms

In this new behaviour the upstream has 500ms to accept a tcp connection
and 5000ms to respond to the HTTP request.

2025-08-28 22:03:14 -07:00

..

.gitignore

New UI (#157, #164)

2025-06-16 16:45:19 -07:00

config_posix_test.go

Add barebones but working implementation of model preload (#209, #235)

2025-08-14 10:27:28 -07:00

config_test.go

Strip comments before macro expansion in config (#193)

2025-07-15 10:14:16 -07:00

config_windows_test.go

Add metrics logging for chat completion requests (#195)

2025-07-21 22:19:55 -07:00

config.go

Add barebones but working implementation of model preload (#209, #235)

2025-08-14 10:27:28 -07:00

discardWriter.go

Add barebones but working implementation of model preload (#209, #235)

2025-08-14 10:27:28 -07:00

events.go

Add barebones but working implementation of model preload (#209, #235)

2025-08-14 10:27:28 -07:00

helpers_test.go

Add barebones but working implementation of model preload (#209, #235)

2025-08-14 10:27:28 -07:00

logMonitor_test.go

Add Event Bus (#184)

2025-07-01 22:17:35 -07:00

logMonitor.go

Fix High CPU (#189)

2025-07-15 18:04:30 -07:00

metrics_middleware.go

Support llama-server's /infill endpoint (#272)

2025-08-27 08:36:05 -07:00

metrics_monitor.go

Add prompt processing metrics (#250)

2025-08-14 10:02:16 -07:00

process_test.go

Strip comments before macro expansion in config (#193)

2025-07-15 10:14:16 -07:00

process.go

Add different timeout scenarios to Process.checkHealthEndpoint #276 (#278)

2025-08-28 22:03:14 -07:00

processgroup_test.go

Fix #277 race condition in ProcessGroup.ProxyRequest when swap=true

2025-08-28 21:38:40 -07:00

processgroup.go

Fix #277 race condition in ProcessGroup.ProxyRequest when swap=true

2025-08-28 21:38:40 -07:00

proxymanager_api.go

Improve Activity event handling in the UI (#254)

2025-08-15 21:44:08 -07:00

proxymanager_loghandlers.go

Add Event Bus (#184)

2025-07-01 22:17:35 -07:00

proxymanager_test.go

add /completion endpoint (#275)

2025-08-28 21:41:02 -07:00

proxymanager.go

add /completion endpoint (#275)

2025-08-28 21:41:02 -07:00

sanitize_cors_test.go

Sanitize CORS headers (#85)

2025-04-01 08:43:53 -07:00

sanitize_cors.go

Sanitize CORS headers (#85)

2025-04-01 08:43:53 -07:00

ui_embed.go

New UI (#157, #164)

2025-06-16 16:45:19 -07:00