Artur Podsiadły 558801db1a Fix nginx proxy buffering for streaming endpoints (#295) ...

* Fix nginx proxy buffering for streaming endpoints

- Add X-Accel-Buffering: no header to SSE endpoints (/api/events, /logs/stream)
- Add X-Accel-Buffering: no header to proxied text/event-stream responses
- Add nginx reverse proxy configuration section to README
- Add tests for X-Accel-Buffering header on streaming endpoints

Fixes #236

* Fix goroutine cleanup in streaming endpoints test

Add context cancellation to TestProxyManager_StreamingEndpointsReturnNoBufferingHeader
to ensure the goroutine is properly cleaned up when the test completes.

2025-09-09 16:07:46 -07:00

..

.gitignore

New UI (#157, #164)

2025-06-16 16:45:19 -07:00

config_posix_test.go

Add barebones but working implementation of model preload (#209, #235)

2025-08-14 10:27:28 -07:00

config_test.go

Add ${MODEL_ID} macro (#226)

2025-09-01 21:21:37 -07:00

config_windows_test.go

Add metrics logging for chat completion requests (#195)

2025-07-21 22:19:55 -07:00

config.go

Add ${MODEL_ID} macro (#226)

2025-09-01 21:21:37 -07:00

discardWriter.go

Add barebones but working implementation of model preload (#209, #235)

2025-08-14 10:27:28 -07:00

events.go

Add barebones but working implementation of model preload (#209, #235)

2025-08-14 10:27:28 -07:00

helpers_test.go

Add barebones but working implementation of model preload (#209, #235)

2025-08-14 10:27:28 -07:00

logMonitor_test.go

Add Event Bus (#184)

2025-07-01 22:17:35 -07:00

logMonitor.go

Fix High CPU (#189)

2025-07-15 18:04:30 -07:00

metrics_middleware.go

Support llama.cpp's cache_n in timings info (#287)

2025-09-06 13:58:02 -07:00

metrics_monitor.go

Support llama.cpp's cache_n in timings info (#287)

2025-09-06 13:58:02 -07:00

process_test.go

Strip comments before macro expansion in config (#193)

2025-07-15 10:14:16 -07:00

process.go

Fix nginx proxy buffering for streaming endpoints (#295)

2025-09-09 16:07:46 -07:00

processgroup_test.go

Fix #277 race condition in ProcessGroup.ProxyRequest when swap=true

2025-08-28 21:38:40 -07:00

processgroup.go

Fix #277 race condition in ProcessGroup.ProxyRequest when swap=true

2025-08-28 21:38:40 -07:00

proxymanager_api.go

Fix nginx proxy buffering for streaming endpoints (#295)

2025-09-09 16:07:46 -07:00

proxymanager_loghandlers.go

Fix nginx proxy buffering for streaming endpoints (#295)

2025-09-09 16:07:46 -07:00

proxymanager_test.go

Fix nginx proxy buffering for streaming endpoints (#295)

2025-09-09 16:07:46 -07:00

proxymanager.go

add /completion endpoint (#275)

2025-08-28 21:41:02 -07:00

sanitize_cors_test.go

Sanitize CORS headers (#85)

2025-04-01 08:43:53 -07:00

sanitize_cors.go

Sanitize CORS headers (#85)

2025-04-01 08:43:53 -07:00

ui_embed.go

New UI (#157, #164)

2025-06-16 16:45:19 -07:00