Benson Wong e250e71e59 Include metrics from upstream chat requests (#361) ...

* proxy: refactor metrics recording

- remove metrics_middleware.go as this wrapper is no longer needed. This
  also eliminiates double body parsing for the modelID
- move metrics parsing to be part of MetricsMonitor
- refactor how metrics are recording in ProxyManager
- add MetricsMonitor tests
- improve mem efficiency of processStreamingResponse
- add benchmarks for MetricsMonitor.addMetrics
- proxy: refactor MetricsMonitor to be more safe handling errors

2025-10-25 17:38:18 -07:00

..

config

Refactor to use httputil.ReverseProxy (#342)

2025-10-13 16:47:04 -07:00

.gitignore

New UI (#157, #164)

2025-06-16 16:45:19 -07:00

discardWriter.go

Add barebones but working implementation of model preload (#209, #235)

2025-08-14 10:27:28 -07:00

events.go

Add barebones but working implementation of model preload (#209, #235)

2025-08-14 10:27:28 -07:00

helpers_test.go

proxy/config: create config package and migrate configuration (#329)

2025-09-28 16:50:06 -07:00

logMonitor_test.go

Add Event Bus (#184)

2025-07-01 22:17:35 -07:00

logMonitor.go

Fix High CPU (#189)

2025-07-15 18:04:30 -07:00

metrics_monitor_test.go

Include metrics from upstream chat requests (#361)

2025-10-25 17:38:18 -07:00

metrics_monitor.go

Include metrics from upstream chat requests (#361)

2025-10-25 17:38:18 -07:00

process_test.go

Refactor to use httputil.ReverseProxy (#342)

2025-10-13 16:47:04 -07:00

process.go

Refactor to use httputil.ReverseProxy (#342)

2025-10-13 16:47:04 -07:00

processgroup_test.go

proxy/config: create config package and migrate configuration (#329)

2025-09-28 16:50:06 -07:00

processgroup.go

proxy/config: create config package and migrate configuration (#329)

2025-09-28 16:50:06 -07:00

proxymanager_api.go

Include metrics from upstream chat requests (#361)

2025-10-25 17:38:18 -07:00

proxymanager_loghandlers.go

Fix nginx proxy buffering for streaming endpoints (#295)

2025-09-09 16:07:46 -07:00

proxymanager_test.go

Include metrics from upstream chat requests (#361)

2025-10-25 17:38:18 -07:00

proxymanager.go

Include metrics from upstream chat requests (#361)

2025-10-25 17:38:18 -07:00

sanitize_cors_test.go

Sanitize CORS headers (#85)

2025-04-01 08:43:53 -07:00

sanitize_cors.go

Sanitize CORS headers (#85)

2025-04-01 08:43:53 -07:00

ui_embed.go

New UI (#157, #164)

2025-06-16 16:45:19 -07:00