Commit Graph

  • b984f5ca08 Containerized build and socket activation docs main Andreas 2025-11-20 00:18:58 +01:00
  • 553d8659b7 Corrected implementation using coreOS systemd library Andreas 2025-11-20 00:18:07 +01:00
  • 86f433c0c2 Add systemd socket support; incomplete but works Andreas 2025-11-19 23:28:04 +01:00
  • 86e9b93c37 proxy,ui: add version endpoint and display version info in UI (#395) Ryan Steed 2025-11-17 18:43:47 +00:00
  • 3acace810f proxy: add configurable logging timestamp format (#401) Ryan Steed 2025-11-16 18:21:59 +00:00
  • 554d29e87d feat: enhance model listing to include aliases (#400) Ryan Steed 2025-11-15 22:35:26 +00:00
  • 3567b7df08 Update image in README.md for web UI section Benson Wong 2025-11-08 15:29:37 -08:00
  • 38738525c9 config.example.yaml: add modeline for schema validation Benson Wong 2025-11-08 15:08:55 -08:00
  • c0fc858193 Add configuration file JSON schema (#393) Benson Wong 2025-11-08 15:04:14 -08:00
  • b429349e8a add /ui/ to wol-proxy polling (#388) Benson Wong 2025-11-08 14:16:12 -08:00
  • eab2efd7b5 feat: improve llama.cpp base image tag for cpu (#391) Ryan Steed 2025-11-08 17:56:49 +00:00
  • 6aedbe121a cmd/wol-proxy: show a loading page for / (#381) Benson Wong 2025-11-03 22:37:06 -05:00
  • b24467ab89 fix: update containerfile user/group management commands (#379) Ryan Steed 2025-11-03 22:17:40 +00:00
  • 12b69fb718 proxy: recover from panic in Process.statusUpdate (#378) Benson Wong 2025-11-03 08:30:09 -05:00
  • f91a8b2462 refactor: update Containerfile to support non-root user execution and improve security (#368) Ryan Steed 2025-11-01 00:01:04 +00:00
  • a89b803d4a Stream loading state when swapping models (#371) Benson Wong 2025-10-29 00:09:39 -07:00
  • f852689104 proxy: add panic recovery to Process.ProxyRequest (#363) Benson Wong 2025-10-25 20:40:05 -07:00
  • e250e71e59 Include metrics from upstream chat requests (#361) Benson Wong 2025-10-25 17:38:18 -07:00
  • d18dc26d01 cmd/wol-proxy: tweak logs to show what is causing wake ups (#356) Benson Wong 2025-10-25 11:04:31 -07:00
  • 8357714421 ui: fix avg token/sec calculation on models page (#357) Benson Wong 2025-10-23 22:22:24 -07:00
  • c07179d6e2 cmd/wol-proxy: add wol-proxy (#352) Benson Wong 2025-10-20 20:55:02 -07:00
  • 7ff50631e0 Update README for setup instructions clarity [skip ci] Benson Wong 2025-10-19 14:55:23 -07:00
  • 9fc0431531 Clean up and Documentation (#347) [skip ci] Benson Wong 2025-10-19 14:53:13 -07:00
  • 6516532568 Add optional TLS support (#340) David Wen Riccardi-Zhu 2025-10-16 02:29:02 +00:00
  • d58a8b85bf Refactor to use httputil.ReverseProxy (#342) David Wen Riccardi-Zhu 2025-10-13 23:47:04 +00:00
  • caf9e98b1e Fix race conditions in proxy.Process (#349) Benson Wong 2025-10-13 16:42:49 -07:00
  • 539278343b ui: tweak vertical space for mobile (#343) Benson Wong 2025-10-10 10:05:36 -07:00
  • 00b738cd0f Add Macro-In-Macro Support (#337) Benson Wong 2025-10-06 22:57:15 -07:00
  • 70930e4e91 proxy: add support for user defined metadata in model configs (#333) Benson Wong 2025-10-04 19:56:41 -07:00
  • 1f6179110c proxy/config: add model level macros (#330) Benson Wong 2025-09-28 23:32:52 -07:00
  • 216c40b951 proxy/config: create config package and migrate configuration (#329) Benson Wong 2025-09-28 16:50:06 -07:00
  • 9e3d491c85 proxyToUpstream: add redirect with trailing slash to upstream endpoint (#322) Benson Wong 2025-09-25 16:43:00 -07:00
  • 1a84926505 proxy: add unload of single model (#318) Benson Wong 2025-09-24 20:53:48 -07:00
  • fc3bb716df UI styling / code improvements (#307) Oleg Shulyakov 2025-09-19 20:47:17 +03:00
  • c36986fef6 upstream handler support for model names with forward slash (#298) Benson Wong 2025-09-13 13:37:03 -07:00
  • 558801db1a Fix nginx proxy buffering for streaming endpoints (#295) Artur Podsiadły 2025-09-10 01:07:46 +02:00
  • b21dee27c1 Fix #288 Vite hot module reloading creating multiple SSE connections (#290) Benson Wong 2025-09-07 21:48:58 -07:00
  • f58c8c8ec5 Support llama.cpp's cache_n in timings info (#287) Benson Wong 2025-09-06 13:58:02 -07:00
  • 954e2dee73 Remove cmdStart from README [skip ci] Benson Wong 2025-09-04 11:57:28 -07:00
  • a533aec736 small tweak to example config Benson Wong 2025-09-01 21:26:58 -07:00
  • 97b17fc47d Add ${MODEL_ID} macro (#226) Brett Profitt 2025-09-02 00:21:37 -04:00
  • 2457840698 Update README.md [skip ci] Benson Wong 2025-08-28 23:44:37 -07:00
  • 7f55494151 Update README.md [skip ci] Benson Wong 2025-08-28 22:47:28 -07:00
  • 831a90d3b0 Add different timeout scenarios to Process.checkHealthEndpoint #276 (#278) Benson Wong 2025-08-28 22:03:14 -07:00
  • 977f1856bb add /completion endpoint (#275) Yandrik 2025-08-29 06:41:02 +02:00
  • 52b329f7bc Fix #277 race condition in ProcessGroup.ProxyRequest when swap=true Benson Wong 2025-08-28 21:38:36 -07:00
  • 57803fd3aa Support llama-server's /infill endpoint (#272) Benson Wong 2025-08-27 08:36:05 -07:00
  • c55d0cc842 Add docs for model.concurrencyLimit #263 [skip ci] Benson Wong 2025-08-22 16:08:37 -07:00
  • 7acbaf4712 Add connection status indicator in UI (#260) Benson Wong 2025-08-20 13:58:24 -07:00
  • fcc5ad135a UI: Allow editing of title (#246) Benson Wong 2025-08-17 09:42:06 -07:00
  • 305e5a0031 improve example config [skip ci] Benson Wong 2025-08-17 09:19:04 -07:00
  • 04fc67354a Improve Activity event handling in the UI (#254) Benson Wong 2025-08-15 21:44:08 -07:00
  • 4662cf7699 add 'unconfirmed bug' as default label in bug-report.md Benson Wong 2025-08-15 15:38:12 -07:00
  • 5dc6b3e6d9 Add barebones but working implementation of model preload (#209, #235) Benson Wong 2025-08-14 10:27:28 -07:00
  • 74c69f39ef Add prompt processing metrics (#250) Benson Wong 2025-08-14 10:02:16 -07:00
  • a186318892 Update Readme, Add screenshot for Activities page [skip ci] Benson Wong 2025-08-08 13:39:46 -07:00
  • c4e4d5e1e9 Update Readme UI Screenshot [skip ci] Benson Wong 2025-08-08 13:33:47 -07:00
  • 7985e94ba4 add tokens processed to ui models page Benson Wong 2025-08-08 11:05:36 -07:00
  • 74556c3a36 Update bug-report.md [skip ci] Benson Wong 2025-08-08 09:52:05 -07:00
  • 5c381e4b30 Add gofmt linting to ci Benson Wong 2025-08-07 20:19:56 -07:00
  • 10569ed546 Fix model alias usage in upstream path (#230) Benson Wong 2025-08-07 20:16:56 -07:00
  • 5b10b3c23f UI Tweaks (#228) Benson Wong 2025-08-07 11:07:03 -07:00
  • 45ea792a3a Fix UI panel not saving position correctly Benson Wong 2025-08-06 14:02:22 -07:00
  • 1bc2802353 fix panels not saving sizing state Benson Wong 2025-08-06 14:00:21 -07:00
  • 701476c0c4 Update README.md - remove contributor block [skip ci] Benson Wong 2025-08-06 11:11:47 -07:00
  • 5c63e0066c return models sorted by id in /v1/models (#222) Ben Greene 2025-08-06 12:04:52 -05:00
  • 8be5073c51 Fix typo (#223) [skip ci] Martin Garton 2025-08-06 18:02:38 +01:00
  • 6307bd3205 Add support for building Linux ARM64 binary in Makefile (#221) Aaron Ang 2025-08-05 16:26:06 -07:00
  • 558a72de17 UI Improvements (#219) Benson Wong 2025-08-03 17:49:13 -07:00
  • dc42cf366d Add config monitor support for k8s configmap. (#217) Leoyzen 2025-08-03 23:05:48 +08:00
  • ba0a81937a Update README.md (#216) Ryein Goddard 2025-08-01 19:48:09 -07:00
  • 574fdfabb4 UI improvements (#213) Benson Wong 2025-07-31 11:59:21 -07:00
  • 5172cb2e12 Update docs in Readme [skip ci] Benson Wong 2025-07-30 11:51:14 -07:00
  • 5672cb03fd Update github actions for notifying homebrew build (#212) Benson Wong 2025-07-30 11:29:03 -07:00
  • 0f583163f7 add /health (#211) Benson Wong 2025-07-30 10:37:10 -07:00
  • 7905fa9ea3 Update trigger-homebrew-update.yml [skip ci] Benson Wong 2025-07-30 10:13:49 -07:00
  • bbaf172956 add trigger to rebuild homebrew formula (#210) Ian Sebastian Mathew 2025-07-30 22:42:21 +05:30
  • fd50932dbc Decouple MetricsMiddleware from downstream handlers (#206) Benson Wong 2025-07-27 10:36:06 -07:00
  • 8c693e7fcf Add endpoint aliases for reranking models (#201) Gaël James 2025-07-24 17:32:47 +02:00
  • 8f2af26a41 fix stats on model page Benson Wong 2025-07-23 13:57:33 -07:00
  • 01d4838fb3 Fix token metrics parsing (#199) Benson Wong 2025-07-22 23:10:14 -07:00
  • accd65294b add contributors to README [skip ci] Benson Wong 2025-07-21 23:16:48 -07:00
  • 7472a25864 Update README.md [skip ci] Benson Wong 2025-07-21 23:08:19 -07:00
  • cce0bc6aa1 add guard to ensure ls-real-model-name is set in context Benson Wong 2025-07-21 22:59:41 -07:00
  • 36e25125e8 UI tidy [skip ci] Benson Wong 2025-07-21 22:47:55 -07:00
  • 9a54273d15 Update UI with new Activity event stream from #195 Benson Wong 2025-07-21 22:42:30 -07:00
  • 87dce5f8f6 Add metrics logging for chat completion requests (#195) g2mt 2025-07-21 22:19:55 -07:00
  • 307e619521 remove old eventsources from UI Benson Wong 2025-07-19 15:36:40 -07:00
  • 6299c1b874 Fix High CPU (#189) Benson Wong 2025-07-15 18:04:30 -07:00
  • a906cd459b Strip comments before macro expansion in config (#193) Yathi 2025-07-15 10:14:16 -07:00
  • 78b2bc3dbc add toggle to hide/show unlisted models (#187) Benson Wong 2025-07-02 16:14:20 -07:00
  • 6a058e4191 Change fsnotify to watch config directory instead of file Benson Wong 2025-07-02 10:22:39 -07:00
  • 1921e570d7 Add Event Bus (#184) Benson Wong 2025-07-01 22:17:35 -07:00
  • c867a6c9a2 Add name and description to v1/models list (#179) Benson Wong 2025-06-30 23:02:44 -07:00
  • 3bd1b23ce0 fix config hot-reload on k8s (#181) Leoyzen 2025-06-28 02:49:31 +08:00
  • 10606abf89 fix config hot-reload on macos (#180) srevn 2025-06-26 19:20:50 +03:00
  • fefd14903d improve log display and add a small stats table in ui (#178) Benson Wong 2025-06-25 12:27:49 -07:00
  • 717d64e336 update GUI image in README [skip ci] Benson Wong 2025-06-24 10:38:28 -07:00
  • 285191e655 Various UI improvements (#176) Benson Wong 2025-06-23 16:17:21 -07:00
  • 4236cec03a Add Filters to Model Configuration (#174) Benson Wong 2025-06-23 10:52:29 -07:00