andreas/llama-swap
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
326 Commits 1 Branch 0 Tags
b429349e8a3f58393bb91414e1ebb0c7258db6b2
Commit Graph

28 Commits

Author SHA1 Message Date
Benson Wong
8357714421 ui: fix avg token/sec calculation on models page (#357) 
* ui: use percentiles for token stats
* ui: add histogram of metrics
* update vite to remove security warnings

fixes #355
 2025-10-23 22:22:24 -07:00
Benson Wong
539278343b ui: tweak vertical space for mobile (#343) 2025-10-10 10:05:36 -07:00
Benson Wong
1a84926505 proxy: add unload of single model (#318) 
This adds a new API endpoint, /api/models/unload/*model, that unloads a single model. In the UI when a model is in a ReadyState it will have a new button to unload it. 

Fixes #312
 2025-09-24 20:53:48 -07:00
Oleg Shulyakov
fc3bb716df UI styling / code improvements (#307) 
Clean up and improve UI styling

* fix: UI - dependency cleanup
* chore: UI - start script
* refactor: UI - Extract Header
* fix: UI - Header styling
* fix: UI - LogViewer styling
* fix: UI - Models styling
* fix: UI - Activity styling
* fix: UI - ConnectionStatus colors
* review: UI - table border colors
 2025-09-19 10:47:17 -07:00
Benson Wong
b21dee27c1 Fix #288 Vite hot module reloading creating multiple SSE connections (#290) 
- move SSE (EventSource) connection to module level
- manage EventSource as a singleton, closing open connection before
  reopening a new one
 2025-09-07 21:48:58 -07:00
Benson Wong
f58c8c8ec5 Support llama.cpp's cache_n in timings info (#287) 
Capture prompt cache metrics and surface them on Activities page in UI
 2025-09-06 13:58:02 -07:00
Benson Wong
7acbaf4712 Add connection status indicator in UI (#260) 
* show connection status as icon in UI title
* make connection status event driven
 2025-08-20 13:58:24 -07:00
Benson Wong
fcc5ad135a UI: Allow editing of title (#246) 
- make <h1> title contentEditable
- title setting persists across reloads in localStorage
 2025-08-17 09:42:06 -07:00
Benson Wong
04fc67354a Improve Activity event handling in the UI (#254) 
Improve Activity event handling in the UI

- fixes #252 found that the Activity page showed activity inconsistent
  with /api/metrics
- Change data structure for event metrics to array.
- Add Event stream connections status indicator
 2025-08-15 21:44:08 -07:00
Benson Wong
74c69f39ef Add prompt processing metrics (#250) 
- capture prompt processing metrics
- display prompt processing metrics on UI Activity page
 2025-08-14 10:02:16 -07:00
Benson Wong
7985e94ba4 add tokens processed to ui models page 2025-08-08 13:28:39 -07:00
Benson Wong
5b10b3c23f UI Tweaks (#228) 
* sort model names in UI

* add toggle to show model id/name on UI model page
 2025-08-07 11:07:03 -07:00
Benson Wong
1bc2802353 fix panels not saving sizing state 2025-08-06 14:00:21 -07:00
Benson Wong
558a72de17 UI Improvements (#219) 
- use react-resizable-panels for UI
- improve icons for buttons
- improve mobile layout with drag/resize panels
 2025-08-03 17:49:13 -07:00
Benson Wong
574fdfabb4 UI improvements (#213) 
* use two column for logs view on wider screens

* hide log controls when panel is minimized
 2025-07-31 11:59:21 -07:00
Benson Wong
8f2af26a41 fix stats on model page 2025-07-23 13:57:33 -07:00
Benson Wong
01d4838fb3 Fix token metrics parsing (#199) 
Fix #198

- use llama-server's `timings` info if available in response body
- send "-1" for token/sec when not able to accurately calculate
  performance
- optimize streaming body search for metrics information
 2025-07-22 23:10:14 -07:00
Benson Wong
36e25125e8 UI tidy [skip ci] 2025-07-21 22:47:55 -07:00
Benson Wong
9a54273d15 Update UI with new Activity event stream from #195 
- use new metrics data instead of log parsing
- auto-start events connection to server, improves responsiveness
- remove unnecessary libraries and code
 2025-07-21 22:42:30 -07:00
g2mt
87dce5f8f6 Add metrics logging for chat completion requests (#195) 
- Add token and performance metrics  for v1/chat/completions 
- Add Activity Page in UI
- Add /api/metrics endpoint

Contributed by @g2mt
 2025-07-21 22:19:55 -07:00
Benson Wong
307e619521 remove old eventsources from UI 2025-07-19 15:36:40 -07:00
Benson Wong
78b2bc3dbc add toggle to hide/show unlisted models (#187) 2025-07-02 16:14:20 -07:00
Benson Wong
1921e570d7 Add Event Bus (#184) 
Major internal refactor to use an event bus to pass event/messages along. These changes are largely invisible user facing but sets up internal design for real time stats and information.

- `--watch-config` logic refactored for events
- remove multiple SSE api endpoints, replaced with /api/events
- keep all functionality essentially the same
- UI/backend sync is in near real time now
 2025-07-01 22:17:35 -07:00
Benson Wong
fefd14903d improve log display and add a small stats table in ui (#178) 2025-06-25 12:27:49 -07:00
Benson Wong
285191e655 Various UI improvements (#176) 
* add retry/backoff to reconnecting log streams
* update favicons
 2025-06-23 16:17:21 -07:00
Benson Wong
4236cec03a Add Filters to Model Configuration (#174) 
llama-swap can strip specific keys in JSON requests. This is useful for removing the ability for clients to set sampling parameters like temperature, top_k, top_p, etc.
 2025-06-23 10:52:29 -07:00
Alex O'Connell
756193d0dd Load models in the UI without navigating the page (#173) 
* Load models in the UI without navigating the page

* fix table layout for mobile
 2025-06-19 14:39:07 -07:00
Benson Wong
9a3c656738 New UI (#157, #164) 
- Add a react UI to replace the plain HTML one. 
- Serve as a foundation for better GUI interactions
 2025-06-16 16:45:19 -07:00