Benson Wong
f58c8c8ec5
Support llama.cpp's cache_n in timings info ( #287 )
...
Capture prompt cache metrics and surface them on Activities page in UI
2025-09-06 13:58:02 -07:00
Benson Wong
7acbaf4712
Add connection status indicator in UI ( #260 )
...
* show connection status as icon in UI title
* make connection status event driven
2025-08-20 13:58:24 -07:00
Benson Wong
fcc5ad135a
UI: Allow editing of title ( #246 )
...
- make <h1> title contentEditable
- title setting persists across reloads in localStorage
2025-08-17 09:42:06 -07:00
Benson Wong
04fc67354a
Improve Activity event handling in the UI ( #254 )
...
Improve Activity event handling in the UI
- fixes #252 found that the Activity page showed activity inconsistent
with /api/metrics
- Change data structure for event metrics to array.
- Add Event stream connections status indicator
2025-08-15 21:44:08 -07:00
Benson Wong
74c69f39ef
Add prompt processing metrics ( #250 )
...
- capture prompt processing metrics
- display prompt processing metrics on UI Activity page
2025-08-14 10:02:16 -07:00
Benson Wong
7985e94ba4
add tokens processed to ui models page
2025-08-08 13:28:39 -07:00
Benson Wong
5b10b3c23f
UI Tweaks ( #228 )
...
* sort model names in UI
* add toggle to show model id/name on UI model page
2025-08-07 11:07:03 -07:00
Benson Wong
1bc2802353
fix panels not saving sizing state
2025-08-06 14:00:21 -07:00
Benson Wong
558a72de17
UI Improvements ( #219 )
...
- use react-resizable-panels for UI
- improve icons for buttons
- improve mobile layout with drag/resize panels
2025-08-03 17:49:13 -07:00
Benson Wong
574fdfabb4
UI improvements ( #213 )
...
* use two column for logs view on wider screens
* hide log controls when panel is minimized
2025-07-31 11:59:21 -07:00
Benson Wong
8f2af26a41
fix stats on model page
2025-07-23 13:57:33 -07:00
Benson Wong
01d4838fb3
Fix token metrics parsing ( #199 )
...
Fix #198
- use llama-server's `timings` info if available in response body
- send "-1" for token/sec when not able to accurately calculate
performance
- optimize streaming body search for metrics information
2025-07-22 23:10:14 -07:00
Benson Wong
36e25125e8
UI tidy [skip ci]
2025-07-21 22:47:55 -07:00
Benson Wong
9a54273d15
Update UI with new Activity event stream from #195
...
- use new metrics data instead of log parsing
- auto-start events connection to server, improves responsiveness
- remove unnecessary libraries and code
2025-07-21 22:42:30 -07:00
g2mt
87dce5f8f6
Add metrics logging for chat completion requests ( #195 )
...
- Add token and performance metrics for v1/chat/completions
- Add Activity Page in UI
- Add /api/metrics endpoint
Contributed by @g2mt
2025-07-21 22:19:55 -07:00
Benson Wong
307e619521
remove old eventsources from UI
2025-07-19 15:36:40 -07:00
Benson Wong
78b2bc3dbc
add toggle to hide/show unlisted models ( #187 )
2025-07-02 16:14:20 -07:00
Benson Wong
1921e570d7
Add Event Bus ( #184 )
...
Major internal refactor to use an event bus to pass event/messages along. These changes are largely invisible user facing but sets up internal design for real time stats and information.
- `--watch-config` logic refactored for events
- remove multiple SSE api endpoints, replaced with /api/events
- keep all functionality essentially the same
- UI/backend sync is in near real time now
2025-07-01 22:17:35 -07:00
Benson Wong
fefd14903d
improve log display and add a small stats table in ui ( #178 )
2025-06-25 12:27:49 -07:00
Benson Wong
285191e655
Various UI improvements ( #176 )
...
* add retry/backoff to reconnecting log streams
* update favicons
2025-06-23 16:17:21 -07:00
Alex O'Connell
756193d0dd
Load models in the UI without navigating the page ( #173 )
...
* Load models in the UI without navigating the page
* fix table layout for mobile
2025-06-19 14:39:07 -07:00
Benson Wong
9a3c656738
New UI ( #157 , #164 )
...
- Add a react UI to replace the plain HTML one.
- Serve as a foundation for better GUI interactions
2025-06-16 16:45:19 -07:00
