70930e4e91
Changes: - add Metadata key to ModelConfig - include metadata in /v1/models under meta.llamaswap key - add recursive macro substitution into Metadata - change macros at global and model level to be any scalar type Note: This is the first mostly AI generated change to llama-swap. See #333 for notes about the workflow and approach to AI going forward.
44 lines
1.6 KiB
Markdown
44 lines
1.6 KiB
Markdown
# Project: llama-swap
|
|
|
|
## Project Description:
|
|
|
|
llama-swap is a light weight, transparent proxy server that provides automatic model swapping to llama.cpp's server.
|
|
|
|
## Tech stack
|
|
|
|
- golang
|
|
- typescript, vite and react for UI (ui/)
|
|
|
|
## Testing
|
|
|
|
- `make test-dev` - Use this when making iterative changes. Runs `go test` and `staticcheck`. Fix any static checking errors.
|
|
- `make test-all` - runs at the end before completing work. Includes long running concurrency tests.
|
|
|
|
## Workflow Tasks
|
|
|
|
### Plan Improvements
|
|
|
|
Work plans are located in ai-plans/. Plans written by the user may be incomplete, contain inconsistencies or errors.
|
|
|
|
When the user asks to improve a plan follow these guidelines for expanding and improving it.
|
|
|
|
- Identify any inconsistencies.
|
|
- Expand plans out to be detailed specification of requirements and changes to be made.
|
|
- Plans should have at least these sections:
|
|
- Title - very short, describes changes
|
|
- Overview: A more detailed summary of goal and outcomes desired
|
|
- Design Requirements: Detailed descriptions of what needs to be done
|
|
- Testing Plan: Tests to be implemented
|
|
- Checklist: A detailed list of changes to be made
|
|
|
|
Look for "plan expansion" as explicit instructions to improve a plan.
|
|
|
|
### Implementation of plans
|
|
|
|
When the user says "paint it", respond with "commencing automated assembly". Then implement the changes as described by the plan. Update the checklist as you complete items.
|
|
|
|
## General Rules
|
|
|
|
- when summarizing changes only include details that require further action (action items)
|
|
- when there are no action items, just say "Done."
|