Benson Wong 70930e4e91 proxy: add support for user defined metadata in model configs (#333) ...

Changes: 

- add Metadata key to ModelConfig
- include metadata in /v1/models under meta.llamaswap key
- add recursive macro substitution into Metadata
- change macros at global and model level to be any scalar type

Note: 

This is the first mostly AI generated change to llama-swap. See #333 for notes about the workflow and approach to AI going forward.

2025-10-04 19:56:41 -07:00

3.1 KiB

Raw Blame History

View Raw