Benson Wong 8eb5b7b6c4 Add custom check endpoint ...

Replace previously hardcoded value for `/health` to check when the
server became ready to serve traffic. With this the server can support
any server that provides an an OpenAI compatible inference endpoint.

2024-10-11 21:59:21 -07:00

5.0 KiB

Raw Blame History

View Raw