4 Commits

Author	SHA1	Message	Date
Benson Wong	8eb5b7b6c4	Add custom check endpoint ... Replace previously hardcoded value for `/health` to check when the server became ready to serve traffic. With this the server can support any server that provides an an OpenAI compatible inference endpoint.	2024-10-11 21:59:21 -07:00
Benson Wong	d682589fb1	support environment variables	2024-10-04 11:55:27 -07:00
Benson Wong	bfdba43bd8	improve error handling	2024-10-04 10:55:02 -07:00
Benson Wong	b63b81b121	first commit	2024-10-03 20:20:01 -07:00