4 Commits

Author	SHA1	Message	Date
Lucas Armand	0bcd2219ea	Increase model wait time for vLLM	2025-12-03 12:38:52 -08:00
Lucas Armand	e0449cb3c7	add llama log	2025-11-21 10:22:16 -08:00
Nader Arbabian	be2aafdb1f	fix pyright errors + revert to old way of handling cancelled api requests (#23)	2025-07-17 16:59:06 -07:00
Rob Ballantyne	69d9b7455f	OpenAI compatible worker (#19) ... Adds initial support for OpenAI compatible inference servers Available endpoints: - `/v1/completions` - `/v1/chat/completions`	2025-07-16 09:46:26 +01:00