Commit Graph

2 Commits

Author SHA1 Message Date
Nader Arbabian 4ac51947b4 fix pyright errors + revert to old way of handling cancelled api requests 2025-07-17 15:29:41 -07:00
Rob Ballantyne 69d9b7455f OpenAI compatible worker (#19)
Adds initial support for OpenAI compatible inference servers

Available endpoints:

- `/v1/completions`
- `/v1/chat/completions`
2025-07-16 09:46:26 +01:00