Rob Ballantyne
b8377c4081
Set cost to 100
2025-08-28 16:13:17 +01:00
Rob Ballantyne
1e4fa87437
Prevent timeout and allow long running connections
2025-08-28 15:48:57 +01:00
Rob Ballantyne
4c5fa03c7b
adds import for ClientTimeout
2025-08-27 20:54:27 +01:00
Rob Ballantyne
a8fe74f771
Remove default 300s timeout
2025-08-27 18:34:45 +01:00
Rob Ballantyne
703435d10e
Improve MODEL_SERVER_START_* messages
2025-08-26 12:42:04 +01:00
Rob Ballantyne
947fc5eea4
Improve benchmarking explanation
2025-08-26 12:41:30 +01:00
Rob Ballantyne
7c1a544b19
Improve error reporting when no ready workers
2025-08-26 12:41:05 +01:00
Rob Ballantyne
16b414676e
Use count_workload() function for cost
2025-08-25 18:31:10 +01:00
Rob Ballantyne
ba74ac8136
Use cost value 1 for all jobs
2025-08-25 17:58:22 +01:00
Rob Ballantyne
92ff412679
Use MODEL_SERVER_URL environment variable
2025-08-25 17:57:32 +01:00
Rob Ballantyne
fc75a64684
Use MODEL_SERVER_URL environment variable
2025-08-25 17:56:27 +01:00
Rob Ballantyne
b00bef547c
Ensure uv env script is present before sourcing
2025-08-22 17:08:42 +01:00
Rob Ballantyne
3f4acb29fa
Improved client exception handling
2025-08-22 15:20:15 +01:00
Rob Ballantyne
58b078f908
Fix modifier class
2025-08-20 18:06:02 +01:00
Rob Ballantyne
f9fdf04884
Fix signature
2025-08-20 13:27:29 +01:00
Rob Ballantyne
636f17d27f
Fix workflow modifier class
2025-08-20 09:57:07 +01:00
Rob Ballantyne
08c88f7527
Improve testability
2025-08-20 09:34:09 +01:00
Rob Ballantyne
8797b504af
Initial ComfyUI implementation with updated wrapper
2025-08-19 17:59:20 +01:00
Rob Ballantyne and Nader Arbabian
e0be45f39a
Addresses breaking change in core pyworker ( #22 )
...
* Addresses breaking change in test_utils.py
Endpoint.get_endpoint_api_key() now requires instance
Moves the call to this function out of the APIClient and into main
* Ensure make_benchmark_payload has a value to calculate the workload
---------
Co-authored-by: Nader Arbabian <nader@vast.ai >
2025-07-18 16:11:10 -07:00
Rob Ballantyne and GitHub
9e369c55a5
Ensure venv creation where python is unavailable ( #21 )
2025-07-17 09:59:35 -07:00
Rob Ballantyne and GitHub
69d9b7455f
OpenAI compatible worker ( #19 )
...
Adds initial support for OpenAI compatible inference servers
Available endpoints:
- `/v1/completions`
- `/v1/chat/completions`
2025-07-16 09:46:26 +01:00
Rob Ballantyne