Colter Downing
68d8ce4bfd
refactor: use endpoint_id instead of endpoint name for routing
...
- Update route_payload to use endpoint_id instead of endpoint name
- Update AuthData to expect endpoint_id (int) instead of endpoint (str)
- Update ClientState to track endpoint_id
- Update comfyui client functions to use endpoint_id
- Fetch endpoint info (id + api_key) instead of just api_key
This aligns with the autoscaler changes in AUTO-848 that switched
to ID-based endpoint lookups for improved security and consistency.
2025-12-06 14:46:41 -08:00
Colter-Downing and GitHub
138fc3ac47
Merge pull request #71 from vast-ai/AUTO-comfyui-updates
...
Auto comfyui updates
2025-12-04 10:55:12 -08:00
Colter Downing
222ac2a0dd
default endpoint name
2025-12-04 10:54:55 -08:00
Colter Downing
40aed9b5f8
adding s3 as an option
2025-12-04 10:52:57 -08:00
Colter Downing
d4d36bf86e
done with comfy updates
2025-12-03 20:45:55 -08:00
Colter Downing
e839cfc6e8
include view in API wrapper
2025-12-03 20:22:45 -08:00
Colter Downing
f04138e13b
update to be able to get images
2025-12-03 20:16:25 -08:00
Colter-Downing and GitHub
de3aa87c8f
Merge pull request #70 from vast-ai/AUTO-tgi-client-edits
...
update tgi client
2025-12-03 18:40:01 -08:00
Colter Downing
6b5b1341a7
update tgi client
2025-12-03 18:38:42 -08:00
Colter-Downing and GitHub
8be92c03de
Merge pull request #69 from vast-ai/AUTO-874--fix-openai-worker-client
...
defaults to ENDPOINT_NAME and DEFAULT_MODEL but uses the flag first
2025-12-03 16:59:56 -08:00
Colter Downing
adedb8ba90
defaults to ENDPOINT_NAME and DEFAULT_MODEL but uses the flag first if present
2025-12-03 16:57:28 -08:00
Colter-Downing and GitHub
ec2ac0a21a
Merge pull request #52 from vast-ai/remove-sleeps-and-delays
...
Remove sleeps and delays
2025-10-30 11:53:39 -07:00
Colter Downing
7c0f316eeb
leave the env vars alone!
2025-10-29 11:36:46 -07:00
Colter Downing
b4025a744f
remove env var writing
2025-10-29 09:58:09 -07:00
Colter Downing
d190308329
removed 5 sec sleep and warmup request on load
2025-10-29 09:57:46 -07:00
Colter-Downing and GitHub
ac1e109c48
Merge pull request #47 from vast-ai/new-pyworker-vllm-prefix-cache
...
vLLM Prefix caching, benchmark bug fix, test load script
2025-10-27 12:30:34 -07:00
Colter Downing
d6eb498ee4
catch the case where all benchmarks fail (sets error)
2025-10-27 12:01:55 -07:00
Colter Downing
bcecd6df40
Suppress matplot debug logs
2025-10-25 16:18:02 -07:00
Colter-Downing and GitHub
0397af719d
Merge pull request #37 from robballantyne/bugfix/healthcheck-endpoint
...
Fix healthcheck endpoint URL
Tested and merged by Colter
2025-10-06 15:11:27 -07:00
Colter-Downing and GitHub
639d82f5b4
Merge pull request #35 from vast-ai/AUTO-664--Healthcheck-error
...
Fix healthcheck with separate session
2025-10-02 12:51:19 -07:00
Colter Downing
25db78e39d
Fix healthcheck with separate session
2025-10-01 18:04:31 -07:00
Colter-Downing and GitHub
1b37054dec
Merge pull request #28 from vast-ai/bugfix/backend-timeout-infinite
...
Bugfix/backend timeout infinite
2025-08-28 11:22:33 -07:00
Colter-Downing and GitHub
1a1e4174b8
Merge pull request #29 from vast-ai/bugfix/comfyui-json-cost-fix
...
Set cost to 100
2025-08-28 11:22:21 -07:00
Colter Downing