7c0f316eeb
leave the env vars alone!
2025-10-29 11:36:46 -07:00
b4025a744f
remove env var writing
2025-10-29 09:58:09 -07:00
d190308329
removed 5 sec sleep and warmup request on load
2025-10-29 09:57:46 -07:00
9f5a432513
Merge pull request #51 from vast-ai/delete-reqs-hotfix
...
Redis subscriber queue patch
2025-10-28 16:07:28 -07:00
e09f1fa953
patch for redis queue
2025-10-28 16:03:50 -07:00
ba6f1c2e4b
Fix signature ( #50 )
...
* change order of fields in auth_data to match autoscaler for signature verification
* also ignore __request_id
* Revert "change order of fields in auth_data to match autoscaler for signature verification" so that it's alphabetical again
This reverts commit b8223879c9edgarlin2000@gmail.com >
2025-10-28 16:01:32 -07:00
298590fb88
Merge pull request #45 from vast-ai/new-pyworker
...
New PyWorker
2025-10-28 14:02:53 -07:00
814c3acd4c
remove unused code
2025-10-28 13:43:57 -07:00
22bca74087
Prevent load time race
2025-10-27 18:25:21 -07:00
9c795e2a01
removed bad code
2025-10-27 17:03:13 -07:00
830b532781
Trying unified delete
2025-10-27 16:57:52 -07:00
d6a6e34c6b
Merge branch 'main' into new-pyworker
2025-10-27 12:43:49 -07:00
ac1e109c48
Merge pull request #47 from vast-ai/new-pyworker-vllm-prefix-cache
...
vLLM Prefix caching, benchmark bug fix, test load script
2025-10-27 12:30:34 -07:00
d6eb498ee4
catch the case where all benchmarks fail (sets error)
2025-10-27 12:01:55 -07:00
bcecd6df40
Suppress matplot debug logs
2025-10-25 16:18:02 -07:00
4d9bf2048c
Fix
2025-10-24 15:44:38 -07:00
7788bc4a62
Added some debug logs
2025-10-24 15:41:00 -07:00
37ad3f8d46
asyncio in metrics
2025-10-23 10:18:31 -07:00
70d51bafe1
Merge pull request #36 from robballantyne/feat/comfyui-json-benchmark-workflow-from-file
2025-10-23 17:05:48 +01:00
63909736bb
Merge pull request #4 from robballantyne/feat/comfyui-json-benchmark-workflow-from-file-no-silent-fail
...
Feat/comfyui json benchmark workflow from file no silent fail
2025-10-23 17:02:12 +01:00
f4f7080df1
Re-add comment
2025-10-23 17:00:28 +01:00
d51a338e8f
log when benchmark file not used
2025-10-23 16:41:02 +01:00
92a04bd7af
No silent fail if benchmark file is missing
2025-10-23 13:41:03 +01:00
0f13506938
Send success param
2025-10-22 10:18:59 -07:00
01e752d31f
use more asyncio sleep
2025-10-21 18:52:13 -07:00
5edfa968ca
async sleep
2025-10-21 18:49:48 -07:00
5b5ef7227a
nvm moved it here
2025-10-21 18:20:11 -07:00
16990ff8ff
move start request
2025-10-21 18:18:44 -07:00
9748176366
fixed semaphore acquire bool
2025-10-21 18:12:23 -07:00
b39193ae70
check for sem acquire
2025-10-21 18:02:14 -07:00
9a6ca5d412
added versioning
2025-10-21 15:42:43 -07:00
e9ba1b03e4
Use delete_requests and track request_idxs
2025-10-21 11:59:35 -07:00
c98d661513
Merge pull request #39 from vast-ai/remove-time-divide
...
PyWorker fixes for cur_load and acks bug
2025-10-13 10:06:22 -07:00
f6fd1c6ac1
merge
2025-10-09 18:15:55 -07:00
055e346c8c
Send metrics on request start
2025-10-09 10:13:50 -07:00
1cedb28acf
Removed division by elapsed time, since autoscaler cur_load in units of workload
2025-10-08 16:54:18 -07:00
ec25dda3ad
Merge branch 'vast-ai:main' into feat/comfyui-json-benchmark-workflow-from-file
2025-10-08 14:49:32 +01:00
0397af719d
Merge pull request #37 from robballantyne/bugfix/healthcheck-endpoint
...
Fix healthcheck endpoint URL
Tested and merged by Colter
2025-10-06 15:11:27 -07:00
4fdc314fd9
Fix healthcheck endpoint URL
2025-10-06 22:16:09 +01:00
3786cf978d
Add awareness of errors thrown by the provisioning script
2025-10-05 23:14:59 +01:00
a86d4bcf9c
Import json
2025-10-05 23:05:33 +01:00
e9b6a14a5e
Import Path
2025-10-05 22:59:19 +01:00
cadac033e1
Enables use of custom workflow for benchmarking
...
Retains existing method is misc/benchmark.json is nopt present
2025-10-05 22:53:22 +01:00
639d82f5b4
Merge pull request #35 from vast-ai/AUTO-664--Healthcheck-error
...
Fix healthcheck with separate session
2025-10-02 12:51:19 -07:00
25db78e39d
Fix healthcheck with separate session
2025-10-01 18:04:31 -07:00
4e2f2311d0
Merge pull request #33 from vast-ai/comfy-blind-fix-override
...
undo the fix for comfy yesterday.
2025-09-03 11:50:07 -07:00
38782d89bc
undo the fix for comfy yesterday.
2025-09-03 17:12:35 +00:00
0185216ccb
Merge pull request #32 from vast-ai/blindhotfix_comfy_ui_default_port
...
Blind hotfix to see if comfy UI default is needed. if it does work we…
2025-09-02 18:26:25 -07:00
b20d9e714c
Blind hotfix to see if comfy UI default is needed. if it does work we would revert back.
2025-09-03 01:20:09 +00:00
b1eb65d75d
Merge pull request #31 from vast-ai/bugfix/startup-script-20250901
...
Update uv venv creation command
2025-09-01 18:19:17 +01:00
Colter Downing