1movmedia/pyworker
2
0
Fork 0
Code Pull Requests Activity
203 Commits 69 Branches 0 Tags
170571714f8ce57493242c1049afb36f13b1f851
Commit Graph

14 Commits

Author SHA1 Message Date
Lucas Armand 9bc9ba11c5 Increase TGI benchmark tokens to 500 2026-04-30 14:04:39 -07:00
Lucas Armand e02f4bc943 Lowered concurrency of vLLM and TGI benchmarks 2025-12-17 11:55:33 -08:00
Lucas Armand 9daf171487 Increase queue limits for vLLM and TGI 2025-12-17 11:38:55 -08:00
LucasArmandVast 4380d98c01 Use PyWorker SDK (#67) 
* Change PyWorker to Worker SDK
* Moved /lib to vast-sdk (https://github.com/vast-ai/vast-sdk)
 2025-12-15 19:33:03 -08:00
Colter Downing 6b5b1341a7 update tgi client 2025-12-03 18:38:42 -08:00
Lucas Armand b55bfa9611 Updated clients, include vastai-sdk, handle non-UTF-8 2025-11-11 17:09:28 -08:00
Nader Arbabian 8804e17201 download vast.ai's root certificate in order to make pyworker requests (#25) 2025-08-08 17:04:16 -07:00
Nader Arbabian 6fb610cb5b fix pyworker miscounting active connections (#20) 
* fix pyworker miscounting active connections

* clean up some issues

* add option to skip auth
 2025-07-15 15:33:27 -07:00
Nader Arbabian 4bac805093 update tokenizers 2025-06-10 17:07:38 -07:00
Abiola Akinnubi 71ed54ebe4 Endpoint update pr one (#1) 
* Added endpoint flexibility along with existing log. extended the log support

* Switched Endpoint back to vast-ai, Added endpoint flexibility along with existing log. extended the log support

* Modify the endpoint return type as optional and check via pyright to ensure there are not compilation/type errors

* Added endpoint flexibility along with existing log. extended the log support

Switched Endpoint back to vast-ai, Added endpoint flexibility along with existing log. extended the log support

Modify the endpoint return type as optional and check via pyright to ensure there are not compilation/type errors

* Endpoint Utils and API changes
 2025-06-02 18:43:27 -07:00
Abiola Akinnubi b1ca68c349 Added endpoint flexibility along with existing log. extended the log support 
Switched Endpoint back to vast-ai, Added endpoint flexibility along with existing log. extended the log support

Modify the endpoint return type as optional and check via pyright to ensure there are not compilation/type errors
 2025-05-30 14:40:42 -07:00
Nader Arbabian 099bb5fa04 add cuda error handling 2025-03-19 11:35:25 -07:00
Nader Arbabian ed7a952bf4 Merge pull request #1 from Nader-gator/main 
add pyworker v2
 2024-09-12 11:27:48 -07:00
Nader Arbabian 589216d15f initial commit 2024-09-04 11:19:30 -07:00