16b414676e
Use count_workload() function for cost
2025-08-25 18:31:10 +01:00
ba74ac8136
Use cost value 1 for all jobs
2025-08-25 17:58:22 +01:00
92ff412679
Use MODEL_SERVER_URL environment variable
2025-08-25 17:57:32 +01:00
fc75a64684
Use MODEL_SERVER_URL environment variable
2025-08-25 17:56:27 +01:00
b00bef547c
Ensure uv env script is present before sourcing
2025-08-22 17:08:42 +01:00
3f4acb29fa
Improved client exception handling
2025-08-22 15:20:15 +01:00
58b078f908
Fix modifier class
2025-08-20 18:06:02 +01:00
f9fdf04884
Fix signature
2025-08-20 13:27:29 +01:00
636f17d27f
Fix workflow modifier class
2025-08-20 09:57:07 +01:00
08c88f7527
Improve testability
2025-08-20 09:34:09 +01:00
8797b504af
Initial ComfyUI implementation with updated wrapper
2025-08-19 17:59:20 +01:00
cd946b0a9f
update report_addr to use new webserver endpoint with AS fallback
2025-08-12 13:31:19 -07:00
c595b42410
for benchmarking, use concurrent requests ( #26 )
2025-08-11 12:39:28 -07:00
0bf3247a34
fix completions and interactive client
2025-08-11 12:37:53 -07:00
52ac4c0c1a
fix endpoint_util not using the correct instance's endpoint
2025-08-11 12:05:58 -07:00
8804e17201
download vast.ai's root certificate in order to make pyworker requests ( #25 )
2025-08-08 17:04:16 -07:00
4016cf9a53
redo metrics tracking for requests, fixes bug wherere some requests were marked as pending, even though they had finished ( #24 )
2025-08-08 17:01:21 -07:00
e0be45f39a
Addresses breaking change in core pyworker ( #22 )
...
* Addresses breaking change in test_utils.py
Endpoint.get_endpoint_api_key() now requires instance
Moves the call to this function out of the APIClient and into main
* Ensure make_benchmark_payload has a value to calculate the workload
---------
Co-authored-by: Nader Arbabian <nader@vast.ai >
2025-07-18 16:11:10 -07:00
be2aafdb1f
fix pyright errors + revert to old way of handling cancelled api requests ( #23 )
2025-07-17 16:59:06 -07:00
9e369c55a5
Ensure venv creation where python is unavailable ( #21 )
2025-07-17 09:59:35 -07:00
69d9b7455f
OpenAI compatible worker ( #19 )
...
Adds initial support for OpenAI compatible inference servers
Available endpoints:
- `/v1/completions`
- `/v1/chat/completions`
2025-07-16 09:46:26 +01:00
6fb610cb5b
fix pyworker miscounting active connections ( #20 )
...
* fix pyworker miscounting active connections
* clean up some issues
* add option to skip auth
2025-07-15 15:33:27 -07:00
0bf2d04223
stop using urljoin for worker_status endpoint
2025-06-17 23:09:45 -07:00
9ebf1924ea
don't healthcheck endpoints until model is loaded and benchmarks have run
2025-06-11 15:26:50 -07:00
0ab9a13a46
update tokenizers deps
2025-06-10 17:56:06 -07:00
4bac805093
update tokenizers
2025-06-10 17:07:38 -07:00
d99adcfb36
build(deps): bump transformers from 4.44.2 to 4.50.0
...
Bumps [transformers](https://github.com/huggingface/transformers ) from 4.44.2 to 4.50.0.
- [Release notes](https://github.com/huggingface/transformers/releases )
- [Commits](https://github.com/huggingface/transformers/compare/v4.44.2...v4.50.0 )
---
updated-dependencies:
- dependency-name: transformers
dependency-version: 4.50.0
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
2025-06-10 15:08:57 -07:00
4bf6f268a2
fix up depencies once and for all, fix broken imports
2025-06-10 14:11:10 -07:00
90877b758b
build(deps): bump requests from 2.32.3 to 2.32.4
...
Bumps [requests](https://github.com/psf/requests ) from 2.32.3 to 2.32.4.
- [Release notes](https://github.com/psf/requests/releases )
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md )
- [Commits](https://github.com/psf/requests/compare/v2.32.3...v2.32.4 )
---
updated-dependencies:
- dependency-name: requests
dependency-version: 2.32.4
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
2025-06-09 15:02:59 -07:00
f7cfcb0a66
build(deps): bump setuptools from 70.3.0 to 78.1.1
...
Bumps [setuptools](https://github.com/pypa/setuptools ) from 70.3.0 to 78.1.1.
- [Release notes](https://github.com/pypa/setuptools/releases )
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst )
- [Commits](https://github.com/pypa/setuptools/compare/v70.3.0...v78.1.1 )
---
updated-dependencies:
- dependency-name: setuptools
dependency-version: 78.1.1
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
2025-06-09 14:57:27 -07:00
0c4d89f17b
Added back code missed used to merge issues.
2025-06-03 10:54:57 -07:00
84f8555361
Update start_server.sh
...
revert python version bump
2025-06-02 19:15:55 -07:00
71ed54ebe4
Endpoint update pr one ( #1 )
...
* Added endpoint flexibility along with existing log. extended the log support
* Switched Endpoint back to vast-ai, Added endpoint flexibility along with existing log. extended the log support
* Modify the endpoint return type as optional and check via pyright to ensure there are not compilation/type errors
* Added endpoint flexibility along with existing log. extended the log support
Switched Endpoint back to vast-ai, Added endpoint flexibility along with existing log. extended the log support
Modify the endpoint return type as optional and check via pyright to ensure there are not compilation/type errors
* Endpoint Utils and API changes
2025-06-02 18:43:27 -07:00
b1ca68c349
Added endpoint flexibility along with existing log. extended the log support
...
Switched Endpoint back to vast-ai, Added endpoint flexibility along with existing log. extended the log support
Modify the endpoint return type as optional and check via pyright to ensure there are not compilation/type errors
2025-05-30 14:40:42 -07:00
6de4ee2b59
Merge pull request #2 from mbeltagy/patch-1
...
Update README.md
2025-04-09 12:17:58 -07:00
28977c8bf9
Merge pull request #3 from Nader-gator/main
...
add cuda error handling
2025-04-09 12:17:11 -07:00
f15c7a3540
fix wrong aiohttp version and add pubkey fetch retry
2025-04-02 17:01:45 -07:00
e8484e7c08
Merge pull request #4 from kristopolous/readme-update
...
fixing buildbot, updating readme
2025-03-27 12:29:34 -07:00
92c3a03ede
Merge branch 'main' of github.com:kristopolous/pyworker
2025-03-27 11:19:00 -07:00
72572ea39d
readme update
2025-03-27 11:18:32 -07:00
7018ef9249
requirements update
2025-03-27 11:18:25 -07:00
25ed16033c
client needs to be added, even if it's empty, to match the docs
2025-03-27 11:06:14 -07:00
334baf60f7
Merge branch 'main' of github.com:kristopolous/pyworker
2025-03-27 11:04:51 -07:00
f21607d2d4
pushing forward nltk
2025-03-27 11:04:41 -07:00
8d58b16e3a
Merge branch 'main' into mine-master
2025-03-27 10:54:36 -07:00
e1ed9a8e62
updating the readme
2025-03-26 18:58:09 -07:00
728005d28c
readme updates
2025-03-26 18:55:35 -07:00
4f0fc1fca1
Merge branch 'main' of github.com:kristopolous/pyworker
2025-03-26 14:54:42 -07:00
4e12955dd8
updating the readme
2025-03-26 14:54:15 -07:00
74aa9b6b67
style
2025-03-26 14:34:39 -07:00
Rob Ballantyne