d3be9fe7db
redo metrics tracking for requests, fixes bug wherere some requests were marked as pending, even though they had finished
2025-07-30 18:56:51 -07:00
e0be45f39a
Addresses breaking change in core pyworker ( #22 )
...
* Addresses breaking change in test_utils.py
Endpoint.get_endpoint_api_key() now requires instance
Moves the call to this function out of the APIClient and into main
* Ensure make_benchmark_payload has a value to calculate the workload
---------
Co-authored-by: Nader Arbabian <nader@vast.ai >
2025-07-18 16:11:10 -07:00
be2aafdb1f
fix pyright errors + revert to old way of handling cancelled api requests ( #23 )
2025-07-17 16:59:06 -07:00
9e369c55a5
Ensure venv creation where python is unavailable ( #21 )
2025-07-17 09:59:35 -07:00
69d9b7455f
OpenAI compatible worker ( #19 )
...
Adds initial support for OpenAI compatible inference servers
Available endpoints:
- `/v1/completions`
- `/v1/chat/completions`
2025-07-16 09:46:26 +01:00
6fb610cb5b
fix pyworker miscounting active connections ( #20 )
...
* fix pyworker miscounting active connections
* clean up some issues
* add option to skip auth
2025-07-15 15:33:27 -07:00
0bf2d04223
stop using urljoin for worker_status endpoint
2025-06-17 23:09:45 -07:00
9ebf1924ea
don't healthcheck endpoints until model is loaded and benchmarks have run
2025-06-11 15:26:50 -07:00
0ab9a13a46
update tokenizers deps
2025-06-10 17:56:06 -07:00
4bac805093
update tokenizers
2025-06-10 17:07:38 -07:00
d99adcfb36
build(deps): bump transformers from 4.44.2 to 4.50.0
...
Bumps [transformers](https://github.com/huggingface/transformers ) from 4.44.2 to 4.50.0.
- [Release notes](https://github.com/huggingface/transformers/releases )
- [Commits](https://github.com/huggingface/transformers/compare/v4.44.2...v4.50.0 )
---
updated-dependencies:
- dependency-name: transformers
dependency-version: 4.50.0
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
2025-06-10 15:08:57 -07:00
4bf6f268a2
fix up depencies once and for all, fix broken imports
2025-06-10 14:11:10 -07:00
90877b758b
build(deps): bump requests from 2.32.3 to 2.32.4
...
Bumps [requests](https://github.com/psf/requests ) from 2.32.3 to 2.32.4.
- [Release notes](https://github.com/psf/requests/releases )
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md )
- [Commits](https://github.com/psf/requests/compare/v2.32.3...v2.32.4 )
---
updated-dependencies:
- dependency-name: requests
dependency-version: 2.32.4
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
2025-06-09 15:02:59 -07:00
f7cfcb0a66
build(deps): bump setuptools from 70.3.0 to 78.1.1
...
Bumps [setuptools](https://github.com/pypa/setuptools ) from 70.3.0 to 78.1.1.
- [Release notes](https://github.com/pypa/setuptools/releases )
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst )
- [Commits](https://github.com/pypa/setuptools/compare/v70.3.0...v78.1.1 )
---
updated-dependencies:
- dependency-name: setuptools
dependency-version: 78.1.1
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
2025-06-09 14:57:27 -07:00
0c4d89f17b
Added back code missed used to merge issues.
2025-06-03 10:54:57 -07:00
84f8555361
Update start_server.sh
...
revert python version bump
2025-06-02 19:15:55 -07:00
71ed54ebe4
Endpoint update pr one ( #1 )
...
* Added endpoint flexibility along with existing log. extended the log support
* Switched Endpoint back to vast-ai, Added endpoint flexibility along with existing log. extended the log support
* Modify the endpoint return type as optional and check via pyright to ensure there are not compilation/type errors
* Added endpoint flexibility along with existing log. extended the log support
Switched Endpoint back to vast-ai, Added endpoint flexibility along with existing log. extended the log support
Modify the endpoint return type as optional and check via pyright to ensure there are not compilation/type errors
* Endpoint Utils and API changes
2025-06-02 18:43:27 -07:00
b1ca68c349
Added endpoint flexibility along with existing log. extended the log support
...
Switched Endpoint back to vast-ai, Added endpoint flexibility along with existing log. extended the log support
Modify the endpoint return type as optional and check via pyright to ensure there are not compilation/type errors
2025-05-30 14:40:42 -07:00
6de4ee2b59
Merge pull request #2 from mbeltagy/patch-1
...
Update README.md
2025-04-09 12:17:58 -07:00
28977c8bf9
Merge pull request #3 from Nader-gator/main
...
add cuda error handling
2025-04-09 12:17:11 -07:00
f15c7a3540
fix wrong aiohttp version and add pubkey fetch retry
2025-04-02 17:01:45 -07:00
e8484e7c08
Merge pull request #4 from kristopolous/readme-update
...
fixing buildbot, updating readme
2025-03-27 12:29:34 -07:00
92c3a03ede
Merge branch 'main' of github.com:kristopolous/pyworker
2025-03-27 11:19:00 -07:00
72572ea39d
readme update
2025-03-27 11:18:32 -07:00
7018ef9249
requirements update
2025-03-27 11:18:25 -07:00
25ed16033c
client needs to be added, even if it's empty, to match the docs
2025-03-27 11:06:14 -07:00
334baf60f7
Merge branch 'main' of github.com:kristopolous/pyworker
2025-03-27 11:04:51 -07:00
f21607d2d4
pushing forward nltk
2025-03-27 11:04:41 -07:00
8d58b16e3a
Merge branch 'main' into mine-master
2025-03-27 10:54:36 -07:00
e1ed9a8e62
updating the readme
2025-03-26 18:58:09 -07:00
728005d28c
readme updates
2025-03-26 18:55:35 -07:00
4f0fc1fca1
Merge branch 'main' of github.com:kristopolous/pyworker
2025-03-26 14:54:42 -07:00
4e12955dd8
updating the readme
2025-03-26 14:54:15 -07:00
74aa9b6b67
style
2025-03-26 14:34:39 -07:00
226fa13355
Merge pull request #4 from kristopolous/dependabot/pip/pip-bb24fe24d9
...
build(deps): bump aiohttp from 3.10.0 to 3.11.0b0 in the pip group across 1 directory
2025-03-25 14:47:06 -07:00
905255932b
Merge pull request #1 from kristopolous/dependabot/pip/pip-ff0b128437
...
build(deps): bump transformers from 4.43.2 to 4.48.0 in the pip group across 1 directory
2025-03-25 14:46:48 -07:00
eed0a6c8bc
removing some deps
2025-03-25 14:46:30 -07:00
a153b0bcc8
removing some deps
2025-03-25 14:44:59 -07:00
22c19f23b6
build(deps): bump aiohttp in the pip group across 1 directory
...
Bumps the pip group with 1 update in the / directory: [aiohttp](https://github.com/aio-libs/aiohttp ).
Updates `aiohttp` from 3.10.0 to 3.11.0b0
- [Release notes](https://github.com/aio-libs/aiohttp/releases )
- [Changelog](https://github.com/aio-libs/aiohttp/blob/v3.11.0b0/CHANGES.rst )
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.10.0...v3.11.0b0 )
---
updated-dependencies:
- dependency-name: aiohttp
dependency-type: direct:production
dependency-group: pip
...
Signed-off-by: dependabot[bot] <support@github.com >
2025-03-25 21:25:15 +00:00
0541988991
build(deps): bump transformers in the pip group across 1 directory
...
Bumps the pip group with 1 update in the / directory: [transformers](https://github.com/huggingface/transformers ).
Updates `transformers` from 4.43.2 to 4.48.0
- [Release notes](https://github.com/huggingface/transformers/releases )
- [Commits](https://github.com/huggingface/transformers/compare/v4.43.2...v4.48.0 )
---
updated-dependencies:
- dependency-name: transformers
dependency-type: direct:production
dependency-group: pip
...
Signed-off-by: dependabot[bot] <support@github.com >
2025-03-25 21:25:05 +00:00
099bb5fa04
add cuda error handling
2025-03-19 11:35:25 -07:00
c0c8db5a45
Update README.md
...
client.py is no longer there in the worker templates.
2024-10-24 18:31:47 +03:00
ff675ce347
Update README.md
...
Improved text clarity
2024-10-24 18:12:27 +03:00
d6f960930d
Update README.md
...
fixed spelling
2024-10-24 17:54:10 +03:00
910f6f2b29
fix: fix incorrect check for comfy_model env var
2024-09-24 16:09:24 -07:00
ed7a952bf4
Merge pull request #1 from Nader-gator/main
...
add pyworker v2
2024-09-12 11:27:48 -07:00
589216d15f
initial commit
2024-09-04 11:19:30 -07:00
7cd1a30393
Initial commit
2024-09-04 11:08:58 -07:00
Nader Arbabian