Commit Graph

208 Commits

Author SHA1 Message Date
Rob Ballantyne 58b078f908 Fix modifier class 2025-08-20 18:06:02 +01:00
Rob Ballantyne f9fdf04884 Fix signature 2025-08-20 13:27:29 +01:00
Rob Ballantyne 636f17d27f Fix workflow modifier class 2025-08-20 09:57:07 +01:00
Rob Ballantyne 08c88f7527 Improve testability 2025-08-20 09:34:09 +01:00
Rob Ballantyne 8797b504af Initial ComfyUI implementation with updated wrapper 2025-08-19 17:59:20 +01:00
Nader Arbabian cd946b0a9f update report_addr to use new webserver endpoint with AS fallback 2025-08-12 13:31:19 -07:00
Nader Arbabian c595b42410 for benchmarking, use concurrent requests (#26) 2025-08-11 12:39:28 -07:00
Nader Arbabian 0bf3247a34 fix completions and interactive client 2025-08-11 12:37:53 -07:00
Nader Arbabian 52ac4c0c1a fix endpoint_util not using the correct instance's endpoint 2025-08-11 12:05:58 -07:00
Nader Arbabian 8804e17201 download vast.ai's root certificate in order to make pyworker requests (#25) 2025-08-08 17:04:16 -07:00
Nader Arbabian 4016cf9a53 redo metrics tracking for requests, fixes bug wherere some requests were marked as pending, even though they had finished (#24) 2025-08-08 17:01:21 -07:00
Rob Ballantyne e0be45f39a Addresses breaking change in core pyworker (#22)
* Addresses breaking change in test_utils.py

Endpoint.get_endpoint_api_key() now requires instance

Moves the call to this function out of the APIClient and into main

* Ensure make_benchmark_payload has a value to calculate the workload

---------

Co-authored-by: Nader Arbabian <nader@vast.ai>
2025-07-18 16:11:10 -07:00
Nader Arbabian be2aafdb1f fix pyright errors + revert to old way of handling cancelled api requests (#23) 2025-07-17 16:59:06 -07:00
Rob Ballantyne 9e369c55a5 Ensure venv creation where python is unavailable (#21) 2025-07-17 09:59:35 -07:00
Rob Ballantyne 69d9b7455f OpenAI compatible worker (#19)
Adds initial support for OpenAI compatible inference servers

Available endpoints:

- `/v1/completions`
- `/v1/chat/completions`
2025-07-16 09:46:26 +01:00
Nader Arbabian 6fb610cb5b fix pyworker miscounting active connections (#20)
* fix pyworker miscounting active connections

* clean up some issues

* add option to skip auth
2025-07-15 15:33:27 -07:00
Nader Arbabian 0bf2d04223 stop using urljoin for worker_status endpoint 2025-06-17 23:09:45 -07:00
Nader Arbabian 9ebf1924ea don't healthcheck endpoints until model is loaded and benchmarks have run 2025-06-11 15:26:50 -07:00
Nader Arbabian 0ab9a13a46 update tokenizers deps 2025-06-10 17:56:06 -07:00
Nader Arbabian 4bac805093 update tokenizers 2025-06-10 17:07:38 -07:00
dependabot[bot] d99adcfb36 build(deps): bump transformers from 4.44.2 to 4.50.0
Bumps [transformers](https://github.com/huggingface/transformers) from 4.44.2 to 4.50.0.
- [Release notes](https://github.com/huggingface/transformers/releases)
- [Commits](https://github.com/huggingface/transformers/compare/v4.44.2...v4.50.0)

---
updated-dependencies:
- dependency-name: transformers
  dependency-version: 4.50.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-06-10 15:08:57 -07:00
Nader Arbabian 4bf6f268a2 fix up depencies once and for all, fix broken imports 2025-06-10 14:11:10 -07:00
dependabot[bot] 90877b758b build(deps): bump requests from 2.32.3 to 2.32.4
Bumps [requests](https://github.com/psf/requests) from 2.32.3 to 2.32.4.
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](https://github.com/psf/requests/compare/v2.32.3...v2.32.4)

---
updated-dependencies:
- dependency-name: requests
  dependency-version: 2.32.4
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-06-09 15:02:59 -07:00
dependabot[bot] f7cfcb0a66 build(deps): bump setuptools from 70.3.0 to 78.1.1
Bumps [setuptools](https://github.com/pypa/setuptools) from 70.3.0 to 78.1.1.
- [Release notes](https://github.com/pypa/setuptools/releases)
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst)
- [Commits](https://github.com/pypa/setuptools/compare/v70.3.0...v78.1.1)

---
updated-dependencies:
- dependency-name: setuptools
  dependency-version: 78.1.1
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-06-09 14:57:27 -07:00
Abiola Akinnubi 0c4d89f17b Added back code missed used to merge issues. 2025-06-03 10:54:57 -07:00
Nader Arbabian 84f8555361 Update start_server.sh
revert python version bump
2025-06-02 19:15:55 -07:00
Abiola Akinnubi 71ed54ebe4 Endpoint update pr one (#1)
* Added endpoint flexibility along with existing log. extended the log support

* Switched Endpoint back to vast-ai, Added endpoint flexibility along with existing log. extended the log support

* Modify the endpoint return type as optional and check via pyright to ensure there are not compilation/type errors

* Added endpoint flexibility along with existing log. extended the log support

Switched Endpoint back to vast-ai, Added endpoint flexibility along with existing log. extended the log support

Modify the endpoint return type as optional and check via pyright to ensure there are not compilation/type errors

* Endpoint Utils and API changes
2025-06-02 18:43:27 -07:00
Abiola Akinnubi b1ca68c349 Added endpoint flexibility along with existing log. extended the log support
Switched Endpoint back to vast-ai, Added endpoint flexibility along with existing log. extended the log support

Modify the endpoint return type as optional and check via pyright to ensure there are not compilation/type errors
2025-05-30 14:40:42 -07:00
Nader Arbabian 6de4ee2b59 Merge pull request #2 from mbeltagy/patch-1
Update README.md
2025-04-09 12:17:58 -07:00
Nader Arbabian 28977c8bf9 Merge pull request #3 from Nader-gator/main
add cuda error handling
2025-04-09 12:17:11 -07:00
Nader Arbabian f15c7a3540 fix wrong aiohttp version and add pubkey fetch retry 2025-04-02 17:01:45 -07:00
chris mckenzie e8484e7c08 Merge pull request #4 from kristopolous/readme-update
fixing buildbot, updating readme
2025-03-27 12:29:34 -07:00
Chris McKenzie 92c3a03ede Merge branch 'main' of github.com:kristopolous/pyworker 2025-03-27 11:19:00 -07:00
Chris McKenzie 72572ea39d readme update 2025-03-27 11:18:32 -07:00
Chris McKenzie 7018ef9249 requirements update 2025-03-27 11:18:25 -07:00
Chris McKenzie 25ed16033c client needs to be added, even if it's empty, to match the docs 2025-03-27 11:06:14 -07:00
Chris McKenzie 334baf60f7 Merge branch 'main' of github.com:kristopolous/pyworker 2025-03-27 11:04:51 -07:00
Chris McKenzie f21607d2d4 pushing forward nltk 2025-03-27 11:04:41 -07:00
Chris McKenzie 8d58b16e3a Merge branch 'main' into mine-master 2025-03-27 10:54:36 -07:00
Chris McKenzie e1ed9a8e62 updating the readme 2025-03-26 18:58:09 -07:00
Chris McKenzie 728005d28c readme updates 2025-03-26 18:55:35 -07:00
Chris McKenzie 4f0fc1fca1 Merge branch 'main' of github.com:kristopolous/pyworker 2025-03-26 14:54:42 -07:00
Chris McKenzie 4e12955dd8 updating the readme 2025-03-26 14:54:15 -07:00
Chris McKenzie 74aa9b6b67 style 2025-03-26 14:34:39 -07:00
chris mckenzie 226fa13355 Merge pull request #4 from kristopolous/dependabot/pip/pip-bb24fe24d9
build(deps): bump aiohttp from 3.10.0 to 3.11.0b0 in the pip group across 1 directory
2025-03-25 14:47:06 -07:00
chris mckenzie 905255932b Merge pull request #1 from kristopolous/dependabot/pip/pip-ff0b128437
build(deps): bump transformers from 4.43.2 to 4.48.0 in the pip group across 1 directory
2025-03-25 14:46:48 -07:00
Chris McKenzie eed0a6c8bc removing some deps 2025-03-25 14:46:30 -07:00
Chris McKenzie a153b0bcc8 removing some deps 2025-03-25 14:44:59 -07:00
dependabot[bot] 22c19f23b6 build(deps): bump aiohttp in the pip group across 1 directory
Bumps the pip group with 1 update in the / directory: [aiohttp](https://github.com/aio-libs/aiohttp).


Updates `aiohttp` from 3.10.0 to 3.11.0b0
- [Release notes](https://github.com/aio-libs/aiohttp/releases)
- [Changelog](https://github.com/aio-libs/aiohttp/blob/v3.11.0b0/CHANGES.rst)
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.10.0...v3.11.0b0)

---
updated-dependencies:
- dependency-name: aiohttp
  dependency-type: direct:production
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-03-25 21:25:15 +00:00
dependabot[bot] 0541988991 build(deps): bump transformers in the pip group across 1 directory
Bumps the pip group with 1 update in the / directory: [transformers](https://github.com/huggingface/transformers).


Updates `transformers` from 4.43.2 to 4.48.0
- [Release notes](https://github.com/huggingface/transformers/releases)
- [Commits](https://github.com/huggingface/transformers/compare/v4.43.2...v4.48.0)

---
updated-dependencies:
- dependency-name: transformers
  dependency-type: direct:production
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-03-25 21:25:05 +00:00