starred/windmill
1
0
Fork 0
mirror of https://github.com/windmill-labs/windmill.git synced 2026-08-19 16:02:14 +00:00
Code Issues Packages Projects Releases Wiki Activity
4,315 Commits 731 Branches 1,510 Tags
f40bbba519a97cbb1ec142c335f038dbebcd4e7c
Commit Graph

308 Commits

Author SHA1 Message Date
Ruben Fiszel dff1cd9a64 feat: submit result in background thread (unify architecture for dedicated worker) (#2226) 
* merge

* all

* all
 2023-09-04 01:56:23 +02:00
Ruben Fiszel 069e2d18d5 perf: improve queue performance (#2222) 
* benchs

* progress

* prog

* progress

* progress

* progress

* update

* progress

* progress

* progress

* progress

* progress

* all

* all

* improve queries

* improve queries

* rm imv

* all

* all
 2023-09-03 09:44:16 +02:00
Ruben Fiszel 7c5ea569a8 feat: add global cache configuration 2023-08-30 13:35:41 +02:00
Ruben Fiszel 5e3daf02b4 fix serving metrics on ee 2023-08-20 19:40:50 +02:00
Ruben Fiszel 09a4e492ea fix tests 2023-08-20 19:27:42 +02:00
Ruben Fiszel 0503942170 refactor default non-cloud-hosted timeout 2023-08-20 16:30:31 +02:00
Ruben Fiszel da036b2a19 refactor workers 2023-08-20 15:58:43 +02:00
Ruben Fiszel 2afea50497 feat: prometheus metrics are now ee only 2023-08-20 12:29:05 +02:00
Ruben Fiszel 4b8d38d077 fix tar initialization 2023-08-14 16:16:42 +02:00
Ruben Fiszel 933021ad8d feat: implement binary caching for go 2023-08-08 20:54:31 +02:00
Ruben Fiszel c22d2b91a1 feat: use flock to avoid concurrency issues on pip and shared volume 2023-07-26 20:17:26 +02:00
Ruben Fiszel 6f47bf9806 feat: handle worker groups with redis 2023-07-26 17:33:46 +02:00
Ruben Fiszel 601da7f878 fix: respect FIFO order for concurrency limit 2023-07-24 18:11:23 +02:00
Jakub Kołodziejczak 72d0d8a7f5 chore(backend): upgrade sqlx to ^0.7 (#1865) 
* DRAFT chore(backend): upgrade sqlx to ^0.7

related to:
* https://github.com/windmill-labs/windmill/pull/1858
* https://github.com/launchbadge/sqlx/issues/1163#issuecomment-1627685514

* (vol. 2) in 0.7, `Transaction` can no longer implement `Executor` directly

ref: https://github.com/launchbadge/sqlx/blob/afb6b1066e61f8e3875f530d96cfb5a299f13fda/examples/postgres/transaction/src/main.rs#L14-L17

notice that I'm temporarly using my custom patch
https://github.com/mrl5/sqlx/commit/16e4c9a8f380214ad61b1744d3e1f5fa866ffbcc
it's related to https://github.com/launchbadge/sqlx/issues/2611

* post git rebase chores

* use upstream fix from 0.7.1

* fix compile

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
 2023-07-15 14:06:20 +02:00
Ruben Fiszel 08e3502126 fix: make workers bind their http servers on any available port for OCI compliance 2023-07-12 11:19:01 +02:00
Guillaume Bouvignies 96df8900cb Specific NOOP jobs benchmark (#1810) 
* Refactor and fix NOOP benchmark

* Add endpoint to toggle workers on/off when compiled in benchmark mode

* Improve noop benchmark
 2023-07-10 14:16:34 +02:00
Ruben Fiszel 3d999007f5 improve docker-compose 2023-07-08 09:58:45 +02:00
Ruben Fiszel 2921649c3c feat: bun support (#1800) 
* feat: bun support

* feat: bun support

* add bun support

* add bun support

* add bun support

* add bun
 2023-07-06 21:19:07 +02:00
Ruben Fiszel 8c566a2e46 feat: add configurable global error handler 2023-06-30 12:46:02 +02:00
Ruben Fiszel ff942f4d06 fix: add CREATE_WORKSPACE_REQUIRE_SUPERADMIN 2023-06-29 23:06:03 +02:00
Ruben Fiszel f096145cee improve docker-compose and email sending 2023-06-29 11:52:46 +02:00
Ruben Fiszel 7851e932ec feat: smtp support to invite users (#1777) 
* email support

* everyhting

* smtp

* update

* update

* update

* setup backend test
 2023-06-29 10:34:44 +02:00
Ruben Fiszel 293ba774e8 minor worker_flow refactor 2023-06-23 16:53:05 +02:00
Ruben Fiszel 263e03c2bd feat: remove the need for BASE_INTERNAL_URL 2023-06-12 12:00:42 +02:00
Ruben Fiszel 1816252f03 fix(backend): fix initial worker ping issue 2023-05-29 13:53:53 +02:00
Ruben Fiszel 521bf7b495 use hostname as worker name 2023-05-28 21:44:57 +02:00
Ruben Fiszel 9461b15d43 use hostname as worker name 2023-05-28 19:28:06 +02:00
Ruben Fiszel c8ff19befd add logs around connecting to database 2023-05-25 17:45:17 +02:00
Ruben Fiszel 7201045789 fix migration break 2023-05-25 11:07:54 +02:00
Ruben Fiszel 45a6ffcf32 add ee_license endpoint 2023-05-24 14:34:03 +02:00
Ruben Fiszel 9c90e331f7 implement license keys with expiry 2023-05-22 11:06:23 +02:00
Ruben Fiszel cdc4f29ec1 feat: add GOPROXY + fix on saved inputs 2023-05-18 17:29:37 +02:00
Ruben Fiszel 1cbd704a25 feat(backend): add REQUEST_SIZE_LIMIT env variable 2023-05-17 23:07:17 +02:00
Ruben Fiszel d814a25b0f add cairo to openbb build 2023-05-09 11:11:09 +02:00
Ruben Fiszel de9abd129d feat(backend): add EXIT_AFTER_NO_JOB_FOR_SECS for ephemeral workers 2023-04-28 00:09:48 +02:00
Ruben Fiszel 4387db275f fix run_wait_result polling + make it configurable 2023-04-27 07:35:53 +02:00
Ruben Fiszel 0b7bad3816 feat(backend): add JOB_RETENTION_SECS to delete completed jobs completed after expiration period 2023-04-26 19:34:54 +02:00
Ruben Fiszel 4a34e83b56 minor worker tags nit 2023-04-26 01:54:09 +02:00
Ruben Fiszel 670ba51d9b feat(backend): workers are instantly ready and sync with global cache in background 2023-04-21 09:45:25 +02:00
Ruben Fiszel 369dd0dac6 feat(backend): global cache refactor for pip using tar for each dependency (#1443) 
* cache refactor

* exclude tar from being synced to bucket

* run

* update

* update
 2023-04-20 20:05:12 +02:00
Ruben Fiszel 62d196ecec add barrier when num workers > 1 2023-04-19 17:00:03 +02:00
Ruben Fiszel 29848ae466 add barrier when num workers > 1 2023-04-19 12:46:25 +02:00
Ruben Fiszel 0e77e37fbd feat(ee): sync cache in background 2023-04-19 00:55:51 +02:00
Ruben Fiszel 34f48aa1e3 split worker.rs into more files 2023-04-13 17:44:47 +02:00
Ruben Fiszel 3932e5dfb9 add GOPRIVATE and NETRC for private modules 2023-04-11 19:55:38 +02:00
Kai Jellinghaus d45e6c94ab feat(backend): Redis based queue (#1324) 
* Merge?

* Fix V8 breaking change

* WIP

* WIP

* Cleanup

* Move to git reference

* Fix Merge conflict

* update

---------

Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
 2023-04-11 12:24:13 +02:00
Ruben Fiszel f2d3c8208b feat(backend): add instance events webhook 2023-04-11 01:45:56 +02:00
Ruben Fiszel 3097510550 only register prometheus metrics if they are enabled 2023-04-09 15:39:25 +02:00
Ruben Fiszel 94eecea02b feat(backend): add /ready endpoint for workers 2023-04-05 10:34:25 +02:00
Ruben Fiszel 3e5ff8682a feat: do cache bucket syncing in background + check tar before pushing it (#1360) 
* all

* improve tar caching
 2023-04-04 01:34:11 +02:00