Commit Graph

428 Commits

Author SHA1 Message Date
Ruben Fiszel c88cf18ccd increase max worker connections to 5 2024-05-03 08:39:51 +02:00
HugoCasa cb132671d3 feat: critical error side channel (#3625)
* feat: critical error side channel

* feat: trigger workspace error handler or critical channel on schedule error handling failure

* fix: build

* feat: finish critical error side channel

* feat: channels instead of just emails + move to EE

* fix: remove superfluous func

* fix: nits + ee ref

* fix: open source build

* fix: nits

* chore: update ee ref
2024-05-02 20:21:23 +02:00
Ruben Fiszel ccebe282d5 box flowmodulestatus to reduce stack allocation of flowvalue 2024-05-02 10:28:04 +02:00
Ruben Fiszel 59ecd1de29 box flowmodule to reduce stack allocation of flowvalue 2024-05-02 10:06:16 +02:00
Ruben Fiszel f1cd473253 fix: re-release nit 2024-05-02 01:10:41 +02:00
Ruben Fiszel 961c89f3ec fix: improve schedule editor UX 2024-05-02 00:42:50 +02:00
Ruben Fiszel 4032737cd4 fix: add WM_WORKER_GROUP to get worker group from script 2024-05-01 21:22:53 +02:00
Ruben Fiszel fdf237c4ed feat: add distributed global cache for go 2024-04-26 11:31:21 +02:00
Ruben Fiszel e27d2c0d35 feat: add distributed global cache for go 2024-04-26 11:31:21 +02:00
Ruben Fiszel c5de8365ec feat: support multiple labels for jobs (wm_label -> wm_labels) 2024-04-24 11:32:25 +02:00
Ruben Fiszel ba4efb7b7e feat: add label and schedule filters to runs page 2024-04-23 22:48:21 +02:00
HugoCasa 9e36ae066c feat: hide scripts with on function main from operators + badge/filter for devs (#3584)
* feat: save in DB whether script has not main function

* fix: if cannot parse script args, clear schema

* feat: no main function badge and filter

* fix: sqlx

* fix: no main
2024-04-22 15:59:13 +02:00
wendrul c3325c2cbf Instrument logs (#3566)
* Add spans to show worker_name and job_id

Always show worker_name and job_id when relevant, by creating spans that
live as long as the worker and the job.

* Remove redundant worker names from fn run_worker

Remove the now redundant worker_name tracing, as the information now
lives at the span level

* Use span when spawning new thread

* Instrument more pertinent functions

Move spans to more pertinent functions. Remove more redundant info, and
change worker_name to just worker

* Change tracing subscriber to log path:line_no

Change from logging target (module name usually) to file path and line
number
2024-04-18 01:11:14 +02:00
Ruben Fiszel e571d3c4d0 fix ee links 2024-04-17 22:38:03 +02:00
Ruben Fiszel cb6efb08a2 feat: show more for logs on s3 directly possible from browser log viewer 2024-04-17 21:42:46 +02:00
Ruben Fiszel a1d2c59fce feat: flow concurrency limits support custom concurrency key 2024-04-09 22:03:39 +02:00
HugoCasa b168256a90 feat: git sync group changes by folder (#3517)
* feat: git sync group changes by folder

* chore: update ee ref
2024-04-05 23:07:27 +02:00
HugoCasa 9b6ed95ef2 feat: private hub (#3491)
* feat: private hub v0

* feat: add UI setting

* Update ee.rs

* Update ee.rs

* fix: remove ee symlink

* fix: add back CE ee.rs

* feat: disable s3 embedding loading when private hub

* feat: reload embeddings on hub url change

* fix: only reload embeddings db on server mode

* patch: set default hub url const

* fix: nit
2024-04-04 04:16:53 +02:00
Ruben Fiszel 8c106a7790 allow_http by default for s3 2024-04-03 13:58:52 +02:00
Ruben Fiszel 288b9c8ce4 feat: while loop as new flow primitive 2024-04-02 17:38:11 +02:00
Ruben Fiszel e66d4b6708 continue on error option for steps 2024-04-02 10:32:47 +02:00
Ruben Fiszel 773b524b04 feat: approval steps description 2024-03-27 14:04:14 +01:00
HugoCasa 0e0d964fc8 feat: add visible to runner only default value (#3472) 2024-03-26 19:07:21 +01:00
Ruben Fiszel 6b842b3c53 feat: add set_flow_user_states and get_flow_user_states api and sdk support 2024-03-26 17:31:17 +01:00
HugoCasa 6b719fecea feat: add workspace environment vars (custom contextual vars) (#3455)
* feat: custom contextual variables

* chore: sqlx prepare

* fix: main merge
2024-03-23 11:40:55 +01:00
Ruben Fiszel 7714221f3e feat: large log disk and distributed storage compaction 2024-03-23 10:55:29 +01:00
Ruben Fiszel cdb865dac0 improve cred store error 2024-03-22 18:00:06 +01:00
HugoCasa c2d18a6d6f feat keep sql columns ordering (#3444)
* feat: keep pg columns ordering

* feat: pass column order through flow status

* feat: sql ordering for all sql langs

* fix: sqlx build on mac + rename to _metadata

* Update JobPreview.svelte

* Update +page.svelte

* Update +page.svelte

* Update LogPanel.svelte

* Update +page.svelte

* Update LogPanel.svelte

* Update JobPreview.svelte

* fix: build

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2024-03-22 10:34:32 +01:00
Ruben Fiszel 16b3b659e9 chore: update deps 2024-03-21 13:37:17 +01:00
Ruben Fiszel f8d3ba12af generalize cache object store 2024-03-21 08:50:10 +01:00
Ruben Fiszel 7dafa3d62a fix compile on non ee 2024-03-20 15:09:28 +01:00
Ruben Fiszel a0a42067fb feat: s3 cache config added to instance settings + parallelized tar pulling 2024-03-20 14:19:34 +01:00
Ruben Fiszel 8056ce49af removing pulling all piptars at start 2024-03-17 11:21:43 +01:00
Ruben Fiszel 958df4f62c feat: refactor logging to improve performance by order of magnitude for longer jobs 2024-03-16 17:55:34 +01:00
Ruben Fiszel 543d2a1577 fix: s3 cache is an instance settings (#3421)
* s3

* s3
2024-03-15 15:09:05 +01:00
Ruben Fiszel 74a8816eea fix readme 2024-03-15 10:09:08 +01:00
Ruben Fiszel 7d00d4718e fix: be less agressive with log streaming for long jobs 2024-03-14 19:42:41 +01:00
HugoCasa 62661601f6 feat: git sync users groups (#3391)
* feat: git sync users groups

* fix: sqlx build

* chore: set ee ref + hub sync script
2024-03-12 23:42:59 +01:00
HugoCasa cf4358a14b feat: instance usernames (#3382)
* feat: instance usernames

* fix: sqlx + ee ref

* feat: make one-off button for enabling

* chore: set ee ref

* fix: permissions and nits

* fix: admin instance username + sqlx build

* fix: revert stupid change

* fix: only create instance username when setting enabled

* chore: update to ee latest
2024-03-12 11:55:18 +01:00
Ruben Fiszel 80d92e0b13 fix compile 2024-03-08 23:55:10 +01:00
Ruben Fiszel ee961a31f0 feat: implement s3 oidc support + azure workload identity support 2024-03-08 22:51:16 +01:00
Ruben Fiszel ff3aa8ab06 feat: workflow as code v0 2024-03-04 20:19:34 +01:00
HugoCasa 9aa587c36f feat: add ee flag to common (#3300) 2024-02-27 12:06:48 +01:00
Ruben Fiszel 51269e4652 fix: fix scheduling of overlapping flows 2024-02-27 00:50:03 +01:00
Ruben Fiszel 931bd47d9b improve runs filter 2024-02-27 00:08:37 +01:00
HugoCasa 88d1f7aa83 chore: stats in EE (#3296)
* feat: switch stats to closed source

* fix: remove symlink

* fix: add emptied stats

* fix: remove unneeded imports

* fix: embedding feature flag

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2024-02-26 20:08:22 +01:00
Ruben Fiszel b603d63bd5 revert ee 2024-02-24 17:26:35 +01:00
Ruben Fiszel c3ef987e28 chore: fasten compilation time 2024-02-24 17:10:55 +01:00
Ruben Fiszel 82c8b1d1dd chore: fasten compilation time 2024-02-24 16:29:35 +01:00
Ruben Fiszel 81be9c4d60 fix: make setting owner for folders a transaction 2024-02-23 23:12:50 +01:00