Commit Graph

465 Commits

Author SHA1 Message Date
wendrul c3325c2cbf Instrument logs (#3566)
* Add spans to show worker_name and job_id

Always show worker_name and job_id when relevant, by creating spans that
live as long as the worker and the job.

* Remove redundant worker names from fn run_worker

Remove the now redundant worker_name tracing, as the information now
lives at the span level

* Use span when spawning new thread

* Instrument more pertinent functions

Move spans to more pertinent functions. Remove more redundant info, and
change worker_name to just worker

* Change tracing subscriber to log path:line_no

Change from logging target (module name usually) to file path and line
number
2024-04-18 01:11:14 +02:00
Ruben Fiszel e571d3c4d0 fix ee links 2024-04-17 22:38:03 +02:00
Ruben Fiszel cb6efb08a2 feat: show more for logs on s3 directly possible from browser log viewer 2024-04-17 21:42:46 +02:00
Ruben Fiszel a1d2c59fce feat: flow concurrency limits support custom concurrency key 2024-04-09 22:03:39 +02:00
HugoCasa b168256a90 feat: git sync group changes by folder (#3517)
* feat: git sync group changes by folder

* chore: update ee ref
2024-04-05 23:07:27 +02:00
HugoCasa 9b6ed95ef2 feat: private hub (#3491)
* feat: private hub v0

* feat: add UI setting

* Update ee.rs

* Update ee.rs

* fix: remove ee symlink

* fix: add back CE ee.rs

* feat: disable s3 embedding loading when private hub

* feat: reload embeddings on hub url change

* fix: only reload embeddings db on server mode

* patch: set default hub url const

* fix: nit
2024-04-04 04:16:53 +02:00
Ruben Fiszel 8c106a7790 allow_http by default for s3 2024-04-03 13:58:52 +02:00
Ruben Fiszel 288b9c8ce4 feat: while loop as new flow primitive 2024-04-02 17:38:11 +02:00
Ruben Fiszel e66d4b6708 continue on error option for steps 2024-04-02 10:32:47 +02:00
Ruben Fiszel 773b524b04 feat: approval steps description 2024-03-27 14:04:14 +01:00
HugoCasa 0e0d964fc8 feat: add visible to runner only default value (#3472) 2024-03-26 19:07:21 +01:00
Ruben Fiszel 6b842b3c53 feat: add set_flow_user_states and get_flow_user_states api and sdk support 2024-03-26 17:31:17 +01:00
HugoCasa 6b719fecea feat: add workspace environment vars (custom contextual vars) (#3455)
* feat: custom contextual variables

* chore: sqlx prepare

* fix: main merge
2024-03-23 11:40:55 +01:00
Ruben Fiszel 7714221f3e feat: large log disk and distributed storage compaction 2024-03-23 10:55:29 +01:00
Ruben Fiszel cdb865dac0 improve cred store error 2024-03-22 18:00:06 +01:00
HugoCasa c2d18a6d6f feat keep sql columns ordering (#3444)
* feat: keep pg columns ordering

* feat: pass column order through flow status

* feat: sql ordering for all sql langs

* fix: sqlx build on mac + rename to _metadata

* Update JobPreview.svelte

* Update +page.svelte

* Update +page.svelte

* Update LogPanel.svelte

* Update +page.svelte

* Update LogPanel.svelte

* Update JobPreview.svelte

* fix: build

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2024-03-22 10:34:32 +01:00
Ruben Fiszel 16b3b659e9 chore: update deps 2024-03-21 13:37:17 +01:00
Ruben Fiszel f8d3ba12af generalize cache object store 2024-03-21 08:50:10 +01:00
Ruben Fiszel 7dafa3d62a fix compile on non ee 2024-03-20 15:09:28 +01:00
Ruben Fiszel a0a42067fb feat: s3 cache config added to instance settings + parallelized tar pulling 2024-03-20 14:19:34 +01:00
Ruben Fiszel 8056ce49af removing pulling all piptars at start 2024-03-17 11:21:43 +01:00
Ruben Fiszel 958df4f62c feat: refactor logging to improve performance by order of magnitude for longer jobs 2024-03-16 17:55:34 +01:00
Ruben Fiszel 543d2a1577 fix: s3 cache is an instance settings (#3421)
* s3

* s3
2024-03-15 15:09:05 +01:00
Ruben Fiszel 74a8816eea fix readme 2024-03-15 10:09:08 +01:00
Ruben Fiszel 7d00d4718e fix: be less agressive with log streaming for long jobs 2024-03-14 19:42:41 +01:00
HugoCasa 62661601f6 feat: git sync users groups (#3391)
* feat: git sync users groups

* fix: sqlx build

* chore: set ee ref + hub sync script
2024-03-12 23:42:59 +01:00
HugoCasa cf4358a14b feat: instance usernames (#3382)
* feat: instance usernames

* fix: sqlx + ee ref

* feat: make one-off button for enabling

* chore: set ee ref

* fix: permissions and nits

* fix: admin instance username + sqlx build

* fix: revert stupid change

* fix: only create instance username when setting enabled

* chore: update to ee latest
2024-03-12 11:55:18 +01:00
Ruben Fiszel 80d92e0b13 fix compile 2024-03-08 23:55:10 +01:00
Ruben Fiszel ee961a31f0 feat: implement s3 oidc support + azure workload identity support 2024-03-08 22:51:16 +01:00
Ruben Fiszel ff3aa8ab06 feat: workflow as code v0 2024-03-04 20:19:34 +01:00
Ruben Fiszel 51269e4652 fix: fix scheduling of overlapping flows 2024-02-27 00:50:03 +01:00
Ruben Fiszel 931bd47d9b improve runs filter 2024-02-27 00:08:37 +01:00
HugoCasa 88d1f7aa83 chore: stats in EE (#3296)
* feat: switch stats to closed source

* fix: remove symlink

* fix: add emptied stats

* fix: remove unneeded imports

* fix: embedding feature flag

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2024-02-26 20:08:22 +01:00
Ruben Fiszel b603d63bd5 revert ee 2024-02-24 17:26:35 +01:00
Ruben Fiszel c3ef987e28 chore: fasten compilation time 2024-02-24 17:10:55 +01:00
Ruben Fiszel 82c8b1d1dd chore: fasten compilation time 2024-02-24 16:29:35 +01:00
Ruben Fiszel 81be9c4d60 fix: make setting owner for folders a transaction 2024-02-23 23:12:50 +01:00
Ruben Fiszel 2d6ba9528b fix: improve support for singlescriptflow 2024-02-23 21:06:55 +01:00
Ruben Fiszel 76fba8f125 revert ee links 2024-02-22 15:28:18 +01:00
Ruben Fiszel bea6c221d8 fix: fix sqlx build 2024-02-22 15:11:36 +01:00
Ruben Fiszel 2912ad99d5 revert ee symlink change 2024-02-22 14:41:39 +01:00
Ruben Fiszel 75eaa4bd30 fix: improve scim handling of renames on azure 2024-02-22 14:35:40 +01:00
Ruben Fiszel f11aae013f lighten schedule export 2024-02-21 22:39:01 +01:00
Ruben Fiszel f134a8aeff fix: fix app policy quote escaping 2024-02-21 21:44:44 +01:00
HugoCasa 987a764476 fix: backend build on macos (#3243) 2024-02-19 09:58:12 +01:00
Ruben Fiszel 1a8285a06f feat: scim token and saml metadata setting in UI directly
chore(main): release 1.271.0 (#3237)

* chore(main): release 1.271.0

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>

fix test

revert ee changes

revert ee changes
2024-02-18 07:26:12 +01:00
Ruben Fiszel ccbb1d9305 add support for pip index url 2024-02-17 15:58:20 +01:00
Mikhail Zagurskiy 6a9b11463f Fix build for Windows (#3235)
* Fix build for Windows

* Fix typo
2024-02-17 10:45:38 +01:00
Ruben Fiszel 233f777b12 print SAML_METADATA in logs 2024-02-16 20:52:12 +01:00
Guillaume Bouvignies 4990ac79c6 chore: License validation and Audit logs EE (#3227)
* chore: audit log EE

* update repo ref

* license key validation EE
2024-02-15 16:51:24 +01:00