Commit Graph

1785 Commits

Author SHA1 Message Date
Ruben Fiszel d63f5ee26e fix: add support for azure storage on distributed cache/logs 2024-03-23 18:42:38 +01:00
Ruben Fiszel 3279996fd2 feat(frontend): fetch logs just-in-time only when necessary 2024-03-23 15:57:23 +01:00
HugoCasa 6b719fecea feat: add workspace environment vars (custom contextual vars) (#3455)
* feat: custom contextual variables

* chore: sqlx prepare

* fix: main merge
2024-03-23 11:40:55 +01:00
Ruben Fiszel 2339060de1 nit newline 2024-03-23 11:33:10 +01:00
Ruben Fiszel 7714221f3e feat: large log disk and distributed storage compaction 2024-03-23 10:55:29 +01:00
HugoCasa c2d18a6d6f feat keep sql columns ordering (#3444)
* feat: keep pg columns ordering

* feat: pass column order through flow status

* feat: sql ordering for all sql langs

* fix: sqlx build on mac + rename to _metadata

* Update JobPreview.svelte

* Update +page.svelte

* Update +page.svelte

* Update LogPanel.svelte

* Update +page.svelte

* Update LogPanel.svelte

* Update JobPreview.svelte

* fix: build

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2024-03-22 10:34:32 +01:00
Ruben Fiszel f8d3ba12af generalize cache object store 2024-03-21 08:50:10 +01:00
Ruben Fiszel a012ea0768 fix compile on non ee 2024-03-20 16:55:06 +01:00
Ruben Fiszel 169bfd761d fix compile on non ee 2024-03-20 16:41:23 +01:00
Ruben Fiszel d616735174 fix compile on non ee 2024-03-20 15:34:25 +01:00
Ruben Fiszel fcf5cadd69 remove tmpcache 2024-03-20 15:32:55 +01:00
Ruben Fiszel 8718d038f4 fix compile on non ee 2024-03-20 15:18:54 +01:00
Ruben Fiszel 7dafa3d62a fix compile on non ee 2024-03-20 15:09:28 +01:00
Ruben Fiszel a0a42067fb feat: s3 cache config added to instance settings + parallelized tar pulling 2024-03-20 14:19:34 +01:00
HugoCasa 10d2cd41de fix: ai prevent python async + max db schema length (#3440) 2024-03-19 08:17:51 +01:00
Ruben Fiszel 4788c393e9 avoid caching binary on cloud 2024-03-17 19:13:51 +01:00
Ruben Fiszel ab18058405 fix: allow multiple PIP_SECRETS 2024-03-17 15:15:36 +01:00
Ruben Fiszel 805415d95b chore: openidconnect is a feature flag 2024-03-17 13:51:58 +01:00
Ruben Fiszel 8056ce49af removing pulling all piptars at start 2024-03-17 11:21:43 +01:00
Ruben Fiszel 6854728569 fix: disapproval does not trigger flow error handler anymore 2024-03-17 11:08:02 +01:00
Ruben Fiszel fd57b40064 log nits 2024-03-16 19:01:58 +01:00
Ruben Fiszel 9745eec4d4 bash nits 2024-03-16 18:52:17 +01:00
Ruben Fiszel 6f2f9b7ec2 nits logging 2024-03-16 18:30:51 +01:00
Ruben Fiszel 958df4f62c feat: refactor logging to improve performance by order of magnitude for longer jobs 2024-03-16 17:55:34 +01:00
Ruben Fiszel 543d2a1577 fix: s3 cache is an instance settings (#3421)
* s3

* s3
2024-03-15 15:09:05 +01:00
Ruben Fiszel e5aec9c445 fix: improve pip_secret interpolation 2024-03-15 11:17:41 +01:00
Ruben Fiszel bda7ac3669 fix: avoid unecessary re-schedule for retyied flows 2024-03-15 09:53:58 +01:00
Ruben Fiszel 8144813d61 fix jobs metrics 2024-03-14 19:53:38 +01:00
Ruben Fiszel e163c66777 add NO_LOGS_AT_ALL 2024-03-14 19:47:46 +01:00
Ruben Fiszel 7d00d4718e fix: be less agressive with log streaming for long jobs 2024-03-14 19:42:41 +01:00
Ruben Fiszel 72bf49b757 feat: better locking (#3412)
* earlyBackendStop

* fix(frontend): Flow step input description (#3409)

* fix(frontend): Add missing descrpition in a flow step input

* fix(frontend): Add missing descrpition in a flow step input

* fix(frontend): Fix color picker layout (#3411)

* feat: add bit support in pg (#3407)

* fix sqlx

* fix: remove dependency on semver intersect for bun

* sqlx fix

* improve early kill behavior

---------

Co-authored-by: Faton Ramadani <faton.ramadani14@gmail.com>
Co-authored-by: HugoCasa <hugo@casademont.ch>
2024-03-14 13:57:54 +01:00
Ruben Fiszel daa8f0a33b fix: remove dependency on semver intersect for bun 2024-03-14 12:36:38 +01:00
HugoCasa c0104641f0 feat: add bit support in pg (#3407) 2024-03-14 10:40:20 +01:00
Ruben Fiszel a3a874d56d fix warnings 2024-03-08 23:20:54 +01:00
Ruben Fiszel ee961a31f0 feat: implement s3 oidc support + azure workload identity support 2024-03-08 22:51:16 +01:00
HugoCasa c03c73797b fix: pg timstamptz param (#3364) 2024-03-06 12:50:01 +01:00
Ruben Fiszel 14154d2e79 feat: workflow as code for typescript 2024-03-05 23:14:04 +01:00
Ruben Fiszel 426c2a87b5 feat: workflow as code with timelines 2024-03-05 12:45:24 +01:00
Ruben Fiszel ff3aa8ab06 feat: workflow as code v0 2024-03-04 20:19:34 +01:00
Ruben Fiszel 93e95c7210 nit vacuum iterator 2024-03-02 13:51:28 +01:00
Ruben Fiszel 6a0bf15572 fix: fix flow progress monitor when using parallel branches and continuing long after 2024-03-01 12:01:17 +01:00
Ruben Fiszel 3c1e4b09a8 feat: implement progress monitor for parallel branches last transition 2024-02-28 08:49:35 +01:00
Ruben Fiszel 47cee1b1e3 fix: solve deadlock issues for parallel branches with new progress monitor 2024-02-27 20:59:26 +01:00
HugoCasa 1ee45a1f7d feat: allow to pin database in sql scripts (#3304) 2024-02-27 19:59:52 +01:00
HugoCasa 69214069c3 fix: handle very large ints as floats in snowflake (#3302) 2024-02-27 16:40:55 +01:00
Ruben Fiszel cd43297ec8 fix: improve handling of parallel flow branches of more than 30s 2024-02-27 16:33:13 +01:00
HugoCasa 9aa587c36f feat: add ee flag to common (#3300) 2024-02-27 12:06:48 +01:00
Ruben Fiszel 51269e4652 fix: fix scheduling of overlapping flows 2024-02-27 00:50:03 +01:00
Ruben Fiszel 83120fe4b4 fix: crash on init script failure 2024-02-26 19:50:33 +01:00
Ruben Fiszel 103e289aa7 more debug lines, remove telemetry for agents 2024-02-26 17:02:40 +01:00