Commit Graph
662 Commits
Author SHA1 Message Date
Ruben Fiszel e5366b84bb feat: refactor logging to improve performance by order of magnitude for longer jobs 2024-03-16 17:55:34 +01:00
Ruben Fiszel ae661365e4 fix: s3 cache is an instance settings (#3421)
* s3

* s3
2024-03-15 15:09:05 +01:00
Ruben Fiszel 71f7299b6c fix: improve pip_secret interpolation 2024-03-15 11:17:41 +01:00
Ruben Fiszel 89516b922f fix: avoid unecessary re-schedule for retyied flows 2024-03-15 09:53:58 +01:00
Ruben Fiszel e5f7bcf1a6 fix jobs metrics 2024-03-14 19:53:38 +01:00
Ruben Fiszel 47d96c0d97 add NO_LOGS_AT_ALL 2024-03-14 19:47:46 +01:00
Ruben Fiszel df910d7441 fix: be less agressive with log streaming for long jobs 2024-03-14 19:42:41 +01:00
97d4f1cc26 feat: better locking (#3412)
* earlyBackendStop

* fix(frontend): Flow step input description (#3409)

* fix(frontend): Add missing descrpition in a flow step input

* fix(frontend): Add missing descrpition in a flow step input

* fix(frontend): Fix color picker layout (#3411)

* feat: add bit support in pg (#3407)

* fix sqlx

* fix: remove dependency on semver intersect for bun

* sqlx fix

* improve early kill behavior

---------

Co-authored-by: Faton Ramadani <faton.ramadani14@gmail.com>
Co-authored-by: HugoCasa <hugo@casademont.ch>
2024-03-14 13:57:54 +01:00
Ruben Fiszel 1cf6d8b462 fix: remove dependency on semver intersect for bun 2024-03-14 12:36:38 +01:00
HugoCasa 3730566844 feat: add bit support in pg (#3407) 2024-03-14 10:40:20 +01:00
Ruben Fiszel 9e0ba03e6d fix warnings 2024-03-08 23:20:54 +01:00
Ruben Fiszel 4578ed32da feat: implement s3 oidc support + azure workload identity support 2024-03-08 22:51:16 +01:00
HugoCasa c04adcca86 fix: pg timstamptz param (#3364) 2024-03-06 12:50:01 +01:00
Ruben Fiszel e3e86e5c34 feat: workflow as code for typescript 2024-03-05 23:14:04 +01:00
Ruben Fiszel 55c80959a0 feat: workflow as code with timelines 2024-03-05 12:45:24 +01:00
Ruben Fiszel 619e2784f0 feat: workflow as code v0 2024-03-04 20:19:34 +01:00
Ruben Fiszel 161436644e nit vacuum iterator 2024-03-02 13:51:28 +01:00
Ruben Fiszel 07fb3754af fix: fix flow progress monitor when using parallel branches and continuing long after 2024-03-01 12:01:17 +01:00
Ruben Fiszel fc34594aeb feat: implement progress monitor for parallel branches last transition 2024-02-28 08:49:35 +01:00
Ruben Fiszel be7c03bda2 fix: solve deadlock issues for parallel branches with new progress monitor 2024-02-27 20:59:26 +01:00
HugoCasa 1c6e767617 feat: allow to pin database in sql scripts (#3304) 2024-02-27 19:59:52 +01:00
HugoCasa 66e46990b2 fix: handle very large ints as floats in snowflake (#3302) 2024-02-27 16:40:55 +01:00
Ruben Fiszel 4285f1e47d fix: improve handling of parallel flow branches of more than 30s 2024-02-27 16:33:13 +01:00
HugoCasa ec10b3ff81 feat: add ee flag to common (#3300) 2024-02-27 12:06:48 +01:00
Ruben Fiszel 49be282d21 fix: fix scheduling of overlapping flows 2024-02-27 00:50:03 +01:00
Ruben Fiszel c7f6e6f9d5 fix: crash on init script failure 2024-02-26 19:50:33 +01:00
Ruben Fiszel 321da6ce30 more debug lines, remove telemetry for agents 2024-02-26 17:02:40 +01:00
HugoCasa 6a0ed19c80 fix: add bigint support to mysql (#3294) 2024-02-26 16:59:36 +01:00
Ruben Fiszel b24225124a fix: add HOME to pip install 2024-02-26 15:33:45 +01:00
Ruben Fiszel ee0f8b6914 fix: add HOME to pip install 2024-02-26 15:27:56 +01:00
Ruben Fiszel 024f80aee4 fix: handle better flow hanging monitor 2024-02-26 15:09:39 +01:00
Ruben Fiszel 136c04eed4 fix: improve relative bun loader 2024-02-25 19:18:10 +01:00
Ruben Fiszel 32a45b544d feat: more resilient flows in case of crash during transitions 2024-02-25 18:25:40 +01:00
Ruben Fiszel a413541fa6 reactivate parquet features 2024-02-24 17:55:17 +01:00
Ruben Fiszel 5172a4e994 reactivate parquet features 2024-02-24 17:44:43 +01:00
Ruben Fiszel 665d0d5ef1 chore: fasten compilation time 2024-02-24 17:10:55 +01:00
Ruben Fiszel 494ce162c0 chore: fasten compilation time 2024-02-24 16:29:35 +01:00
Ruben Fiszel 0df43221ec fix: improve support for singlescriptflow 2024-02-23 21:06:55 +01:00
Ruben Fiszel bf3e417acc fix(python): handle recursive python imports with loop 2024-02-20 19:42:11 +01:00
Ruben Fiszel 3761de874e fix: prevent bigquery/snowflake against abuse timeout 2024-02-20 01:56:04 +01:00
Ruben Fiszel 66fc78f233 feat: allow arbitrary timeout on graphql 2024-02-20 00:45:42 +01:00
Ruben Fiszel 18bb982852 feat: add support for mem peak to nativets scripts 2024-02-19 23:38:27 +01:00
Ruben Fiszel e28fbc9c97 fix: prevent native http against timeout abuse 2024-02-19 23:28:06 +01:00
Ruben Fiszel 8e21532684 refactor future wrapper for queries 2024-02-19 22:11:45 +01:00
Ruben Fiszel f129e75628 fix(psql): add mem peak to postgresql 2024-02-19 20:51:09 +01:00
Ruben Fiszel a3320fe144 respect query timeout for pg queries 2024-02-19 20:11:28 +01:00
Ruben Fiszel d35c67c9b9 fix: prevent postgres timeout abuse 2024-02-19 19:59:43 +01:00
HugoCasa be3f9125af fix: bigquery timeout (#3244)
* fix: bigquery timeout

* fix: use default timeout instead
2024-02-19 17:56:19 +01:00
HugoCasa 6ccca62876 fix: remove oom prio macos (#3245) 2024-02-19 12:36:57 +01:00
HugoCasa 458550f314 fix: backend build on macos (#3243) 2024-02-19 09:58:12 +01:00