Commit Graph
1188 Commits
Author SHA1 Message Date
Ruben Fiszel 9745eec4d4 bash nits 2024-03-16 18:52:17 +01:00
Ruben Fiszel 6f2f9b7ec2 nits logging 2024-03-16 18:30:51 +01:00
Ruben Fiszel 958df4f62c feat: refactor logging to improve performance by order of magnitude for longer jobs 2024-03-16 17:55:34 +01:00
Ruben Fiszel 543d2a1577 fix: s3 cache is an instance settings (#3421)
* s3

* s3
2024-03-15 15:09:05 +01:00
Ruben Fiszel e5aec9c445 fix: improve pip_secret interpolation 2024-03-15 11:17:41 +01:00
Ruben Fiszel bda7ac3669 fix: avoid unecessary re-schedule for retyied flows 2024-03-15 09:53:58 +01:00
Ruben Fiszel 8144813d61 fix jobs metrics 2024-03-14 19:53:38 +01:00
Ruben Fiszel e163c66777 add NO_LOGS_AT_ALL 2024-03-14 19:47:46 +01:00
Ruben Fiszel 7d00d4718e fix: be less agressive with log streaming for long jobs 2024-03-14 19:42:41 +01:00
72bf49b757 feat: better locking (#3412)
* earlyBackendStop

* fix(frontend): Flow step input description (#3409)

* fix(frontend): Add missing descrpition in a flow step input

* fix(frontend): Add missing descrpition in a flow step input

* fix(frontend): Fix color picker layout (#3411)

* feat: add bit support in pg (#3407)

* fix sqlx

* fix: remove dependency on semver intersect for bun

* sqlx fix

* improve early kill behavior

---------

Co-authored-by: Faton Ramadani <faton.ramadani14@gmail.com>
Co-authored-by: HugoCasa <hugo@casademont.ch>
2024-03-14 13:57:54 +01:00
HugoCasa c0104641f0 feat: add bit support in pg (#3407) 2024-03-14 10:40:20 +01:00
Ruben Fiszel a3a874d56d fix warnings 2024-03-08 23:20:54 +01:00
Ruben Fiszel ee961a31f0 feat: implement s3 oidc support + azure workload identity support 2024-03-08 22:51:16 +01:00
HugoCasa c03c73797b fix: pg timstamptz param (#3364) 2024-03-06 12:50:01 +01:00
Ruben Fiszel 14154d2e79 feat: workflow as code for typescript 2024-03-05 23:14:04 +01:00
Ruben Fiszel 426c2a87b5 feat: workflow as code with timelines 2024-03-05 12:45:24 +01:00
Ruben Fiszel ff3aa8ab06 feat: workflow as code v0 2024-03-04 20:19:34 +01:00
Ruben Fiszel 93e95c7210 nit vacuum iterator 2024-03-02 13:51:28 +01:00
Ruben Fiszel 6a0bf15572 fix: fix flow progress monitor when using parallel branches and continuing long after 2024-03-01 12:01:17 +01:00
Ruben Fiszel 3c1e4b09a8 feat: implement progress monitor for parallel branches last transition 2024-02-28 08:49:35 +01:00
Ruben Fiszel 47cee1b1e3 fix: solve deadlock issues for parallel branches with new progress monitor 2024-02-27 20:59:26 +01:00
HugoCasa 1ee45a1f7d feat: allow to pin database in sql scripts (#3304) 2024-02-27 19:59:52 +01:00
HugoCasa 69214069c3 fix: handle very large ints as floats in snowflake (#3302) 2024-02-27 16:40:55 +01:00
Ruben Fiszel cd43297ec8 fix: improve handling of parallel flow branches of more than 30s 2024-02-27 16:33:13 +01:00
Ruben Fiszel 51269e4652 fix: fix scheduling of overlapping flows 2024-02-27 00:50:03 +01:00
Ruben Fiszel 83120fe4b4 fix: crash on init script failure 2024-02-26 19:50:33 +01:00
Ruben Fiszel 103e289aa7 more debug lines, remove telemetry for agents 2024-02-26 17:02:40 +01:00
HugoCasa bc9e2381b8 fix: add bigint support to mysql (#3294) 2024-02-26 16:59:36 +01:00
Ruben Fiszel c540c92fdc fix: add HOME to pip install 2024-02-26 15:33:45 +01:00
Ruben Fiszel d951d17b78 fix: add HOME to pip install 2024-02-26 15:27:56 +01:00
Ruben Fiszel e3b1e5fe06 fix: handle better flow hanging monitor 2024-02-26 15:09:39 +01:00
Ruben Fiszel efbba24581 feat: more resilient flows in case of crash during transitions 2024-02-25 18:25:40 +01:00
Ruben Fiszel 594fa42767 reactivate parquet features 2024-02-24 17:55:17 +01:00
Ruben Fiszel 75d736ca7e reactivate parquet features 2024-02-24 17:44:43 +01:00
Ruben Fiszel c3ef987e28 chore: fasten compilation time 2024-02-24 17:10:55 +01:00
Ruben Fiszel 82c8b1d1dd chore: fasten compilation time 2024-02-24 16:29:35 +01:00
Ruben Fiszel 2d6ba9528b fix: improve support for singlescriptflow 2024-02-23 21:06:55 +01:00
Ruben Fiszel 2ee069a1b8 fix(python): handle recursive python imports with loop 2024-02-20 19:42:11 +01:00
Ruben Fiszel c7d04bfa88 fix: prevent bigquery/snowflake against abuse timeout 2024-02-20 01:56:04 +01:00
Ruben Fiszel 585134e6af feat: allow arbitrary timeout on graphql 2024-02-20 00:45:42 +01:00
Ruben Fiszel e4c763d513 feat: add support for mem peak to nativets scripts 2024-02-19 23:38:27 +01:00
Ruben Fiszel 6e82575309 fix: prevent native http against timeout abuse 2024-02-19 23:28:06 +01:00
Ruben Fiszel d414e9fff9 refactor future wrapper for queries 2024-02-19 22:11:45 +01:00
Ruben Fiszel 37e80ca1a4 fix(psql): add mem peak to postgresql 2024-02-19 20:51:09 +01:00
Ruben Fiszel fa9d5af10e respect query timeout for pg queries 2024-02-19 20:11:28 +01:00
Ruben Fiszel 52b2b5048d fix: prevent postgres timeout abuse 2024-02-19 19:59:43 +01:00
HugoCasa 9288d909b9 fix: bigquery timeout (#3244)
* fix: bigquery timeout

* fix: use default timeout instead
2024-02-19 17:56:19 +01:00
HugoCasa aa71b7363b fix: remove oom prio macos (#3245) 2024-02-19 12:36:57 +01:00
HugoCasa 987a764476 fix: backend build on macos (#3243) 2024-02-19 09:58:12 +01:00
Ruben Fiszel 879a6cda00 chore: remove warnings 2024-02-18 14:03:00 +01:00