Commit Graph

96 Commits

Author SHA1 Message Date
Ruben Fiszel ba76d8749a fix: improve support of relative paths in subflows and apps 2024-06-21 18:07:58 +02:00
Ruben Fiszel 5ae8592792 feat: track dependency map for bun + inline script of flows 2024-06-08 16:43:48 +02:00
Ruben Fiszel 017710f17d improve bun dedicated worker to use nodejs 2024-05-01 02:10:58 +02:00
Ruben Fiszel 1eeaa277f0 add base_internal_url to dedicated python workers 2024-04-30 22:48:40 +02:00
Ruben Fiszel eb873c6119 more logs for dedicated workers 2024-04-30 17:19:34 +02:00
Ruben Fiszel cf6ffef48a fix(python): supports folders starting with numbers for execution 2024-04-30 11:23:48 +02:00
wendrul ac841400ba Instrument logs (#3566)
* Add spans to show worker_name and job_id

Always show worker_name and job_id when relevant, by creating spans that
live as long as the worker and the job.

* Remove redundant worker names from fn run_worker

Remove the now redundant worker_name tracing, as the information now
lives at the span level

* Use span when spawning new thread

* Instrument more pertinent functions

Move spans to more pertinent functions. Remove more redundant info, and
change worker_name to just worker

* Change tracing subscriber to log path:line_no

Change from logging target (module name usually) to file path and line
number
2024-04-18 01:11:14 +02:00
Ruben Fiszel d2afc05703 fix: add support for azure storage on distributed cache/logs 2024-03-23 18:42:38 +01:00
HugoCasa 283d55008c feat: add workspace environment vars (custom contextual vars) (#3455)
* feat: custom contextual variables

* chore: sqlx prepare

* fix: main merge
2024-03-23 11:40:55 +01:00
Ruben Fiszel 75e9e67d7a feat: large log disk and distributed storage compaction 2024-03-23 10:55:29 +01:00
Ruben Fiszel 030f6c553e generalize cache object store 2024-03-21 08:50:10 +01:00
Ruben Fiszel 52d00d9c58 fix compile on non ee 2024-03-20 15:34:25 +01:00
Ruben Fiszel 745bd4d170 fix compile on non ee 2024-03-20 15:09:28 +01:00
Ruben Fiszel 174ead0473 feat: s3 cache config added to instance settings + parallelized tar pulling 2024-03-20 14:19:34 +01:00
Ruben Fiszel ca88047312 fix: allow multiple PIP_SECRETS 2024-03-17 15:15:36 +01:00
Ruben Fiszel e5366b84bb feat: refactor logging to improve performance by order of magnitude for longer jobs 2024-03-16 17:55:34 +01:00
Ruben Fiszel ae661365e4 fix: s3 cache is an instance settings (#3421)
* s3

* s3
2024-03-15 15:09:05 +01:00
Ruben Fiszel 71f7299b6c fix: improve pip_secret interpolation 2024-03-15 11:17:41 +01:00
Ruben Fiszel e3e86e5c34 feat: workflow as code for typescript 2024-03-05 23:14:04 +01:00
Ruben Fiszel 55c80959a0 feat: workflow as code with timelines 2024-03-05 12:45:24 +01:00
Ruben Fiszel 619e2784f0 feat: workflow as code v0 2024-03-04 20:19:34 +01:00
Ruben Fiszel ee0f8b6914 fix: add HOME to pip install 2024-02-26 15:27:56 +01:00
Ruben Fiszel bf3e417acc fix(python): handle recursive python imports with loop 2024-02-20 19:42:11 +01:00
Ruben Fiszel 77aaf2724c chore: remove warnings 2024-02-18 14:03:00 +01:00
Ruben Fiszel 1de8479259 add support for pip index url 2024-02-17 15:58:20 +01:00
Ruben Fiszel 0a5bf33beb fix compile 2024-02-10 00:40:53 +01:00
Ryan Doyle b230378320 fix: Properly handle pip index urls in pip-compile (#3192)
- URLs that contain simple auth seem to have that stripped before being
  passed to underlying pip if it needs to be called by pip-compile.
- This forces explicit passing of the complete, authenticated url
  string to pip, through pip-compile, via pip-compile's "--pip-args"
  argument.
2024-02-10 00:29:08 +01:00
Ruben Fiszel 7845ad0d18 add tracing debug to pip compile 2024-02-09 22:38:52 +01:00
Ruben Fiszel e5a447d699 add tracing debug to pip install command args 2024-02-09 22:35:59 +01:00
Ruben Fiszel e4dc972d40 fix: handle better \u0000 in python result 2024-02-08 16:02:38 +01:00
Ruben Fiszel 95952da387 fix: add support for ephemeral tokens 2024-02-03 12:09:39 +01:00
Audrius Butkevicius ec911f6a5a feat: Passing HOME env var through to python workers (#3092)
* feat: Allow passing through certain environment variables

* Lookup the env vars on startup

* Faceplam

* Update python_executor.rs
2024-01-27 15:49:29 +01:00
Ruben Fiszel a66208f326 fix(scim): improve get_user for scim 2024-01-24 20:23:42 +01:00
Ruben Fiszel 450267a84e fix: no-emit-index-url on lockfiles 2024-01-24 12:47:19 +01:00
Ruben Fiszel 00d3305592 fix build 2024-01-23 20:15:32 +01:00
Ruben Fiszel 9121eb0a74 remove denogobuncache 2024-01-23 19:54:07 +01:00
Ruben Fiszel 640ebcb146 feat: OIDC support (#3017)
* oidc

* update

* feat: add support for multiselect in python

* d

* d

* progress

* all

* all

* all
2024-01-16 23:32:26 +01:00
Ruben Fiszel dff1948a64 add step_id to errors in flows 2024-01-13 13:46:42 +01:00
Ruben Fiszel 605a61c378 replace tracing log 2024-01-10 13:54:58 +01:00
Ruben Fiszel 3517c7f283 feat: add ability to use secrets in pip requirements 2024-01-10 13:12:20 +01:00
Ruben Fiszel e0140f175d feat: PIP_LOCAL_DEPENDENCIES now accepts regex and is configurable from the UI (#2940)
* fix(frontend): Fix decision tree (#2928)

* fix(frontend): wip

* fix(frontend): wip

* fix(frontend): decision tree history

* fix(frontend): fix wording

* feat: PIP_LOCAL_DEPENDENCIES now accepts regex

* Add worker config FE

---------

Co-authored-by: Faton Ramadani <faton.ramadani14@gmail.com>
Co-authored-by: gbouv <guillaume@windmill.dev>
2023-12-30 03:35:04 +01:00
Guillaume Bouvignies 5f85b67dfc fix: Failing jobs in dedicated worker mode are now marked as failing (#2894)
* fix: Failing jobs in dedicated worker mode are now marked as failing

* remove log line

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2023-12-21 10:29:26 +01:00
Guillaume Bouvignies 4c3c988f7b fix: Python wrapper catches BaseException instead of Exception (#2902) 2023-12-21 10:26:13 +01:00
Guillaume Bouvignies 292b2309a7 fix: Python imports from git repository (#2886) 2023-12-20 13:00:51 +09:00
Guillaume Bouvignies 350c8e843f feat: EnvVar allow list is configurable from the UI (#2829)
* feat: EnvVar allow list is configurable from the UI

* variable renaming
2023-12-12 07:04:55 +01:00
HugoCasa c58190ef78 feat: limit pro plans (#2794) 2023-12-06 17:47:32 +01:00
Guillaume Bouvignies 3d6fb15a90 fix: minor fixes to private NPM and python registries to get everything working (#2728) 2023-11-29 16:30:45 +01:00
Guillaume Bouvignies 15ebf46abc chore: Add examples on how to deploy private registries (#2719)
* chore: Add examples on how to deploy private registries

* chore: example for private pypiserver with https

* Allow DENO_CERT certificate with native workers

* Add BUN_TLS_REJECT_UNAUTHORIZED
2023-11-29 11:38:23 +01:00
Ruben Fiszel aa6bf4027f fix base_internal_url 2023-11-20 02:03:41 +01:00
Ruben Fiszel fa3efd3f60 fix: handle console logs in dedicated workers 2023-11-11 13:39:06 +01:00