Commit Graph
1002 Commits
Author SHA1 Message Date
Ruben Fiszel 7674eadf47 flow editor improvements 2024-12-18 00:21:25 +01:00
Lucas Abel dab7b39917 feat(cache): remove persistent raw values from queue (#4866)
* feat(cache): remove persistent raw values from queue

* test: add tests and fix discovered regressions

* fix csharp executor after rebase

* invalidate script cache after locking

* fix lite flow version race

* fix flow dependencies lock race

* update version flag to `v.1.440`
2024-12-16 17:10:16 +01:00
Ruben Fiszel 330a6352d0 make rust optional 2024-12-15 10:00:22 +01:00
Ruben Fiszel fd462a7038 feature gates more feature for faster compilation (#4928)
* cleanup

* cleanup

* all

* all

* all

* all
2024-12-15 00:00:37 +01:00
HugoCasa 95f4d15ffe more feature flags (#4918)
* more feature flags

* include python in tests

* smtp feature flag

* del

* add back file

* fix openapi int
2024-12-14 13:21:28 +01:00
wendrul 87f6e84fec fix: add DOTNET_ROOT env variable (#4921) 2024-12-13 17:54:56 +01:00
wendrul 4f64b3e530 Target dotnet 9.0 for C# (#4920) 2024-12-13 15:41:39 +01:00
wendrul 10c54565d6 fix: c#: nsjail image, default langs and feature cage imports (#4917)
* fix: nsjail image, default langs and feature cage csharp imports

* Fix unused imports with csharp flag
2024-12-13 09:36:17 +01:00
wendrul 6b27a0b91d feat: add C# support (#4908)
* Add csharp stuff and merge after the rewrite

    * Add csharp, boilerplate + minimal execution
    * Add initial parser
    * Frontend + wasm export of the tree sitter parser
    * Arg spread and use cache

* More types and req parsing

* Add logo

* Parse async and void to fit the wrapper to the main sig

* Csharp editor resource and var buttons

* Lockfile generation

* Add default parsing using serde_json::from_str

* Update init code for c#

* Nsjail for c#

* Remove c_variadic feature

* Remove unused imports

* Add c_variadic only for wasm32 assembly

* Fix c# test

* Add dotnet to the images

* Update dockerfiles

* Update dockerfile again

* Touch Dockerfile

* npm install c# parser

* Add opt mount in nsjail

* Update ee repo ref

* Add csharp to backend image for tests

* Add setting to set nuget package

* Windows compatibility

* Disable csharp test

* ADd feature flag
2024-12-13 00:29:01 +01:00
pyranotaandRuben Fiszel f43781f937 Display memory peak while installing wheels with uv (#4889)
* fix no_uv not affecting deploy

Before this fix no_uv, no_uv_compile and no_uv_install were not affecting Dependency jobs

These jobs are only affected if used USE_PIP_COMPILE or USE_PIP_INSTALL env variables

To make it more consistant, no_uv should also affect dep jobs.

Also make ansible use uv by default

* Make it build

* Add no_uv_usage stats

* Provide build-env for Samael through shell.nix

* Run update_sqlx.sh

* Update ee-repo-ref

* Display memory peak while installing wheels with uv

* Invert DISABLE_NSJAIL

* Make it safer

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2024-12-12 11:26:02 +01:00
HugoCasa 2fca4158c0 add php and mysql feature flags (#4905) 2024-12-12 01:16:25 +01:00
pyranota 8526028a6f Add no_uv_usage stats (#4883)
* fix no_uv not affecting deploy

Before this fix no_uv, no_uv_compile and no_uv_install were not affecting Dependency jobs

These jobs are only affected if used USE_PIP_COMPILE or USE_PIP_INSTALL env variables

To make it more consistant, no_uv should also affect dep jobs.

Also make ansible use uv by default

* Make it build

* Add no_uv_usage stats

* Provide build-env for Samael through shell.nix

* Run update_sqlx.sh

* Update ee-repo-ref

* Update sqlx cache

* Update ee-repo-ref

* Update ee repo ref

* Update sqlx cache

* Update ee-repo-ref.txt
2024-12-12 00:32:03 +01:00
Ruben Fiszel 12d9a8525d clear env for uv pip-compile 2024-12-11 17:06:05 +01:00
Lucas Abel 307382edc5 fix s3_storage decl not being the same as in ee (#4901) 2024-12-11 14:39:45 +01:00
Lucas Abel 3f4e111c57 feat(cache): re-work job results cache (#4898) 2024-12-11 12:01:48 +01:00
Lucas Abel ed71efa6da fmt: re-format Rust leftovers (#4897) 2024-12-11 08:57:00 +01:00
Ruben Fiszel fa533b736c fix(frontend): fix newly deployed apps with frontend scripts 2024-12-10 19:41:11 +01:00
Ruben Fiszel 9bdb5dac9e handle empty requirement line in python 2024-12-10 16:40:12 +01:00
Ruben Fiszel 720d48d3a8 fix(python): do not follow symlinks when copying recursively in overlapping sites-package 2024-12-10 15:52:47 +01:00
Ruben Fiszel f40fcf7b7e improve debug logs 2024-12-10 12:35:56 +01:00
Ruben Fiszel 2db7f07c87 add home in uv pip compile env 2024-12-09 20:53:43 +01:00
Ruben Fiszel 17d262ff7f backend tests 2024-12-09 18:41:13 +01:00
Ruben Fiszel 628ae617f7 feat: docker runtime 2024-12-09 18:02:18 +01:00
Ruben Fiszel 5711cc571d update tokio and deno_core (#4871)
* all

* update
2024-12-08 16:10:46 +01:00
Ruben Fiszel c6dc19a893 improve otel 2024-12-08 11:06:35 +01:00
Ruben Fiszel f7db561304 fix tracing 2024-12-07 17:17:25 +01:00
Ruben Fiszel 8a5ba115c6 feat: add otlp support (#4869)
* all

* all

* add otel

* add otel

* update docker-image

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update
2024-12-07 16:29:20 +01:00
Lucas Abel e38312700a feat(frontend): render new job kinds (#4864) 2024-12-06 15:11:57 +01:00
Lucas Abel ef08fc8e29 feat: add db storage for app inline scripts (#4837) 2024-12-06 13:37:45 +01:00
Lucas Abel c0b93f9c97 fix: handle flow & workspace renames for flow_node (#4861) 2024-12-06 09:40:32 +01:00
Ruben Fiszel b4011be2dc improve retries max value handling 2024-12-06 01:03:46 +01:00
Lucas Abel 5417ac5f07 fix: fix flow_node uniqueness (#4850)
`jsonb` comparison wasn't working as expected, and duplicated entries
were inserted within `flow_node`. To resolve this add a second hash
column, `hash_v2` with a unique default for uniqueness, and use this new
column to ensure unique entries. The previous hash column is left for
backward compatibility. Duplicated entries already insterted will remain
as is without breaking, and only new ones will preserve uniqueness.
2024-12-05 17:42:33 +01:00
Lucas Abel 9faf9ebb45 nit: format worker_lockfiles.rs (#4849) 2024-12-05 15:17:41 +01:00
Ruben Fiszel 75b64a53fa fix compile 2024-12-05 15:17:24 +01:00
Ruben Fiszel 7ad00e07b3 improve windows worker 2024-12-05 14:45:23 +01:00
Ruben Fiszel 3f6e40b0d4 fix: pass USERPROFILE on windows 2024-12-05 10:12:44 +01:00
Ruben Fiszel 19946deb82 simplify warn_after_seconds 2024-12-04 18:28:28 +01:00
Ruben Fiszel 715d09c30d simplify warn_after_seconds 2024-12-04 18:24:31 +01:00
Ruben Fiszel f6c4951877 improve transparency for slow queries 2024-12-04 17:30:58 +01:00
Ruben Fiszel 61d31cc9a7 improve draft only delete security 2024-12-03 23:13:35 +01:00
Ruben Fiszel 9abed3a30a fix empty branchall subflow 2024-11-29 19:02:47 +01:00
Ruben Fiszel b81bf99cc2 prettify cache msg 2024-11-29 13:01:54 +01:00
Ruben Fiszel 6891bf604c nit pip install 2024-11-29 12:37:52 +01:00
Ruben Fiszel 1b74cbaebb add total time 2024-11-29 12:35:10 +01:00
Ruben Fiszel e700016780 small uv s3 pull fix 2024-11-29 12:31:50 +01:00
Ruben Fiszel dbfc8a2783 fix: fix windows build 2024-11-29 09:53:05 +01:00
Lucas Abel 0a65b90049 feat(cache): implement flow node caching (#4808)
* feat(cache): implement flow node caching

* feat(cache): implement script caching

* feat(cache): improve cache
2024-11-29 09:35:00 +01:00
Ruben Fiszel 8338efa685 skip s3 python cache on windows and pro 2024-11-29 08:35:08 +01:00
pyranota a1dd641466 feat: Parallelize uv install (#4774)
* Implement MVP of Parallel uv installation

* Implement PY_CONCURRENT_DOWNLOADS

* Remove Flock for uv installs

* Make S3 pull/push parallel

* Refactor and allow to Cancel installation

* Dont print S3 in output if disabled

* Implement better error handling

* Polishing

* More polishing

* Implement error-handler for kill_tx_2.send()

* Fix and Format prev merge

* Presubscribe to all kill_tx's

We do it now before first event could fire
Meaning no events can be lost anymore

* Early print errors and safer error handling

* Return Err if installation failed

* Final changes

* Return error instead of just printing it

* Safer the way to acquire permit

* Fix compilation error

* Remove double error logs
2024-11-29 08:21:51 +01:00
Lucas Abel 995edad334 fix: invalid null comparison while inserting flow node (#4815) 2024-11-28 17:29:16 +01:00