Commit Graph

52 Commits

Author SHA1 Message Date
wendrul c85d2a4957 feat: add C# support (#4908)
* Add csharp stuff and merge after the rewrite

    * Add csharp, boilerplate + minimal execution
    * Add initial parser
    * Frontend + wasm export of the tree sitter parser
    * Arg spread and use cache

* More types and req parsing

* Add logo

* Parse async and void to fit the wrapper to the main sig

* Csharp editor resource and var buttons

* Lockfile generation

* Add default parsing using serde_json::from_str

* Update init code for c#

* Nsjail for c#

* Remove c_variadic feature

* Remove unused imports

* Add c_variadic only for wasm32 assembly

* Fix c# test

* Add dotnet to the images

* Update dockerfiles

* Update dockerfile again

* Touch Dockerfile

* npm install c# parser

* Add opt mount in nsjail

* Update ee repo ref

* Add csharp to backend image for tests

* Add setting to set nuget package

* Windows compatibility

* Disable csharp test

* ADd feature flag
2024-12-13 00:29:01 +01:00
pyranota f240d1322a feat: Handle pip install by uv (#4517)
* feat: Handle `pip install` by `uv`

Dirty and untested, but already something working

* Integrate with NSJAIL and prepare fallbacks

* Refactor fallback
no_uv disable compile and install
where no_uv_install and no_uv_compile are a bit more specific

* Remove `--disable-pip-version-check`
Reason:
   warning: pip's `--disable-pip-version-check` has no effect

* Fix backend compilation error

* Pip fallback overwrite UV's cache

* Initially refactor cache (No S3)

* Support S3

* Remove unused import

* Handle flags for NSJAIL

* Return deleted flag

* Update Dockerfile

* Update docker-image.yml

* Update docker-image.yml

* Add --link-mode=copy and remove -v

* Fix NSJAIL INDEX_URL

* Fix flock and windows

* Update python_executor.rs

* Remove line from Dockerfile

We dont need it and to trigger build

* fixing for windows

* Dont pin python to specific version

* Change TMP for windows

* Revert docker-image.yml

* Disable UV for ansible

Will be enabled later.
Needs proper testing and its better to split onto 2 PRs with first modifying python and second ansible

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
Co-authored-by: Alexander Petric <petric.al@gmail.com>
2024-11-15 00:12:56 +01:00
Ruben Fiszel b603f4a6ba allow python multiprocessing on nsjail 2024-10-11 01:40:09 +02:00
Ruben Fiszel 827113c797 add urandom to nsjail 2024-09-29 12:31:55 +02:00
Ruben Fiszel c3546afa63 quote req and target for nsjail python download 2024-09-29 12:13:54 +02:00
HugoCasa 6fb936cdb6 fix: allow preprocessor to write to args.json on nsjail (#4455) 2024-09-27 21:12:38 +02:00
wendrul a7ef3ed293 fix: various improvements for ansible (#4419)
* Improve error messages, fix dependency job issue

* Add nsjail support for ansible

* Remove invalid comment syntax

* Change nsjail config and ansible controller config to be ephemeral

* Move ansible cfg to later to overwrite possible files named ansible.cfg

* Fix ansible.cfg env var

* Fix tmp dir issue
2024-09-23 16:44:37 +02:00
wendrul 91d328b132 feat: add rust (#4253)
* Add rust on frontend

* Add parser for rust

* Handle rust job execution

* Main has to return a result that is serializable

* Update parser: parse many rust types

* Rust parser dependencies

* Frontend wasm parser

* Add windmill parser rust to windmill parser wasm (temporarily)

* Add rust as a tag on worker__default

* Change init code for rust

* Cleanup rust_executor.rs

* Remove tree-sitter dep and fix unused imports

* Add lockfile and build logic

* Add cargo and rustup to windmill image

* Fix env var to work on docker image and dev env

* modify package.json

* Deps after parser publish

* Add stashed migration

* Unify rust versions

* Add error message when php or cargo are not present to use another image

* Error message conditionally on feature flag

* all ci/cd changes

* all ci/cd changes

---------

Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
2024-08-30 17:01:04 +02:00
Ruben Fiszel 2f1d7349b9 fix: move bun cache to non mounted volume to benefit from cache optimization 2024-07-24 18:25:21 +02:00
Ruben Fiszel afed03565f make nsjsail mode compatible with arm64 by making lib64 non mandatory 2024-06-28 15:11:41 +02:00
HugoCasa f7f7a6d85f feat: add php (#3725)
* feat: add php

* fix: nsjail + frontend build
2024-05-15 08:12:11 +02:00
Ruben Fiszel 49469644b9 fix: bun loader with nsjail 2024-05-14 01:17:13 +02:00
Ruben Fiszel 1f64715043 feat: local typescript codebase as bundle (#3694)
* codebases

* codebases

* foo

* foo

* foo

* foo

* fix(frontend): Disable the insert button when required fields are empty strings (#3659)

* fix(frontend): use normal password mask for the sensitive fields of the resource editor

* handle super admins in password arg input

* chore(main): release 1.323.2 (#3660)

* chore(main): release 1.323.2

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>

* foo

* all

* s3_helpers move

* progress

* all

* progress

* progress

* progress

* progress

* codebase final

* update without ee

* sqlx

* all

* all

* all

* all

* all

* all

* all

* all

* all

* all

* all

* all

* all

* all

* all

* update

* all

* all

* all

---------

Co-authored-by: Faton Ramadani <faton.ramadani14@gmail.com>
Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2024-05-09 18:35:50 +02:00
Ruben Fiszel 8970009b44 fix powershell with nsjail 2024-03-26 23:11:26 +01:00
Ruben Fiszel 958df4f62c feat: refactor logging to improve performance by order of magnitude for longer jobs 2024-03-16 17:55:34 +01:00
Ruben Fiszel 1eff3fc9cc feat: experimental nodejs support 2024-01-14 18:53:43 +01:00
HugoCasa ff7834086d fix: powershell nsjail (#2856) 2023-12-14 13:34:40 +01:00
HugoCasa 297a31d468 fix: pwsh modules nsjail (#2845) 2023-12-13 14:16:08 +01:00
Ruben Fiszel d85217564e make bun cache rw on nsjail 2023-10-12 02:03:31 +02:00
Ruben Fiszel ff529e6c1a fix bun on nsjail 2023-10-11 23:13:10 +02:00
Ruben Fiszel e3d28b9507 feat: support pinned versions for bun in deployed scripts 2023-09-19 18:15:06 +02:00
Ruben Fiszel c2d766028e refactor worker-common 2023-08-20 16:44:22 +02:00
Ruben Fiszel 3024069427 improve BADF on cloud 2023-08-13 00:36:44 +02:00
Ruben Fiszel 70b7fe4989 improve BADF on cloud 2023-08-13 00:29:23 +02:00
Ruben Fiszel 7a66d03715 enable relative path under nsjail too 2023-08-12 20:54:35 +02:00
Ruben Fiszel 1778ec1117 feat: respect lockfiles for bun 2023-08-12 20:49:36 +02:00
Ruben Fiszel ea92fa1154 remove nltk_data binding 2023-08-03 11:30:36 +02:00
Ruben Fiszel 838266bb2f feat: lock depedency for the entire flow + dependency job depend on script/flow's tag 2023-07-26 21:14:14 +02:00
Ruben Fiszel 4317f065f5 feat: bun support (#1800)
* feat: bun support

* feat: bun support

* add bun support

* add bun support

* add bun support

* add bun
2023-07-06 21:19:07 +02:00
Ruben Fiszel 7b2d7b9af7 feat: increase timeout to 900 2023-05-10 19:08:18 +02:00
Ruben Fiszel 198dd9e8ff remove deno nsjail in favor of deno sandboxing 2023-04-08 15:25:10 +02:00
Ruben Fiszel 1f8513b937 remove unecessary deno lock file 2023-03-31 11:53:31 +02:00
Ruben Fiszel 2dfbf5ffcf fix autogen script names 2023-03-28 21:07:21 +02:00
Ruben Fiszel 904d74187e feat(backend): allow relative imports for python 2023-03-28 20:27:40 +02:00
Ruben Fiszel 1bc97cd73b add import_map to nsjail 2023-01-21 23:28:11 +01:00
Ruben Fiszel ac94b57726 fix deno nsjail vmem 2023-01-20 11:49:08 +01:00
Ruben Fiszel ddef8e30e9 bump default bash tmp size 2023-01-19 20:32:08 +01:00
Ruben Fiszel 5250532043 relax nsjail limits 2023-01-19 14:51:43 +01:00
Ruben Fiszel 13300be1ac relax nsjail limits 2023-01-19 14:35:06 +01:00
Ruben Fiszel 3ad5bfc192 feat: add relative imports for python scripts (#1075)
* all

* all
2023-01-09 13:49:30 +01:00
Ruben Fiszel cecc5a9d73 fix(backend): support PIP_INDEX_URL 2022-11-28 23:48:42 +01:00
Ruben Fiszel 6d037f92d1 fix(backend): support PIP_INDEX_URL 2022-11-28 23:12:05 +01:00
Ruben Fiszel 65a535eb86 add urandom and all /etc to nsjail 2022-11-25 19:05:41 +01:00
Ruben Fiszel 0640df275d add ld.so.cache to bash path 2022-11-23 15:20:50 +01:00
Ruben Fiszel dbe1ada3a9 nits on nsjail config 2022-11-23 14:00:49 +01:00
Ruben Fiszel c2e9dff784 feat(go): improve cold start of 200ms by building outside of nsjail 2022-11-20 14:40:29 +01:00
Ruben Fiszel 0a8fd771b0 feat: supercache extended to all version 2022-11-18 20:17:23 +01:00
Ruben Fiszel d969eb4f2c fix python on nsjail 2022-11-08 00:42:14 +01:00
Ruben Fiszel 61c915488c ci: trim down docker main docker image 2022-11-07 13:37:37 +01:00
Ruben Fiszel 7c97fac746 feat: support bash as 4th language (#865)
* bash support

* bash backend working

* frontend part

* bash backend working
2022-11-06 23:48:18 +01:00