Commit Graph

53 Commits

Author SHA1 Message Date
Ruben Fiszel 04d2e3f316 add path env to python req 2022-12-02 23:48:42 +01:00
Ruben Fiszel 519247740a fix PIP_INDEX_URL when nsjail is disabled 2022-12-02 23:45:51 +01:00
Ruben Fiszel 304508fd5c quicker log feedback on resolving dependencies 2022-11-28 23:57:02 +01:00
Ruben Fiszel 12f967726b fix(backend): support PIP_INDEX_URL 2022-11-28 23:48:42 +01:00
Ruben Fiszel 9761cb3a8c increase failure loglines capture 2022-11-28 17:52:32 +01:00
Ruben Fiszel 37967a7950 feat: refactor variable + resource linkage + OAuth visibility 2022-11-27 17:26:37 +01:00
Ruben Fiszel 890ec2cb4e fix no color without nsjail 2022-11-26 19:06:36 +01:00
Ruben Fiszel 53fb0ce2ee fix same_worker/shared to work with and without nsjail 2022-11-26 19:02:49 +01:00
Ruben Fiszel b9cb9e9987 fix adding nsjail based on arg 2022-11-26 17:13:14 +01:00
Ruben Fiszel 8a4282ef6a disable nsjail by default 2022-11-25 16:31:15 +01:00
Kai Jellinghaus 4ddb3ec276 fix(backend): bash flow lock & add flow lock tests (#933)
* Fix Bash flow lock

* Tests w/ fixes

* Add Sequence privileges
2022-11-23 19:17:19 +01:00
Kai Jellinghaus af3a62a443 Fix Python flow lock (#931) 2022-11-22 22:56:06 +01:00
Ruben Fiszel 16166df490 fix enterprise code 2022-11-21 19:19:42 +01:00
Ruben Fiszel c6a7313c26 distribute the sync from workers more evenly 2022-11-21 18:30:58 +01:00
Ruben Fiszel c6dc07007c fix tarring the entire cache back to s3 + UX nits 2022-11-21 09:25:22 +01:00
Ruben Fiszel a3529759ad fix(caching): preserve permissions 2022-11-20 21:39:57 +01:00
Ruben Fiszel 7af345e5e5 fix(caching): add a second caching mechanism by tarring the entire cache for fast startup 2022-11-20 19:46:01 +01:00
Ruben Fiszel b62f1a4502 better logging for worker 2022-11-20 18:06:53 +01:00
Ruben Fiszel b571da5356 improve distributed caching 2022-11-20 17:48:46 +01:00
Ruben Fiszel 838a92a0db feat(go): improve cold start of 200ms by building outside of nsjail 2022-11-20 14:40:29 +01:00
Ruben Fiszel 8a71625c52 fix enterprise sync 2022-11-20 11:12:53 +01:00
Ruben Fiszel 61dd5e7e26 resync even for later steps 2022-11-20 04:34:38 +01:00
Ruben Fiszel b08fe63998 add resolver backtracking to silence error 2022-11-19 10:17:36 +01:00
Ruben Fiszel 75b1ae83c4 force creating initial cache dirs after resync 2022-11-18 21:17:38 +01:00
Ruben Fiszel 2923226cfb cleanup logs 2022-11-18 21:08:29 +01:00
Ruben Fiszel 8846ca5856 feat: supercache extended to all version 2022-11-18 20:17:23 +01:00
Kai Jellinghaus bd09884955 feat(backend): sync cache features on all workers [enterprise] (#907)
* Periodic Job

* Add write lock & bash execution

* Use env for bash script

* Enterprise Feature

* Only time based

* Cleanup

* Move code

* Use rclone sync

* WIP

* Use buildarg

* Remove unecessary deps

* 10 Minute Intervals

* Revert testing change

* Manually pull rclone

* fix rclone

* Initial sync

* Update worker.rs

Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
2022-11-18 17:20:39 +01:00
Ruben Fiszel 0b50e2b9ce improve same_worker UX clarity 2022-11-17 18:03:07 +01:00
Ruben Fiszel 5f83655daa add build-essential to base image + pip install has path as env variable 2022-11-16 18:47:11 +01:00
Faton Ramadani cc5f629a7b fix(frontend): App Editor v0 (#886) 2022-11-14 17:30:49 +01:00
Ruben Fiszel c8b35a26a3 add cache dir for deno even when nsjail disabled 2022-11-14 11:43:56 +01:00
Ruben Fiszel a9abd28882 fix(backend): go use windmill cache dir even if nsjail disabled 2022-11-14 09:20:09 +01:00
Kai Jellinghaus 47c9ff1edc feat(backend): Flow lock (#868)
* Add lockfile information

* Allow Lockfiles to be pushed to queue

* Handle raw_lock on worker

* Flow Lock Job

* Allow RawScript path

* Simplify handle_code_execution_job

* Regenerate SQLX

* Fix tests

* fix test

Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
2022-11-13 18:31:08 +01:00
Ruben Fiszel 3357cffb04 feat(backend): remove go.sum from go lockfile (#891) 2022-11-13 17:36:35 +01:00
Ruben Fiszel 6fe5c99af4 tweak identity to extract previous_result 2022-11-10 08:48:06 +01:00
Ruben Fiszel 40183ce4e4 feat: deprecate previous_result in favor of results per id 2022-11-10 01:58:52 +01:00
Kai Jellinghaus 8db4d542e7 Disable Deno Lock Files unless feature flag require it(#881) 2022-11-08 16:52:45 +01:00
Ruben Fiszel 3c09275960 feat: support bash as 4th language (#865)
* bash support

* bash backend working

* frontend part

* bash backend working
2022-11-06 23:48:18 +01:00
Ruben Fiszel badc60193c feat(backend): flow duration is now computed as the sum of every child 2022-11-05 22:31:54 +01:00
Ruben Fiszel 01701882dc feat(backend): use result_by_id in branchone (#857)
* progress

* fix result by id
2022-11-04 12:06:08 +01:00
Kai Jellinghaus f1d658d7f3 Ignore deno lockfile if invalid (#854)
* Ignore deno lockfile if invalid

* Always write file
2022-11-03 00:47:09 +01:00
Kai Jellinghaus 5bbfb40ee1 feat(backend): Deno lock files (#851)
* Enable generating locks for deno

* Handle deno lockfile

* Fix bug with empty lockfiles

* Handle deno lockfiles

* Allow unstable features when resolving deno deps

* Ignore bad lockfiles

* Handle Deno Path

* No Color output

* Fix OsStr
2022-11-02 23:52:45 +01:00
Ruben Fiszel 35868ef9bf fix(backend): capture up all lockfile issues 2022-11-02 14:04:44 +01:00
Ruben Fiszel c049838fd2 approvers are available to the step right after approval 2022-11-02 10:43:19 +01:00
Ruben Fiszel 4ac19c6ce5 add a bit of docs 2022-11-01 07:50:59 +01:00
Ruben Fiszel 39937e6a83 feat(backend): add parallel option for forloop and branchall (#840)
* parallel

* parallel

* fix 1

* fix 2

* fix 3

* fix 3

* fix 4

* sqlx

* add parallel toggle on frontend

* parallel in frontend

* serde

* fix everything

* fix everything
2022-11-01 06:09:00 +01:00
Ruben Fiszel fe61f23d6a handle errors prior to first step better 2022-10-30 19:03:22 +01:00
Ruben Fiszel ed1829da4a add flow_input to context of branch predicates and stop early 2022-10-30 18:24:23 +01:00
Ruben Fiszel e37e07ddb6 fix input transforms for resource and variable 2022-10-30 17:28:59 +01:00
Ruben Fiszel 4bd74ad723 fix(backend): fix error handler progress update 2022-10-30 13:47:28 +01:00