Commit Graph

52 Commits

Author SHA1 Message Date
Ruben Fiszel d0b24d07d2 deno_core is an optional feature flag (#4473)
* full

* all

* add deno_core as features

* all

* remove warnings

* all
2024-10-03 13:11:58 +02:00
Ruben Fiszel f189aaad5a fix: improve suspend_first behavior and frequency 2024-09-28 15:46:50 +02:00
wendrul b0cb1e0b27 feat: ansible playbook support (#4399)
* Ansible execution and parsing

* Working collections and pip dependencies

* Remove unused vars

* File resources logic for ansible

* Make frontend for ansible and resource file

* Format file

* Change naming of file resource and inventory fields

* Add autocomplete for file extension resource creation

* Add endpoint to list file formats for resource types

* Add CLI functionality to pull/push file resources

* Add beta tag to ansible

* Add Full image dockerfiles containing ansible

* Prepare sqlx

* Update cargo.lock

* Update ansible path

* Remove unused imports

* Add back import removed by rust-analyzer

* Improve ansible init code

* Prepare sqlx

* Change dockerfile to make the full windmill image

* Remove old dockerfile

* Improve autocomplete file resource extension select

* Remove comment

* Validate file extension

* Add icons to text file resources

* Remove editability of file resource types

* Remove unused import

* Missing space

* Add yaml parser
2024-09-19 00:21:15 +02:00
wendrul 91d328b132 feat: add rust (#4253)
* Add rust on frontend

* Add parser for rust

* Handle rust job execution

* Main has to return a result that is serializable

* Update parser: parse many rust types

* Rust parser dependencies

* Frontend wasm parser

* Add windmill parser rust to windmill parser wasm (temporarily)

* Add rust as a tag on worker__default

* Change init code for rust

* Cleanup rust_executor.rs

* Remove tree-sitter dep and fix unused imports

* Add lockfile and build logic

* Add cargo and rustup to windmill image

* Fix env var to work on docker image and dev env

* modify package.json

* Deps after parser publish

* Add stashed migration

* Unify rust versions

* Add error message when php or cargo are not present to use another image

* Error message conditionally on feature flag

* all ci/cd changes

* all ci/cd changes

---------

Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
2024-08-30 17:01:04 +02:00
HugoCasa fba0817dd5 fix: email triggers sqlx CE and improve email parsing (#4203)
* fix: CE sqlx

* update ee ref
2024-08-06 23:05:36 +02:00
Ruben Fiszel 2812792326 fix: memory optimization for flow with big args (#4019) 2024-07-04 10:08:42 +02:00
HugoCasa 93f58056a0 feat: replace ephemeral tokens by jwt (#3908)
* feat: replace ephemeral tokens by jwt

* fix: migration + sqlx

* fix: tests, agent, ee ref

* fix: sqlx

* fix: tests

* fix: jwt prefix change + fix tests

* fix: nit

* fix: handle agent mode
2024-06-14 13:07:35 +02:00
Ruben Fiszel f740614c0b feat: accelerate bun through caches (#3909)
* all

* all

* all

* all

* all

* simplify extract
2024-06-13 19:09:16 +02:00
Ruben Fiszel af52c61385 fix: update deno_core to latest to work better with rust 1.78 (#3890) 2024-06-10 18:31:16 +02:00
Ruben Fiszel 4c20d88fee remove all warnings 2024-06-08 18:06:04 +02:00
HugoCasa f7f7a6d85f feat: add php (#3725)
* feat: add php

* fix: nsjail + frontend build
2024-05-15 08:12:11 +02:00
Ruben Fiszel ab89792187 nit global cache python improvements 2024-04-04 22:07:14 +02:00
Ruben Fiszel de66141362 add checksum log to s3 piptar pull 2024-04-02 20:55:31 +02:00
Ruben Fiszel 8718d038f4 fix compile on non ee 2024-03-20 15:18:54 +01:00
Ruben Fiszel a0a42067fb feat: s3 cache config added to instance settings + parallelized tar pulling 2024-03-20 14:19:34 +01:00
Ruben Fiszel 805415d95b chore: openidconnect is a feature flag 2024-03-17 13:51:58 +01:00
HugoCasa c0104641f0 feat: add bit support in pg (#3407) 2024-03-14 10:40:20 +01:00
HugoCasa 9aa587c36f feat: add ee flag to common (#3300) 2024-02-27 12:06:48 +01:00
Ruben Fiszel efbba24581 feat: more resilient flows in case of crash during transitions 2024-02-25 18:25:40 +01:00
Ruben Fiszel 75d736ca7e reactivate parquet features 2024-02-24 17:44:43 +01:00
Ruben Fiszel c3ef987e28 chore: fasten compilation time 2024-02-24 17:10:55 +01:00
Ruben Fiszel 82c8b1d1dd chore: fasten compilation time 2024-02-24 16:29:35 +01:00
Ruben Fiszel a24645ee00 feat: OIDC support (#3017)
* oidc

* update

* feat: add support for multiselect in python

* d

* d

* progress

* all

* all

* all
2024-01-16 23:32:26 +01:00
Ruben Fiszel bb84ab654a feat: improve git sync and recompute dependents when common python script is redeployed (#2967)
* fix: allow extraConfig for agGrid to set onGridReady

* depmap

* depmap

* depmap

* depmap
2024-01-07 15:18:27 +01:00
Guillaume Bouvignies 2081e7a8ff chore: Add examples on how to deploy private registries (#2719)
* chore: Add examples on how to deploy private registries

* chore: example for private pypiserver with https

* Allow DENO_CERT certificate with native workers

* Add BUN_TLS_REJECT_UNAUTHORIZED
2023-11-29 11:38:23 +01:00
HugoCasa 2fe623cf6b feat: add sql server (#2604)
* feat: add sql server

* feat: mssql test, db schema, AI

* chore: update to latest parser

* fix: clean mssql executor
2023-11-10 11:16:13 +01:00
Ruben Fiszel fb95c97463 feat: invalidate result cache on flow or script change 2023-10-31 12:49:31 +01:00
Ruben Fiszel 2ee57f3f84 feat: refactor entirely json processing in favor or rawjson to handle larger payloads (#2446)
* raw json

* raw json

* raw json

* raw json

* the big rawjson rewrite

* resolve merge conflicts

* all

* progress

* progress

* all compile

* remove mut

* remove mut

* remove mut

* arc queuedjob

* finish

* finish

* finish

* fixes

* progress

* fix result

* small fixes

* small fixes

* fix tests

* fix tests

* fix tests

* optimize eval timeout

* optimize eval timeout

* optimize eval timeout

* handle big args and result in get jobs

* improve args

* fix

* fix

* fix tests

* fix tests

* done

* add bigquery to native picker

* add bigquery

---------

Co-authored-by: gbouv <guillaume@windmill.dev>
2023-10-16 10:46:55 +02:00
HugoCasa 9002a0e05a fix: add numeric, array and date types (#2379)
* fix: add numeric, array and date types

* fix: update parser npm
2023-10-05 09:13:56 +02:00
Ruben Fiszel e8dd9bf1f0 feat: attempt to SIGTERM before SIGKILL for bash 2023-09-11 18:55:19 +02:00
Ruben Fiszel 21e8d7694c perf: improve queue performance (#2222)
* benchs

* progress

* prog

* progress

* progress

* progress

* update

* progress

* progress

* progress

* progress

* progress

* all

* all

* improve queries

* improve queries

* rm imv

* all

* all
2023-09-03 09:44:16 +02:00
Ruben Fiszel 5fd36052fa feat: add lockfile for deno + use npm module for deno for windmill-client 2023-08-26 11:14:01 +02:00
Ruben Fiszel 29262130e1 encode special characters in postgres url 2023-08-25 14:38:30 +02:00
HugoCasa f1a0070b71 feat: add graphql support (#2014)
* feat: add graphql support

* fix: use custom editor for viewing graphql schema

* fix: graphql parser cargo version

* fix: add graphql where missing
2023-08-09 16:19:57 +02:00
HugoCasa 488d2813f3 feat: add snowflake (#1987)
* feat: unveil windmill AI

* feat: add snowflake

* fix: uppercase snowflake auth params
2023-08-03 17:22:00 +02:00
Ruben Fiszel c301ca4f7a feat: add support for postgresql numeric 2023-07-30 18:16:25 +02:00
HugoCasa c9110575cd feat: add bigquery (#1934)
* feat: add bigquery

* fix: remove debug logs

* fix: add records number limit

* fix: revert unwanted changes

* feat: bigquery enterprise only

* fix: google auth only when enterprise

* fix: rename bigquery scripts
2023-07-27 14:24:27 +02:00
Ruben Fiszel b7c7d564ca feat: add mysql as native integration (#1859) 2023-07-11 22:53:02 +02:00
Ruben Fiszel 41213a61aa feat: native fetch + native postgresql jobs (#1796)
* push

* test

* test

* done

* fix

* modify script lang enum

* fix tests

* update wasm

* fix tests
2023-07-04 19:39:59 +02:00
Ruben Fiszel 01a5ae940f add proto postgresql backend support as a job language 2023-06-26 18:23:14 +02:00
Ruben Fiszel 74254af71a migrate all jsonschema parser to wasms 2023-06-06 10:52:04 +02:00
Kai Jellinghaus 63102b036c feat(backend): Redis based queue (#1324)
* Merge?

* Fix V8 breaking change

* WIP

* WIP

* Cleanup

* Move to git reference

* Fix Merge conflict

* update

---------

Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
2023-04-11 12:24:13 +02:00
Ruben Fiszel 63bd0cfb28 fix(backend): increase dynamic js timeout + improve client passing 2023-03-23 10:32:09 +01:00
Ruben Fiszel 69d4a23b4f send a webhook on new user + lazy static refactor (#1203)
* supercharge

* supercharge

* progress

* progress

* display config

* display config

* display config

* display config

* fix extensions

* fix build

* disable nsjail = false for test
2023-02-15 10:59:50 +01:00
Ruben Fiszel 567a404355 usage tracker v3 2022-12-12 01:11:44 +01:00
Kai Jellinghaus b87fc7796a feat(backend): Input transform errors (#1006)
* Add pre run error & propagate input transforms there

* Handle pre-run errors

* Update SQLX data

* Update SQLX data
2022-12-08 23:56:49 +01:00
Ruben Fiszel 01400c571e better logging for worker 2022-11-20 18:06:53 +01:00
Kai Jellinghaus 7efdb3af6b feat(backend): sync cache features on all workers [enterprise] (#907)
* Periodic Job

* Add write lock & bash execution

* Use env for bash script

* Enterprise Feature

* Only time based

* Cleanup

* Move code

* Use rclone sync

* WIP

* Use buildarg

* Remove unecessary deps

* 10 Minute Intervals

* Revert testing change

* Manually pull rclone

* fix rclone

* Initial sync

* Update worker.rs

Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
2022-11-18 17:20:39 +01:00
Ruben Fiszel cd8d0e5ea6 feat: deprecate previous_result in favor of results per id 2022-11-10 01:58:52 +01:00
Kai Jellinghaus 15561541f1 Disable Deno Lock Files unless feature flag require it(#881) 2022-11-08 16:52:45 +01:00