Commit Graph

4047 Commits

Author SHA1 Message Date
Alexander Petric e1fc7977e0 fix win build (#5494)
* add sysinfoapi feature flag for winapi dependency

* add ff

* add ff at the right place
2025-03-20 20:28:15 +00:00
wendrul 71c54024d3 feat: unsafe parameters for sql queries (table names, column names) (#5488)
* Make schema validation struct

Schema Validation rules that are constructed from the schema or from the
MainArgSig(TODO).

* Make other validator builder

* Fail dependency job like with lockfile failing for schema validator

* Add last types + tests

* Remove unused dependency

* fix typos

* Migration ID was colliding with another, changed it manually

* Add Oneof + other fixes

* fix: cache for querying scripts correclty handles ScriptMetadata

* Add cache for schema validation from main arg sig

* Prepare sqlx

* Remove default features

* Feature flags

* WIP: unsafe sql params for sql langauges

* Fix down migration table name

* cleanup: put validation logic inside a function

* Refactor to cache the should_validate boolean

Changed the schemavalidators cache to take in an
Option<SchemaValidator>, effectively storing the `should_validate_schema` information.

Also pass the schema when avaialble to construct the schema validator

* Add other job kinds to u8 cache key just in case

* Change sql languages to all get arguments as Values instead of RawValue

* Only cache if not preview

* Add last sql languages and some CI fixes

* Rename after typo on `sanitized`

* Finish rename

* Remove unused import

* Fix wrong test

* Add newly published regex parser version

* Remove default features from cargo.toml

* Change to a cleaner syntax for the interpolated args

* Update republished parser
2025-03-20 20:02:25 +01:00
pyranota f55cb420dd feat: add nu-lang support (#5217)
* feat: add nu (nushell) support

* add worker tests

* deactivate tables and non-any types below top-level

full support will come in V1
for V0 it's better to keep things minimal and simple

* add syntax highlighting

used python's grammar, since nushell isn't supported by monaco nor svelte-highlights

for V1 nu will get it`s own grammar

* add logo

* partially implement plugin support

* change logo + ability to deploy + nsjail draft

* static variables + get_resource + get_variable

* lsp/dev.nu + initial nu lsp (not working yet)

* make it work with nsjail

* nullguard

* Much more flexible signature parsing and better error-messages

* add init script

* rename nulsp to nu

* install nu to dockerfile

* fix merge

* implement Default for MainArgSignature

* stage NU_CACHE_DIR

* improve dockerfiles

* dev.nu for parser-wasm + flake.nix

* update code for windows

* add nushell to flake

* upload Cargo.lock

* make build.sh work on nixos

* build wasm cli parsers

* add docs to README_DEV.md

* add helper script docker/dev.nu

* improve docker/dev.nu

* fix windows

* commit frontend/package(lock).json

* update cargo.lock

* correctly update cargo.lock

* remove lsp

* update flake.nix to include svelte server and nushell

* Revert base.sql to main

* remove PLUGIN_USE_RE

* make CARGO_PATH private

* add nu to cli

* Change flags to build wasm-nu-parser

* remove flake.nix from parser-wasm

* update wasm-build target

* remove unused import

* add cli support for nu

* update github workflows

* wasm-build 0.17 -> 0.19

* update build script

* update cargo.lock

* Fix typographical error

* update Cargo.lock

* update ENV_SETTINGS

* use published nu parser

* update package.lock

* rewrite parser in tree-sitter

* implement parser from scratch

* polishing

* change init script to match new parser

* fix imports

* fix cli build

* fix cli build

* merge

* update wasm

* use MiniPulledJob

* update cli

* change cli wasm schema

* change cli

* update deno.json

* make wasm modules load lazily

* regenerate parsers

* remove leftover

* update cargo.lock

* clean up dnt.ts

* add docs to cli/test.nu

* add schema validation option

* add Nu to try_validate_schema

* reference frontend to new parser version
2025-03-20 16:45:21 +01:00
Ruben Fiszel e5978c8003 chore(main): release 1.478.1 (#5492)
* chore(main): release 1.478.1

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com>
2025-03-20 12:01:55 +01:00
Ruben Fiszel 30b95fb7d8 fix: update deps versions 2025-03-20 11:51:37 +01:00
Ruben Fiszel 4f998d5543 chore(main): release 1.478.0 (#5478)
* chore(main): release 1.478.0

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com>
2025-03-20 10:11:14 +01:00
Ruben Fiszel debf68734b fix: improve memory metrics graph 2025-03-20 09:54:55 +01:00
wendrul 299c1430eb feat: backend arg schema validation (#5455)
* Make schema validation struct

Schema Validation rules that are constructed from the schema or from the
MainArgSig(TODO).

* Make other validator builder

* Fail dependency job like with lockfile failing for schema validator

* Add last types + tests

* Remove unused dependency

* fix typos

* Migration ID was colliding with another, changed it manually

* Add Oneof + other fixes

* fix: cache for querying scripts correclty handles ScriptMetadata

* Add cache for schema validation from main arg sig

* Prepare sqlx

* Remove default features

* Feature flags

* Fix down migration table name

* cleanup: put validation logic inside a function

* Refactor to cache the should_validate boolean

Changed the schemavalidators cache to take in an
Option<SchemaValidator>, effectively storing the `should_validate_schema` information.

Also pass the schema when avaialble to construct the schema validator

* Add other job kinds to u8 cache key just in case

* Only cache if not preview
2025-03-19 19:41:10 +01:00
HugoCasa 884aba4811 perf: improve perf of get completed flow node (#5418)
* perf: improve perf of get completed flow node

* better

* nit

* nits

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2025-03-19 10:51:30 +01:00
HugoCasa bf938fdfae feat: add support for python list[x] (#5486) 2025-03-19 10:49:34 +01:00
Ruben Fiszel eefb77f445 nit move away from using views 2025-03-19 10:48:43 +01:00
Ruben Fiszel b8d7092478 fix: fix delete completed job 2025-03-19 10:10:16 +01:00
Ruben Fiszel aaa4cde349 feat: filter by worker + backend perf opt (#5489)
* all

* all

* all

* refactor

* sqlx

* ref

* impr

* fix

* fix

* fix

* ee private
2025-03-19 09:55:53 +01:00
Ruben Fiszel e7868f097a only reload license key periodically on ee 2025-03-18 21:57:17 +01:00
Ruben Fiszel 5134deefad improve concurrency limits II (#5485) 2025-03-17 17:24:50 +01:00
Ruben Fiszel fcaee6fef5 fix: improve concurrency limit check performances 2025-03-17 00:53:14 +01:00
Ruben Fiszel c15e699150 DISABLE_CONCURRENCY_LIMIT 2 2025-03-16 18:22:41 +01:00
Ruben Fiszel 18ecb261c3 DISABLE_CONCURRENCY_LIMIT 2025-03-16 17:45:40 +01:00
Ruben Fiszel fe6c2abd59 fix: improve row lock contention on concurrency counter 2025-03-16 17:20:39 +01:00
HugoCasa 1e1bc56f33 feat: keep captures across drafts and deploys (#5482) 2025-03-14 15:17:48 +01:00
Ruben Fiszel a9a64a4b52 nit 2025-03-14 13:28:32 +01:00
Ruben Fiszel 6a03c6cdf9 add PG_LISTENER_REFRESH_PERIOD_SECS 2025-03-14 13:26:52 +01:00
Ruben Fiszel 1dd9ca10fc pg nits 2025-03-14 12:13:12 +01:00
Ruben Fiszel f726b3af88 fix: avoid lock contention for native workers on cached connection (#5481) 2025-03-14 11:58:03 +01:00
dieriba df4b6db0d4 feat: add raw string option and wrap option for http trigger (#5467)
* add new column

* handled worskpaced route

* update .sqlx

* update: rename migration file, rewrite query for checking existing route path key, add copy button url for each route trigger

* update .sqlx

* update sql query

* update .sqlx

* fix: prevent precedence on query

* nits

* update .sqlx

* update query

* Update http_triggers.rs

* nits

* handling two new option in http route 'wrap_body' and 'raw_string'

* update sqlx and add wrap_body and raw_string to http route

* fix: undefined route path

* nits: remove unnecessay ref as type implement copy

* nits

* fix: undefined protection

---------

Co-authored-by: HugoCasa <hugo@casademont.ch>
2025-03-13 20:39:54 +00:00
Ruben Fiszel acceb37e20 more transparent pg listener error 2025-03-13 12:07:33 +01:00
Ruben Fiszel 5c7c46c84b chore(main): release 1.477.1 (#5475)
* chore(main): release 1.477.1

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com>
2025-03-13 10:44:33 +01:00
Ruben Fiszel 14706879ca fix: fix rusttls panic 2025-03-13 10:34:27 +01:00
Ruben Fiszel a4b5d22fce rustls install default 2025-03-13 10:30:42 +01:00
Ruben Fiszel cefc45caaa improve search perfs 2025-03-13 09:31:38 +01:00
Ruben Fiszel c5d67dc71d chore(main): release 1.477.0 (#5471)
* chore(main): release 1.477.0

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com>
2025-03-13 08:00:31 +01:00
Ruben Fiszel e11f0a5fa6 fix: pg_listeners have no timeout 2025-03-12 23:16:32 +01:00
Ruben Fiszel 6c95ccac48 require server mode on indexer 2025-03-12 19:19:38 +01:00
Ruben Fiszel a48cf1346f improve input history job loader UX 2025-03-12 18:18:13 +01:00
Ruben Fiszel 6915b334b2 improve args bind 2025-03-12 17:38:35 +01:00
Ruben Fiszel 5a2c44f347 feat: add search by args on input history directly 2025-03-12 16:05:02 +01:00
Ruben Fiszel 5d2e5d5b48 fix: prevent monitoring task to die without sending killpill (#5472) 2025-03-12 11:51:53 +01:00
Ruben Fiszel 2c1d05858b chore(main): release 1.476.0 (#5469)
* chore(main): release 1.476.0

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com>
2025-03-11 22:04:18 +01:00
wendrul 70d3f48f0b fix: cache for querying scripts correclty handles ScriptMetadata (#5466) 2025-03-11 20:04:23 +01:00
Ruben Fiszel 09b859e1ae fix: codebases compatible with git sync (#5470) 2025-03-11 19:38:55 +01:00
dieriba 04ea7b851b feat: option to prefix http route with workspace id (#5461)
* add new column

* handled worskpaced route

* update .sqlx

* update: rename migration file, rewrite query for checking existing route path key, add copy button url for each route trigger

* update .sqlx

* update sql query

* update .sqlx

* fix: prevent precedence on query

* nits

* update .sqlx

* update query

* Update http_triggers.rs

* nits

---------

Co-authored-by: HugoCasa <hugo@casademont.ch>
2025-03-11 15:24:22 +00:00
Ruben Fiszel 879c090653 chore(main): release 1.475.1 (#5465)
* chore(main): release 1.475.1

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com>
2025-03-11 11:03:06 +01:00
Ruben Fiszel 5765d4cf75 nit zombie job monitoring 2025-03-11 07:08:28 +01:00
Ruben Fiszel 00d5c39347 improve slightly index creation 2025-03-11 06:35:57 +01:00
dieriba ba0cfb199c use-exists-function-for-folder-and-improve-error-handling (#5464)
* update: removing try and catch for checkExistalready fn and use exist function folder instead of get folder for folder kind

* update .sqlx
2025-03-10 12:38:11 +01:00
Ruben Fiszel 14d7a0daae clarify state transition error 2025-03-10 11:03:22 +01:00
Ruben Fiszel 1e32c83446 improve bundle preview 2025-03-07 23:44:48 +01:00
Ruben Fiszel 1235448176 chore(main): release 1.475.0 (#5426)
* chore(main): release 1.475.0

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com>
2025-03-06 18:24:36 +01:00
HugoCasa 28568e30c5 fix: s3 file picker delete + better s3 path handling (#5454)
* fix: s3 file picker delete + better s3 path handling

* update ee ref
2025-03-06 17:28:22 +01:00
dieriba 996cebeb8a feat: deploy triggers to prod/staging workspace (#5429)
* add deploy to staging prod option to trigger

* remove unused import

* handle schedule trigger, fix update fn

* Update frontend/src/lib/utils_deployable.ts

Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>

* Update backend/windmill-common/src/workspaces.rs

Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>

* Update frontend/src/lib/components/DeployWorkspace.svelte

Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>

* update kind name and handle script kind flow for websocket

* nits: english wording

---------

Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-03-06 17:02:11 +01:00