a6cf327f74
fix: improve memory metrics graph
2025-03-20 09:54:55 +01:00
6634c82e20
feat: backend arg schema validation ( #5455 )
...
* Make schema validation struct
Schema Validation rules that are constructed from the schema or from the
MainArgSig(TODO).
* Make other validator builder
* Fail dependency job like with lockfile failing for schema validator
* Add last types + tests
* Remove unused dependency
* fix typos
* Migration ID was colliding with another, changed it manually
* Add Oneof + other fixes
* fix: cache for querying scripts correclty handles ScriptMetadata
* Add cache for schema validation from main arg sig
* Prepare sqlx
* Remove default features
* Feature flags
* Fix down migration table name
* cleanup: put validation logic inside a function
* Refactor to cache the should_validate boolean
Changed the schemavalidators cache to take in an
Option<SchemaValidator>, effectively storing the `should_validate_schema` information.
Also pass the schema when avaialble to construct the schema validator
* Add other job kinds to u8 cache key just in case
* Only cache if not preview
2025-03-19 19:41:10 +01:00
9dba57d546
feat: add raw string option and wrap option for http trigger ( #5467 )
...
* add new column
* handled worskpaced route
* update .sqlx
* update: rename migration file, rewrite query for checking existing route path key, add copy button url for each route trigger
* update .sqlx
* update sql query
* update .sqlx
* fix: prevent precedence on query
* nits
* update .sqlx
* update query
* Update http_triggers.rs
* nits
* handling two new option in http route 'wrap_body' and 'raw_string'
* update sqlx and add wrap_body and raw_string to http route
* fix: undefined route path
* nits: remove unnecessay ref as type implement copy
* nits
* fix: undefined protection
---------
Co-authored-by: HugoCasa <hugo@casademont.ch >
2025-03-13 20:39:54 +00:00
61a5ceaba3
feat: option to prefix http route with workspace id ( #5461 )
...
* add new column
* handled worskpaced route
* update .sqlx
* update: rename migration file, rewrite query for checking existing route path key, add copy button url for each route trigger
* update .sqlx
* update sql query
* update .sqlx
* fix: prevent precedence on query
* nits
* update .sqlx
* update query
* Update http_triggers.rs
* nits
---------
Co-authored-by: HugoCasa <hugo@casademont.ch >
2025-03-11 15:24:22 +00:00
5c39037aea
feat: MQTT triggers ( #5277 )
...
* first commit
* update migration mqtt
* chore: update dependencies
* add cli support and update schema for mqtt
* update: casing style
* update: rename get_resource function and moving to resource.rs
* feat:
* feat: refactored
* feat: add ready endpoints for workers to enterprise
* feat: handle connection to server
* fix: main.rs
* feat: added support v5
* feat: 🚧 updated .github, handle more case for v5 and handle v3
* feat: handled client, update script helper
* update .sqlx
* refactor: added generic implement and trait to remove redundant code, misses client impleme
* feat: remove optinal property update test function
* feat: done
* handle client certificate
* minor fix
* fix: tls and mtls
* fix: min topic len in frontend
* Update frontend/src/lib/components/triggers/mqtt/MqttEditorConfigSection.svelte
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Update backend/windmill-api/openapi.yaml
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Update backend/windmill-api/src/mqtt_triggers.rs
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* update openapi, and script_helper.ts
* fix: toggle button and update mqtt migration
* nits: remove postgres type and only relies on serde
* fix: timeout connection
* fix typo and captures
* fix: capture table reactivity
* handle more mqtt v5 option
* nits: remove clone method
* update: better naming
* nits: display tooltip qos
* fix: hanle tls connection with natively
* update: add documentation links for qos and topics
* fix tooltip and add default value
* update: shoz preprocessor only if selected in capture table
* nits: show mqtt icon in resource related componenets
* update hub link and repo ref
* fix: unused var
* update ee ref
* fix: give good reference id for script hub
---------
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
Co-authored-by: Clement Zhang <clement.zhang2@gmail.com >
2025-03-04 23:52:47 +01:00
3063001491
fix: migrations do not refer to public schema anymore ( #5400 )
2025-02-27 14:37:39 +01:00
7bf9e25ede
feat: track workspace runnables used in flows ( #5369 )
...
* feat: track workspace runnables used in flows
* track script hash
* weird
* do it with lock
* Revert "feat: add support for | None and Optional in python (#5361 )"
This reverts commit 9736355d5f#5361 )""
This reverts commit bb8f709894
2025-02-27 10:01:12 +01:00
c8a959691c
feat: limit the number of times a job can be restarted (3) after loss of pings
2025-02-25 16:35:29 +01:00
0456272e3f
fix: improve webhook settings cache invalidation
2025-02-24 16:10:53 +01:00
b8e6d0da79
feat: make flow lock deployment error visible in UI
2025-02-22 15:02:16 +01:00
58a67a3ac0
feat: SQS triggers ( #5182 )
...
* feat: first commit
* fix: npm check
* fix: openapi file
* feat: update openapi and migration
* feat: basic implementation done
* fix: fix: no used function when no feature
* feat: capture done
* Update capture.rs
* nits: change sqs trigger
* fix: make migration great again
* feat: add message attributes
* feat: nits: fix error messages, remove console.log and add try catch
* update sqs icon and ee feature for sqs_trigger
* update: change sqs name casing and added test connection button
* nits: update Icon and add create from template button
* fix: ci build and error compilation
* update migration type sqs
* update link on create from template button for sqs, add archive in workspace export and update sqlx
* fix: ci
* Update SqsTriggerEditorInner.svelte
* add link to docs, use generic function for resource and fix import error
* chore: update .github ci
* nits: remove empty
* update to match ee repo changement
* Update backend/windmill-api/src/resources.rs
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* add sqs handling for the cli and refacoring sqsEditorInner
* Update cli/sync.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* fix: add break to switch statement for sqs case
* fix: display aws_resource_path when retrieve or create a new trigger
* rework sqs ui, fix postgres optional port
* fix: ci
* update ui for trigger
* update repo ref and specific
* feat: add ready endpoints for workers to enterprise
* update ref
* Update frontend/src/lib/script_helpers.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: HugoCasa <hugo@casademont.ch >
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
2025-02-18 23:49:45 +01:00
0208f53541
fix: windmill_admin has implicit bypass rls on v2_job even if role not set
2025-02-17 15:20:39 +01:00
9ccadb6085
fix: users should be able to see their own jobs
2025-02-14 11:12:26 +01:00
149d5fb3e1
feat: teams workspace scripts ( #5238 )
...
* backend and clients
* adding teams_team_name to workspace_settings
* openapi.yaml adding teams workspace settings endpoints
* teams workspace settings frontend
* workspaces router
* build ce
* ee gate
* ee oauth
* update client
* workspace error handler
* remove log
* ce
* point to new hub scripts
* updating hubPaths
* updating hubPaths
* cleanup
* merge
* schedule teams error
* polish, reactivity
* sqlx compilewarning
* sqlx migrate
* make it build
* router
* fix
* remove sqlx workaround
* Update ee-repo-ref.txt
* simplify some logic
* sqlx
* latest ee ref
* latest ee ref
---------
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
2025-02-13 16:53:57 +01:00
bf206515e8
fix(backend): improve schedule queries plan to leverage indices better for performance ( #5273 )
...
* backend: fix schedule queries plan
* rework
* fix skipped as non success
* update sqlx
* update
* all
* fix npm run check
---------
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
2025-02-12 16:34:03 +01:00
57cfa4045b
feat: add postgres trigger captures ( #5165 )
...
* feat: 🚧 add postgres trigger config in back
* feat: add capture section for postgres
* feat: update postgres trigger panel, update capture migration
* fix: ci and casing style
* feat: capture done
* fix: update sqlx
* fix: remove unused
* feat: handle persisting data
* fix: add feature flag
* feat: capture done
* fix: feature flag
* feat: capture done
* nits: add plus into postgres capture label
* feat: trigger done
* Update PostgresTriggerEditorInner.svelte
* Update script_helpers.ts
* nit
* chore: update to meet pr comment requirement
* refactor:
* fix:
* fix: miss closing curly braces
* fix:
* fix: ci
* Update mod.rs
* polishing postgres trigger
* update minor changes on UI
* nits: remove log and update function parameters
* fix: remove wrong name
* nits: change icon
* fix: nit migration
* nits: refacto and remove alert
* nits: change variable name
* update workspaces_export
* fix: ci
---------
Co-authored-by: HugoCasa <hugo@casademont.ch >
Co-authored-by: Guilhem <guilhemlemouel@gmail.com >
2025-02-11 18:16:12 +01:00
69c316576c
add grants to v2 tables
2025-02-11 15:57:36 +01:00
4849af04de
backend: fix workflow as code ( #5239 )
...
* backend: improve `/get_job_update` after v2
* backend: insert missing `workflow_as_code_status` on completion
also insert `flow_status` from so we can remove the query when `_duration` is above 500
* backend: fix workflow_as_code after v2
* backend: add `workflow_as_code` worker test
2025-02-07 12:27:43 +01:00
48e4ae6561
feat: serve static websites ( #5218 )
...
* feat: serve static websites
* nit
* sqlx
* nit
* nits
* nits
* nits
* nits
2025-02-06 17:38:12 +01:00
2478df52a5
backend: un-queue zombies left by missing row in v2_job_runtime ( #5232 )
2025-02-06 16:46:32 +01:00
eabf4c969f
backend: fix missing v2_job_runtime ( #5230 )
2025-02-06 15:12:22 +01:00
d51c3080f7
backend: use v2 tables through views where possible (v2 phase 3) ( #5119 )
2025-02-06 12:43:24 +01:00
3e8e0c653e
backend: migrate job tables to v2 schema (v2 phase 1) ( #5084 )
2025-02-06 12:37:11 +01:00
245c8719fc
feat: more AI models ( #5207 )
...
* feat: more AI models
* nits
* groq + openrouter
* nit
2025-02-04 22:17:30 +01:00
99b3308c56
Fix otel migration error ( #5189 )
...
* Fix otel migration error
1: error returned from database: duplicate key value violates unique constraint "global_settings_pkey"
0: while executing migration 20250131115248: error returned from database: duplicate key value violates unique constraint "global_settings_pkey"
* delete migration
* add .sqlx cache + move otel_global_settings to new location
* Fix compilation error
* Move before migrating
* Add error handler
* warn -> info
---------
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
2025-01-31 19:34:23 +01:00
e29a54022c
Revert "fix: fix worker restart on otel setting set from undefined to null (#…" ( #5190 )
...
This reverts commit 940fb03023
2025-01-31 18:50:33 +01:00
940fb03023
fix: fix worker restart on otel setting set from undefined to null ( #5183 )
2025-01-31 17:14:44 +01:00
487c273bfb
feat: websocket trigger allow returning messages ( #5168 )
...
* feat: websocket trigger allow returning messages
* handle early return
2025-01-29 21:17:36 +01:00
eaa74d5582
team plan >80% included usage warning ( #5163 )
2025-01-29 18:09:47 +01:00
a1579c1654
fix: oracledb tag for native workers + client not working on arm systems ( #5162 )
...
* New migration for oracledb
* fix oracledb on ARM64 systems
2025-01-28 17:57:40 +01:00
1a1ea68216
feat(frontend): operator visibility setting per workspace ( #5124 )
...
* feat(frontend): operator visibility setting per workspace
* section + reactivity
* sqlx prep
* npm check
* more sqlx
* fix table bg dark mode
* improve db query / reactivity
* sqlx prepare
* more merge fixing
* npm check
* npm check
2025-01-24 18:17:00 +01:00
316a2167e7
feat: postgres triggers ( #4860 )
...
* feat: init database triggers
* feat: ✨ wip: database_triggers
* feat: ✨ add database triggers front view
* feat: 🚧 database_triggers
* feat: 🚧 add definition in yaml, updated backend code and added migration
* feat: 🚧 updated migration file, update openapi.yml, updated database_triggers page and backend function
* fix: struct rust
* feat: 🚧 update migrate, database trigger backend function fixed
* feat: 🚧 add resource picker front, update backend function
* feat: 🚧 edit inner database inner, update triggers
* feat: 🚧 database_triggers
* feat: 🚧 update openapi yaml, prettied websocker trigger
* feat: 🚧 database_triggers
* feat: 🚧 add resource module, update variable file, working on main loop for database_trigger
* feat: 🐛 working sqlx query
* feat: 🚧 fix query with sqlx, added main loop
* feat: 🚧 add new column database_trigg
* feat: 🛂 run jobs works
* feat: 🚧 handling slot name and replication
* feat: restructring triggers, decoding trigger message on work
* feat: 🚧 database_trigger
* feat: 🚧
* feat: 🚧 converter done, work on custom script
* feat: 🚧 multiple trigger
* feat: 🚧 adding new argument function
* feat: 🚧 database_trigger
* feat: 🚧 add generate template for front, update script picker
* feat: 🚧 template script fix bug, work on restructing backend logic
* feat: 🚧 update autogenerated script, add persistence state for template script
* feat: 🚧 update structure client
* feat: 🚧 rewrited crud function
* feat: 🚧 added publication handler
* feat: 🚧 new ui finished
* feat: 🚧 added slot function hanlder finish front ux
* feat: ✨ ux improvement done, backend logic done
* feat: 🐛 fix where clause
* feat:
* feat:
* chore: update .sqlx and remove empty package
* fix: update publication and remove unneccessary print
* feat: finish converter to json, remove save button, remove unused crate
* feat: update migration for database trigger, fixed query, fixed frontend error with missing feature on back
* chore: update .sqlx
* chore: update sqlx
* chore: .sqlx
* chore: add unused
* fix: use right database resource in back and front
* fix build
* refactor:
* fix sqlx
* nits: retrieve all script from database trigger editor
* fix: template script object, fix route name
* merge main
* feat: rework ux
* feat/finish ux and update backend logic
* feat: database_trigger
* feat: database_trigger
* chore: update sqlx
* chore: fix ci
* nits: fix worker.rs
* feat: database_trigger
* Update frontend/src/lib/components/triggers/database/DatabaseTriggersPanel.svelte
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* feat:
* fix ci
* nits: database to postgres
* nits: fix .sqlx
* feat: add link to original code and open tab functionallity
* nits: update .sqlx
* nits: fix request type and yaml file
* nits: add abel suggestion
* fix: update .sqlx
* fix: update .sqlx
* nits: add comment to hex.rs
* nits: remove features, rename database to postgres name
* nits: replace database name by postgres
* nits: database name to postgres
* nits: update .sqlx
* nits: update .sqlx
* nit
* nit
* nits
* nit
* nits
* nits
* nits
* nits
* fix sqlx
* nits: update .vscode
---------
Co-authored-by: HugoCasa <hugo@casademont.ch >
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
2025-01-24 15:12:41 +01:00
a88fbb238a
feat: msft teams support for critical alerts ( #5113 )
...
* feat: msft teams support for critical alerts
* ee changes
* ee
* sqlx prep
* multiple teams channels
* commit file, not symlink
* improve reactivity
* docs link
* Update ee-repo-ref.txt
2025-01-23 19:57:13 +01:00
1f53ded622
team plans billing threshold alert ( #5078 )
...
* team plans billing threshold alert
* nits
* tmp ee ref
* update ee ref
2025-01-17 14:06:47 +01:00
b7eeed0729
triggers improvements ( #5074 )
...
* triggers improvements
* nits
* nits
* update ee ref
2025-01-16 13:01:45 +01:00
77d825540f
feat: add oracle db support on ee ( #5062 )
2025-01-14 21:21:24 +01:00
04fbda28e8
feat: on behalf of ( #5058 )
...
* feat: on behalf of
* fix
* revert mistakke
* temp ee ref
* renaming + CLI
* sqlx
* nits + ee ref
2025-01-14 18:32:25 +01:00
e66fcf9270
feat: nats triggers ( #5039 )
...
* feat: nats triggers
* missing files
* fix build
* update feature flags
* event stream fixes
* update ee ref
2025-01-10 19:47:17 +01:00
0c391372cc
feat(frontend): allow workspace admin to set workspace color ( #5032 )
...
* feat(frontend): allow workspace admin to set workspace color
* sqlx prep
* sqlx prep
* make border wider, add removed comment
2025-01-09 06:42:36 +01:00
01c6f84520
feat: captures ( #4807 )
...
* feat: captures
* flow UI and improvements
* fix: build
* fix sqlx
* Move Capture WIP
* Add capture to webhook and websocket
* Move connection status viewer in the head
* change trigger section label
* Add popover capture picker using melt ui
* Add shortcut to triggers capture from input form
* remove capture tab in input
* Allways show capture
* remove useless logs
* Add email capture
* Add kafka capture into triggers
* Add edit option in capture table
* use light header for arg input
* Add prefilled group id
* Change button label
* fix logic
* Open resource drawer if prototype has fields
* fix default completion
* Change name Prototype
* Dissociate Editor Mode for triggers
* Fix bug for script
* Fix apply args
* fix apply schema
* Add capture table to script
* fix apply args
* Add capture button for script
* Delete capture tab
* Set capture on when opening triggers capture
* fix connection indicator
* fix minor issues
* Add preprocessor logic
* Use slot in log Panel for captures
* handle capture refresh in script
* Delete capture tab from script editor
* reset kafka resource on toggle static
* fix minor issue
* Allow resource in kafka capture
* use simple capture button in flow
* Remove capture panel
* Polish route trigger editor
* Fix resource saving
* Remove excessive padding
* merge nits
* add workflow_dispatch to build
* add workflow_dispatch to build
* better capture UI
* fix sqlx
* fix build
* fix build
* build
* make initial_messages optional in line with db
* fix npm check
* better handle args for capture webhook and http
* improve migration + http capture fixes
* fix sqlx
* update ee ref
---------
Co-authored-by: Guilhem <guilhemlemouel@gmail.com >
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com >
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
2025-01-06 12:07:09 +01:00
c85d2a4957
feat: add C# support ( #4908 )
...
* Add csharp stuff and merge after the rewrite
* Add csharp, boilerplate + minimal execution
* Add initial parser
* Frontend + wasm export of the tree sitter parser
* Arg spread and use cache
* More types and req parsing
* Add logo
* Parse async and void to fit the wrapper to the main sig
* Csharp editor resource and var buttons
* Lockfile generation
* Add default parsing using serde_json::from_str
* Update init code for c#
* Nsjail for c#
* Remove c_variadic feature
* Remove unused imports
* Add c_variadic only for wasm32 assembly
* Fix c# test
* Add dotnet to the images
* Update dockerfiles
* Update dockerfile again
* Touch Dockerfile
* npm install c# parser
* Add opt mount in nsjail
* Update ee repo ref
* Add csharp to backend image for tests
* Add setting to set nuget package
* Windows compatibility
* Disable csharp test
* ADd feature flag
2024-12-13 00:29:01 +01:00
bcd2cfe674
fix(frontend): fix newly deployed apps with frontend scripts
2024-12-10 19:41:11 +01:00
2bc4934c4f
feat: add db storage for app inline scripts ( #4837 )
2024-12-06 13:37:45 +01:00
f175158b9f
fix: handle flow & workspace renames for flow_node ( #4861 )
2024-12-06 09:40:32 +01:00
667167a022
fix: fix flow_node uniqueness ( #4850 )
...
`jsonb` comparison wasn't working as expected, and duplicated entries
were inserted within `flow_node`. To resolve this add a second hash
column, `hash_v2` with a unique default for uniqueness, and use this new
column to ensure unique entries. The previous hash column is left for
backward compatibility. Duplicated entries already insterted will remain
as is without breaking, and only new ones will preserve uniqueness.
2024-12-05 17:42:33 +01:00
b534ef6074
improve transparency for slow queries
2024-12-04 17:30:58 +01:00
1ec6c6f765
feat: app custom paths ( #4828 )
...
* feat: app custom paths
* nit
* make ee only + fix sqlx
* fix: custom http routes auth
* nits
* fix auth + nits
* apps_ee
* move custom path to ee
* fix app jwt
* update ee ref
2024-12-04 16:50:17 +01:00
ac8d359dfb
fix apply migration to current_user
2024-11-27 19:07:31 +01:00
2668e37574
adding sqlx migration to grant windmill permissions to db user ( #4806 )
2024-11-27 18:27:06 +01:00
2911775d0a
feat(backend): store flow inner modules into flow_node table ( #4778 )
2024-11-27 16:08:31 +01:00
Ruben Fiszel
wendrul
dieriba
HugoCasa
Alexander Petric
Lucas Abel
pyranota
Ruben Fiszel