5b534be168
feat: ssh repl like direct to workers hosts machine ( #5809 )
...
* feat(backend): add repl for worker
* feat(frontend): add repl to interact with worker and missing packages
* nits
* Update backend/windmill-worker/src/result_processor.rs
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Update backend/windmill-worker/src/result_processor.rs
Co-authored-by: graphite-app[bot] <96075541+graphite-app[bot]@users.noreply.github.com>
* Update frontend/src/lib/components/WorkerRepl.svelte
Co-authored-by: graphite-app[bot] <96075541+graphite-app[bot]@users.noreply.github.com>
* fix typo
* fix cd
* nits
* refactoring
* feat: handle other agent worker to also access repl feature, fix bugs
* update repo ref
* nits and match function args
* nits
* typo
* remove struct AgentWorkerData
* update repo ref
* nits
* impl new for authed client and revert to async
* update ref
* updage ee repo ref
* fix missing method/imports small bugs
* update ee repo ref
* update .sqlx
* test
* clean wait for interactive_shell future
* free call stack
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
Co-authored-by: graphite-app[bot] <96075541+graphite-app[bot]@users.noreply.github.com>
2025-06-03 18:41:14 +02:00
7467833239
EE Refactor ( #5844 )
...
* app compiles with every ee substituted
* Replace all oss files content
* Revert "Replace all oss files content"
This reverts commit ea4017d59f
2025-06-02 22:12:33 +02:00
2833d6da3f
feat(python): inline script metadata (PEP 723) ( #5712 )
...
* make resolver
* more updates
* fix build
* fix raw_dependencies job type
* compat with http agent workers
* refactor
* rename
* more refactor
* cleanup
* more tests
* fix s3
* small fixes
* more fixing
* fix endpoint
* nit: update comment
* update ee ref
* update ee ref
* update ee ref
* implement safer `list_available_python_versions`
* add tracing to get of authed client
* internal: Trigger claude when commenting with /aider (#5783 )
* add claude instructions files
* call claude too when using aider
* fix
* add draft for linear claude integration
* fix build
* update ee ref
* ignore versions <=3.9
* fix windows build
* correct versions filter
* fix windows build (this time for real)
* inject error to debug CI
* update CI
* undo debug of CI
* fix tests
* remove outdated comment
* update ee repo ref
* Update ee-repo-ref.txt
* Update backend/parsers/windmill-parser-py-imports/src/lib.rs
Co-authored-by: graphite-app[bot] <96075541+graphite-app[bot]@users.noreply.github.com>
* Update InstanceSetting.svelte
---------
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
Co-authored-by: centdix <40307056+centdix@users.noreply.github.com >
Co-authored-by: graphite-app[bot] <96075541+graphite-app[bot]@users.noreply.github.com>
2025-05-24 02:13:47 +02:00
729d90f61e
add more labels to traces
2025-05-22 12:07:21 +02:00
23cce4ddb0
fix: workspace preprocessor improvements ( #5784 )
...
* add tracing to get of authed client
* internal: Trigger claude when commenting with /aider (#5783 )
* add claude instructions files
* call claude too when using aider
* fix
* add draft for linear claude integration
* fix: workspace preprocessor fixes
* tmp ee ref
* fix build
* update ee ref
* fix: hub script preprocessor handling
* fix build
* good ref
---------
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
Co-authored-by: centdix <40307056+centdix@users.noreply.github.com >
2025-05-21 17:49:21 +02:00
a499f9dffe
fix: improve handling of custom concurrency key/tag with preprocessors ( #5762 )
...
* fix
* rm spurrious diff
* handle failing preprocessors
* nits
* update
* update
2025-05-17 10:52:28 +02:00
a325bf587f
add more duration warnings to logs
2025-05-14 10:27:55 +02:00
d2787cfd78
feat: preprocessor refactor ( #5629 )
...
* feat: preprocessor refactor
* nit
* oneOf kind support + new capture format + fix build
* fix build
* fix build
* update preprocessor templates
* cache runnable version info
* update ee ref
* update hub scripts && ee ref
2025-05-09 09:50:01 +02:00
bfe0a7aa8b
feat: handle . in interpolated args
2025-05-07 13:57:05 +02:00
13ed9fa876
fix(python): handle better relative imports with requirements or extra_requirements
2025-04-29 15:23:44 +02:00
1c46bf9301
slower pull if no tag is available
2025-04-28 00:34:30 +02:00
031e522a6a
ui code builder v0 (at secret path) ( #4964 )
2025-04-20 01:19:02 +02:00
96376effda
improve perf of push
2025-04-12 15:26:56 +00:00
216b5b01e3
improve benchmarks
2025-04-12 11:09:21 +00:00
06586596e5
feat: add gcp trigger ( #5501 )
...
* update: add migration for gcp_trigger table, add cli method gcp and add gcp_trigger args for github ci
* update: add gcp module and routing it in lib.rs
* update: added gcp type to TRIGGER KIND type in db, add new feature condition to try_get_fn and added gcp_trigger feature in cargo file
* update: add ui for gcp trigger, added missing triggers type for job kin, add gcp trigger in deploy to functionallity
* adding google cloud crate
* update: handle pull and push delivery
* update: handle pull and push delivery
* update: handle push event, changed front ui
* update: ui
* fix: capture for gcp
* update: automatically manage pub sub subscription and refactoring
* capture done
* update cli types
* fix: wrong func argument and type openapi
* fix: missing import
* update .sqlx
* update: svg color and remove pulse button for capture push gcp
* update: handle deployto
* update script helper and link to hub gcp script/flow
* update gcp representation
* update: add confirmation modal
* add unique index to mitigate same subscriber id, fix `zombie worker`, update test connection logic
* Update frontend/src/lib/components/triggers/gcp/GcpTriggerEditorInner.svelte
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Update cli/gen/services.gen.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* nits
* update repo ref
* fix feature function
* update dependencies
* update .sqlx
* fix missing import
* update: handle existing subscription and creating new one or update it
* fix ee build
* handle existing config properly
* update .sqlx
* update .sqlx
* remove unused
* update documentation link fix ci
* use on instance of empty_string_as_none fn
* update refo ref
* updat script_helper
* update ui
* update migration
* add missing arguments
* fix and nits
* update repo ref
* remove unused
* nits
* add doc links
* nits
* Update frontend/src/lib/components/triggers/gcp/GcpTriggerPanel.svelte
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Update frontend/src/lib/components/triggers/gcp/GcpTriggerEditorInner.svelte
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* use trigger path as default route path
* update .sqlx
* update repo ref
* update ref
* update route path
* update types
* fix deploy to
* nits
* update repo ref
* update .sqlx
* Update frontend/src/lib/components/triggers/gcp/GcpTriggerEditorConfigSection.svelte
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* nits
* nits
* nits
* remove dupliacte fn and update repo ref
* remove unused import
* fix missing import
* fix: wong name var
* update script helper and template script
* Update frontend/src/lib/script_helpers.ts
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Update ee-repo-ref.txt
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
Co-authored-by: HugoCasa <hugo@casademont.ch >
2025-04-10 20:39:01 +00:00
947c91809d
feat: agent workers v2 using http ( #5588 )
2025-04-10 00:56:11 +00:00
6602c5fedf
fix benchmarks
2025-04-03 21:17:13 +00:00
064c5bb5f1
fix: correctly run empty flow with preprocessor from UI ( #5537 )
2025-03-28 11:26:26 -07:00
ef88a83f56
bump versions ( #5526 )
...
* all
* version bump
* ci
* fix bump
* fix
2025-03-27 23:57:09 +01:00
e04529b309
nit, add scheduled_for in logs
2025-03-27 21:28:21 +01:00
ec886a688a
fix: add missing privileged hub script for app slack reports ( #5515 )
2025-03-26 23:15:03 +01:00
7e802bd611
perf: cache workspace premium check
2025-03-25 02:00:51 +01:00
094a9deccd
fix: improve cancel for flows with many substeps
2025-03-24 22:00:15 +01:00
123b4405ed
perf: optimize number of queries needed for job run ( #5504 )
...
* optPerf
* update sqlx
* update sqlx
2025-03-24 20:12:26 +01:00
884aba4811
perf: improve perf of get completed flow node ( #5418 )
...
* perf: improve perf of get completed flow node
* better
* nit
* nits
---------
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
2025-03-19 10:51:30 +01:00
eefb77f445
nit move away from using views
2025-03-19 10:48:43 +01:00
aaa4cde349
feat: filter by worker + backend perf opt ( #5489 )
...
* all
* all
* all
* refactor
* sqlx
* ref
* impr
* fix
* fix
* fix
* ee private
2025-03-19 09:55:53 +01:00
5134deefad
improve concurrency limits II ( #5485 )
2025-03-17 17:24:50 +01:00
fcaee6fef5
fix: improve concurrency limit check performances
2025-03-17 00:53:14 +01:00
c15e699150
DISABLE_CONCURRENCY_LIMIT 2
2025-03-16 18:22:41 +01:00
18ecb261c3
DISABLE_CONCURRENCY_LIMIT
2025-03-16 17:45:40 +01:00
fe6c2abd59
fix: improve row lock contention on concurrency counter
2025-03-16 17:20:39 +01:00
5765d4cf75
nit zombie job monitoring
2025-03-11 07:08:28 +01:00
d7879e237b
fix: improve cancel performance
2025-03-03 23:50:13 +01:00
4ae8cad4d4
fix: schedules do not accept 5 units cron syntax on update/create anymore
2025-02-20 17:59:32 +01:00
60a3cc2e65
make benchmarks even more stable
2025-02-18 08:43:03 +01:00
a034c3ff28
fix: improve que job indices for faster performances
2025-02-17 21:26:46 +01:00
ecbec1fe50
fix(backend): improve schedule queries plan to leverage indices better for performance ( #5273 )
...
* backend: fix schedule queries plan
* rework
* fix skipped as non success
* update sqlx
* update
* all
* fix npm run check
---------
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
2025-02-12 16:34:03 +01:00
5f46d79f26
fix: fix concurrent limit jobs non restarting
2025-02-10 11:33:19 +01:00
7bf5e381ac
fix: worker name in job + better timeout handling for same_worker jobs ( #5248 )
2025-02-08 22:20:06 +01:00
17a86e6907
backend: fix workflow as code ( #5239 )
...
* backend: improve `/get_job_update` after v2
* backend: insert missing `workflow_as_code_status` on completion
also insert `flow_status` from so we can remove the query when `_duration` is above 500
* backend: fix workflow_as_code after v2
* backend: add `workflow_as_code` worker test
2025-02-07 12:27:43 +01:00
6ded2c598e
backend: use v2 tables through views where possible (v2 phase 3) ( #5119 )
2025-02-06 12:43:24 +01:00
8374377958
backend: check queries to queue and completed_job where possible (v2 phase 2) ( #5125 )
2025-02-06 12:39:32 +01:00
cecc19dafc
backend: migrate job tables to v2 schema (v2 phase 1) ( #5084 )
2025-02-06 12:37:11 +01:00
098cd72840
fix uv install for nsjail ( #5222 )
2025-02-06 00:00:33 +01:00
dd3fb0f955
improve error messages for internal err
2025-02-05 16:32:01 +01:00
900a8d675e
feat: postgres triggers ( #4860 )
...
* feat: init database triggers
* feat: ✨ wip: database_triggers
* feat: ✨ add database triggers front view
* feat: 🚧 database_triggers
* feat: 🚧 add definition in yaml, updated backend code and added migration
* feat: 🚧 updated migration file, update openapi.yml, updated database_triggers page and backend function
* fix: struct rust
* feat: 🚧 update migrate, database trigger backend function fixed
* feat: 🚧 add resource picker front, update backend function
* feat: 🚧 edit inner database inner, update triggers
* feat: 🚧 database_triggers
* feat: 🚧 update openapi yaml, prettied websocker trigger
* feat: 🚧 database_triggers
* feat: 🚧 add resource module, update variable file, working on main loop for database_trigger
* feat: 🐛 working sqlx query
* feat: 🚧 fix query with sqlx, added main loop
* feat: 🚧 add new column database_trigg
* feat: 🛂 run jobs works
* feat: 🚧 handling slot name and replication
* feat: restructring triggers, decoding trigger message on work
* feat: 🚧 database_trigger
* feat: 🚧
* feat: 🚧 converter done, work on custom script
* feat: 🚧 multiple trigger
* feat: 🚧 adding new argument function
* feat: 🚧 database_trigger
* feat: 🚧 add generate template for front, update script picker
* feat: 🚧 template script fix bug, work on restructing backend logic
* feat: 🚧 update autogenerated script, add persistence state for template script
* feat: 🚧 update structure client
* feat: 🚧 rewrited crud function
* feat: 🚧 added publication handler
* feat: 🚧 new ui finished
* feat: 🚧 added slot function hanlder finish front ux
* feat: ✨ ux improvement done, backend logic done
* feat: 🐛 fix where clause
* feat:
* feat:
* chore: update .sqlx and remove empty package
* fix: update publication and remove unneccessary print
* feat: finish converter to json, remove save button, remove unused crate
* feat: update migration for database trigger, fixed query, fixed frontend error with missing feature on back
* chore: update .sqlx
* chore: update sqlx
* chore: .sqlx
* chore: add unused
* fix: use right database resource in back and front
* fix build
* refactor:
* fix sqlx
* nits: retrieve all script from database trigger editor
* fix: template script object, fix route name
* merge main
* feat: rework ux
* feat/finish ux and update backend logic
* feat: database_trigger
* feat: database_trigger
* chore: update sqlx
* chore: fix ci
* nits: fix worker.rs
* feat: database_trigger
* Update frontend/src/lib/components/triggers/database/DatabaseTriggersPanel.svelte
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* feat:
* fix ci
* nits: database to postgres
* nits: fix .sqlx
* feat: add link to original code and open tab functionallity
* nits: update .sqlx
* nits: fix request type and yaml file
* nits: add abel suggestion
* fix: update .sqlx
* fix: update .sqlx
* nits: add comment to hex.rs
* nits: remove features, rename database to postgres name
* nits: replace database name by postgres
* nits: database name to postgres
* nits: update .sqlx
* nits: update .sqlx
* nit
* nit
* nits
* nit
* nits
* nits
* nits
* nits
* fix sqlx
* nits: update .vscode
---------
Co-authored-by: HugoCasa <hugo@casademont.ch >
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
2025-01-24 15:12:41 +01:00
7591edea4c
backend: always prioritize flow steps ( #5108 )
...
When a flow start, his flow steps have lower priority than already scheduled jobs, hence steps are only executed when the queue is drained which considerably increase flow execution time when queue size is significant.
This add a very low priority to flow steps in order to prioritize finishing a started flow over new jobs.
2025-01-21 09:27:40 +01:00
175379fbe9
feat: on behalf of ( #5058 )
...
* feat: on behalf of
* fix
* revert mistakke
* temp ee ref
* renaming + CLI
* sqlx
* nits + ee ref
2025-01-14 18:32:25 +01:00
a2f05d0e36
prevent cancelling schedule next tick + remove need of flow_status inside add_completed_job ( #5022 )
2025-01-13 14:26:28 +01:00
dieriba
Diego Imbert
pyranota
Ruben Fiszel
HugoCasa
Lucas Abel