Guillaume Bouvignies
2edba18038
feat: Tag override for scheduled scripts ( #2998 )
...
* feat: Tag override for scheduled scripts
* Refactor WorkerTagPicker to component
* Fix test
2024-01-13 00:06:54 +01:00
Guillaume Bouvignies
2138171c5a
fix: git sync now works for delete and rename ( #2988 )
...
* fix: git sync now works for delete and rename
* update hub script
* sqlx prepare
* Archiving a script/flow removes it from repo
2024-01-12 11:42:54 +01:00
Ruben Fiszel
bb84ab654a
feat: improve git sync and recompute dependents when common python script is redeployed ( #2967 )
...
* fix: allow extraConfig for agGrid to set onGridReady
* depmap
* depmap
* depmap
* depmap
2024-01-07 15:18:27 +01:00
Guillaume Bouvignies
953b80cab7
feat: Add jitter to exponential backoff ( #2842 )
2023-12-12 18:36:22 +01:00
Guillaume Bouvignies
346d9affa5
feat: Add possibility to delete flow step results when the flow is complete ( #2806 )
...
* feat: Add possibility to delete flow step results when the flow is complete
* Add third layer of tabs and gate feature to EE
2023-12-08 21:30:44 +01:00
Guillaume Bouvignies
925632ffd7
feat: CLI now accepts message arg for sync push ( #2784 )
2023-12-05 19:01:09 +01:00
Guillaume Bouvignies
bfb5eb27b5
feat: Add workspace settings to sync scripts/flows/apps to git repo on deployment ( #2740 )
...
* feat: Add workspace settings to sync script to git repo on deployment
* track deployment callback jobs in separate table
* sqlx prepare
* update deployment_metadata table
* Point to hub script
* Add details to the settings page and restrict to EE only
* cleanup unused impots
* Flows and Apps are now pushed to GH as well
* Ignore scripts/flows/apps located in private user folders
2023-12-04 14:26:27 +01:00
Ruben Fiszel
49ecb54692
feat: add early return for flows
2023-11-26 14:30:49 +01:00
Ruben Fiszel
050daee33d
fix: fix flow primary schedule clearing
2023-11-21 17:58:26 +01:00
Ruben Fiszel
518a8396b3
feat: dedicated workers for flows ( #2637 )
...
* dw for flows
* dw for flows
* all
* sqlx
* sqlx
* dedicated workers
* more comments
2023-11-17 10:00:04 +01:00
Ruben Fiszel
eeb6b8280a
fix: fix delete schedule clear jobs
2023-11-15 13:13:24 +01:00
HugoCasa
b076e093df
feat: add unique id ( #2483 )
...
* feat: add unique id
* fix: sqlx prepare
* feat: add disable option
* fix: cron schedule
2023-10-23 17:05:54 +02:00
bd69bafe59
feat: Priority queue ( #2476 )
...
* BE v1 for priority queue
* Add FE prototype
* sqlx prepare
* Disply priority badge in job detail view
* sqlx prepare post merge
* Add priority number input field next to toggle
* increase dnd timeout for app events
* Update db migration
* Fix FE import
* Add badge to script/flow details page and fix EE-only mention in tooltip
---------
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com >
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
2023-10-23 14:22:59 +02:00
Guillaume Bouvignies
09e29d6b3c
feat: Mute workspace error handler for flows and scripts ( #2458 )
...
* feat: Mute workspace error handler for flows and scripts
* implement BE muting
* Add tooltip to bell icon
* change field name to ws_error_handler_muted
* revert new field for queue table
* Error when error handler not set
* extract svelte component and use flow table column
* Fix flow error handler result arg
2023-10-17 22:07:13 +02:00
Ruben Fiszel and gbouv
2ee57f3f84
feat: refactor entirely json processing in favor or rawjson to handle larger payloads ( #2446 )
...
* raw json
* raw json
* raw json
* raw json
* the big rawjson rewrite
* resolve merge conflicts
* all
* progress
* progress
* all compile
* remove mut
* remove mut
* remove mut
* arc queuedjob
* finish
* finish
* finish
* fixes
* progress
* fix result
* small fixes
* small fixes
* fix tests
* fix tests
* fix tests
* optimize eval timeout
* optimize eval timeout
* optimize eval timeout
* handle big args and result in get jobs
* improve args
* fix
* fix
* fix tests
* fix tests
* done
* add bigquery to native picker
* add bigquery
---------
Co-authored-by: gbouv <guillaume@windmill.dev >
2023-10-16 10:46:55 +02:00
HugoCasa
2e60105beb
feat: filter resource types passed to gpt-4 ( #2430 )
...
* feat: code gen filter resource types
* fix: minor
* feat: using snake case for flow inputs
* fix: filter resource types for python
* fix: correct resrouce type name + wmill import
* fix: disable automerge ci
* fix: remove unnecessary json parsing
2023-10-11 17:50:21 +02:00
Ruben Fiszel
76d9dcbe4a
feat: code content search ( #2367 )
...
* code search
* foo
* foo
* all
* all
2023-10-01 21:03:08 +02:00
HugoCasa
1d71154c99
feat: flow copilot ( #2219 )
...
* chore: refactoring
* feat: hub embeddings search benchmark
* feat: flow copilot v0
* feat: as trigger schedule + refactoring
* feat: improvements
* fix: remove unecessary filter
* feat: UX improvements
* fix: frontend check
* feat: switch to bun + other improvements
* fix: improve reactivity
2023-09-07 18:03:48 +02:00
Ruben Fiszel
8d62fbdbdc
feat: add caching to flows and scripts ( #2193 )
...
* cachettl
* all
2023-08-29 13:00:20 +02:00
Ruben Fiszel
ab27adc87e
feat: early stop for flows
2023-08-28 17:46:16 +02:00
Ruben Fiszel
11c8f90daf
feat: concurrency limits for flows
2023-08-28 16:02:48 +02:00
Ruben Fiszel
06006f1c7e
feat: add parallelism control to forloops
2023-08-27 23:03:19 +02:00
Ruben Fiszel
3d79187f31
feat: lock inline scripts for apps on deploy
2023-08-26 09:12:19 +02:00
Ruben Fiszel
c77d38563d
remove unecessary postgres transactions and improve performance
2023-08-22 00:34:44 +02:00
Ruben Fiszel
e41a3fc1d2
improve sql query performances
2023-08-20 18:06:59 +02:00
Ruben Fiszel
9970f6daeb
feat: migrate state path to new schema
2023-08-11 18:54:47 +02:00
Ruben Fiszel
832c988681
fix: fix clear schedule to be workspace specific
2023-08-08 14:10:56 +02:00
Ruben Fiszel
68a4e327a6
fix: fix draft permissions (require writer instead of owner)
2023-08-01 17:02:29 +02:00
Ruben Fiszel
b0660619c8
feat: add step's custom timeout
2023-07-30 20:42:24 +02:00
Ruben Fiszel
838266bb2f
feat: lock depedency for the entire flow + dependency job depend on script/flow's tag
2023-07-26 21:14:14 +02:00
Ruben Fiszel
28933d09cc
UX nits + fix flow worker group
2023-07-25 16:14:23 +02:00
Ruben Fiszel
af7c92ac16
feat: worker group for flows
2023-07-25 12:41:51 +02:00
223b80768a
chore(backend): upgrade sqlx to ^0.7 ( #1865 )
...
* DRAFT chore(backend): upgrade sqlx to ^0.7
related to:
* https://github.com/windmill-labs/windmill/pull/1858
* https://github.com/launchbadge/sqlx/issues/1163#issuecomment-1627685514
* (vol. 2) in 0.7, `Transaction` can no longer implement `Executor` directly
ref: https://github.com/launchbadge/sqlx/blob/afb6b1066e61f8e3875f530d96cfb5a299f13fda/examples/postgres/transaction/src/main.rs#L14-L17
notice that I'm temporarly using my custom patch
https://github.com/mrl5/sqlx/commit/16e4c9a8f380214ad61b1744d3e1f5fa866ffbcc
it's related to https://github.com/launchbadge/sqlx/issues/2611
* post git rebase chores
* use upstream fix from 0.7.1
* fix compile
---------
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com >
2023-07-15 14:06:20 +02:00
Guillaume Bouvignies
0327b85f89
feat: Per script concurrency limit with time window ( #1816 )
...
* Add concurrency a per-script concurrency limit
* Add a per-script per time window concurrency limit
* Improve feature with a better estimation of the next schedule timestamp
* Add concurrency limits for inline scripts
* Fix tests
* run sqlx prepare
* Add requeue event to job logs
2023-07-11 23:35:26 +02:00
Ruben Fiszel
734f75d493
feat: step mocking for flows
2023-06-22 12:01:08 +02:00
Ruben Fiszel
027fa6ff09
feat: add cache as a primitive for flows ( #1671 )
...
* feat: add cache as a primitive for flows
* fix failure module
2023-06-04 14:39:10 +02:00
Ruben Fiszel
9ea18b4593
feat(backend): add job_id as a query arg to force set the new job_id
2023-05-15 10:50:43 +02:00
Ruben Fiszel
73c5a7473d
feat: add drafts for apps
2023-05-01 18:13:57 +02:00
Ruben Fiszel
8d3416e525
feat: introduce draft for flows
2023-05-01 09:31:22 +02:00
Ruben Fiszel
91b8b3eb0a
fix flow update update schedules
2023-04-30 16:18:43 +02:00
Ruben Fiszel
ec89b656b6
feat: introduce backend persisted draft systems for scripts
2023-04-30 15:56:52 +02:00
Ruben Fiszel
02ba82064f
feat(backend): worker groups ( #1452 )
...
* tagged scripts
* tagged scripts
* fix
* fix
* fix
* all
* update sqlx
2023-04-23 16:57:23 +02:00
Ruben Fiszel
4c33daaba0
rework ownership permissions
2023-04-15 23:03:16 +02:00
Ruben Fiszel
be41e45130
split worker.rs into more files
2023-04-13 17:44:47 +02:00
4e74266761
feat: inputs library on run page
...
* display previous script inputs on script run page
* parallelise loading
* parallelise loading
* also working for flows
* separate endpoints for scripts and flows
* Splitpanes and Saved Inputs (UI)
* Saved inputs API endpoints
* Editable Input name
* Narrow width styling
* feat(frontend): Add a toggle to open the saved inputs (#1401 )
* feat(frontend): Add a toggle to open the saved inputs
* feat(frontend): Add a toggle to open the saved inputs
* feat(frontend): Move toggle
* update all
---------
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com >
Co-authored-by: Faton Ramadani <faton.ramadani14@gmail.com >
2023-04-12 17:29:06 +02:00
Kai Jellinghaus and Ruben Fiszel
63102b036c
feat(backend): Redis based queue ( #1324 )
...
* Merge?
* Fix V8 breaking change
* WIP
* WIP
* Cleanup
* Move to git reference
* Fix Merge conflict
* update
---------
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com >
2023-04-11 12:24:13 +02:00
Ruben Fiszel
3f1fd31e1b
remove backend warnings & fix test
2023-04-02 13:56:16 +02:00
Ruben Fiszel
124775a26d
refresh folders more aggressively in case a non non just created one
2023-04-02 12:08:52 +02:00
Ruben Fiszel
77079b4b68
consistent sort + minor nits
2023-03-30 17:27:21 +02:00
Ruben Fiszel
2809ef905b
fix serde test
2023-03-10 12:19:56 +01:00