Ruben Fiszel
a55aad3003
feat: flow concurrency limits support custom concurrency key
2024-04-09 22:03:39 +02:00
Ruben Fiszel
c7f0f3f359
fix: improve CLI with visible_to_runner_only and priority
2024-04-08 12:22:48 +02:00
HugoCasa
1d7bab075b
feat: private hub ( #3491 )
...
* feat: private hub v0
* feat: add UI setting
* Update ee.rs
* Update ee.rs
* fix: remove ee symlink
* fix: add back CE ee.rs
* feat: disable s3 embedding loading when private hub
* feat: reload embeddings on hub url change
* fix: only reload embeddings db on server mode
* patch: set default hub url const
* fix: nit
2024-04-04 04:16:53 +02:00
Ruben Fiszel
cc5d1b405e
continue on error option for steps
2024-04-02 10:32:47 +02:00
HugoCasa
14a86bf59c
feat: add visible to runner only default value ( #3472 )
2024-03-26 19:07:21 +01:00
Ruben Fiszel
75e9e67d7a
feat: large log disk and distributed storage compaction
2024-03-23 10:55:29 +01:00
Ruben Fiszel
4c388533fb
chore: update deps
2024-03-21 13:37:17 +01:00
Ruben Fiszel
77aaf2724c
chore: remove warnings
2024-02-18 14:03:00 +01:00
Guillaume Bouvignies
f61116da24
chore: License validation and Audit logs EE ( #3227 )
...
* chore: audit log EE
* update repo ref
* license key validation EE
2024-02-15 16:51:24 +01:00
Ruben Fiszel
89dc4dd4aa
nit on txs
2024-02-06 16:40:43 +01:00
Guillaume Bouvignies
99484bdc20
feat: Tag override for scheduled scripts ( #2998 )
...
* feat: Tag override for scheduled scripts
* Refactor WorkerTagPicker to component
* Fix test
2024-01-13 00:06:54 +01:00
Guillaume Bouvignies
cde574b891
fix: git sync now works for delete and rename ( #2988 )
...
* fix: git sync now works for delete and rename
* update hub script
* sqlx prepare
* Archiving a script/flow removes it from repo
2024-01-12 11:42:54 +01:00
Ruben Fiszel
94493812ac
feat: improve git sync and recompute dependents when common python script is redeployed ( #2967 )
...
* fix: allow extraConfig for agGrid to set onGridReady
* depmap
* depmap
* depmap
* depmap
2024-01-07 15:18:27 +01:00
Guillaume Bouvignies
dd1032fbc3
feat: Add jitter to exponential backoff ( #2842 )
2023-12-12 18:36:22 +01:00
Guillaume Bouvignies
b65657d0f8
feat: Add possibility to delete flow step results when the flow is complete ( #2806 )
...
* feat: Add possibility to delete flow step results when the flow is complete
* Add third layer of tabs and gate feature to EE
2023-12-08 21:30:44 +01:00
Guillaume Bouvignies
d9458e96eb
feat: CLI now accepts message arg for sync push ( #2784 )
2023-12-05 19:01:09 +01:00
Guillaume Bouvignies
194ee830cc
feat: Add workspace settings to sync scripts/flows/apps to git repo on deployment ( #2740 )
...
* feat: Add workspace settings to sync script to git repo on deployment
* track deployment callback jobs in separate table
* sqlx prepare
* update deployment_metadata table
* Point to hub script
* Add details to the settings page and restrict to EE only
* cleanup unused impots
* Flows and Apps are now pushed to GH as well
* Ignore scripts/flows/apps located in private user folders
2023-12-04 14:26:27 +01:00
Ruben Fiszel
dbaef0aa5f
feat: add early return for flows
2023-11-26 14:30:49 +01:00
Ruben Fiszel
3ebe6d7a62
fix: fix flow primary schedule clearing
2023-11-21 17:58:26 +01:00
Ruben Fiszel
b13cc58315
feat: dedicated workers for flows ( #2637 )
...
* dw for flows
* dw for flows
* all
* sqlx
* sqlx
* dedicated workers
* more comments
2023-11-17 10:00:04 +01:00
Ruben Fiszel
244b85e859
fix: fix delete schedule clear jobs
2023-11-15 13:13:24 +01:00
HugoCasa
7037d70ca2
feat: add unique id ( #2483 )
...
* feat: add unique id
* fix: sqlx prepare
* feat: add disable option
* fix: cron schedule
2023-10-23 17:05:54 +02:00
Guillaume Bouvignies
3f4af48b0b
feat: Priority queue ( #2476 )
...
* BE v1 for priority queue
* Add FE prototype
* sqlx prepare
* Disply priority badge in job detail view
* sqlx prepare post merge
* Add priority number input field next to toggle
* increase dnd timeout for app events
* Update db migration
* Fix FE import
* Add badge to script/flow details page and fix EE-only mention in tooltip
---------
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com >
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
2023-10-23 14:22:59 +02:00
Guillaume Bouvignies
2dc75f0f65
feat: Mute workspace error handler for flows and scripts ( #2458 )
...
* feat: Mute workspace error handler for flows and scripts
* implement BE muting
* Add tooltip to bell icon
* change field name to ws_error_handler_muted
* revert new field for queue table
* Error when error handler not set
* extract svelte component and use flow table column
* Fix flow error handler result arg
2023-10-17 22:07:13 +02:00
Ruben Fiszel
9314d38bf1
feat: refactor entirely json processing in favor or rawjson to handle larger payloads ( #2446 )
...
* raw json
* raw json
* raw json
* raw json
* the big rawjson rewrite
* resolve merge conflicts
* all
* progress
* progress
* all compile
* remove mut
* remove mut
* remove mut
* arc queuedjob
* finish
* finish
* finish
* fixes
* progress
* fix result
* small fixes
* small fixes
* fix tests
* fix tests
* fix tests
* optimize eval timeout
* optimize eval timeout
* optimize eval timeout
* handle big args and result in get jobs
* improve args
* fix
* fix
* fix tests
* fix tests
* done
* add bigquery to native picker
* add bigquery
---------
Co-authored-by: gbouv <guillaume@windmill.dev >
2023-10-16 10:46:55 +02:00
HugoCasa
e20889b910
feat: filter resource types passed to gpt-4 ( #2430 )
...
* feat: code gen filter resource types
* fix: minor
* feat: using snake case for flow inputs
* fix: filter resource types for python
* fix: correct resrouce type name + wmill import
* fix: disable automerge ci
* fix: remove unnecessary json parsing
2023-10-11 17:50:21 +02:00
Ruben Fiszel
fb960594fc
feat: code content search ( #2367 )
...
* code search
* foo
* foo
* all
* all
2023-10-01 21:03:08 +02:00
HugoCasa
2f3138c65d
feat: flow copilot ( #2219 )
...
* chore: refactoring
* feat: hub embeddings search benchmark
* feat: flow copilot v0
* feat: as trigger schedule + refactoring
* feat: improvements
* fix: remove unecessary filter
* feat: UX improvements
* fix: frontend check
* feat: switch to bun + other improvements
* fix: improve reactivity
2023-09-07 18:03:48 +02:00
Ruben Fiszel
03e48a4ca5
feat: add caching to flows and scripts ( #2193 )
...
* cachettl
* all
2023-08-29 13:00:20 +02:00
Ruben Fiszel
6354c95bb7
feat: early stop for flows
2023-08-28 17:46:16 +02:00
Ruben Fiszel
d0d041fde3
feat: concurrency limits for flows
2023-08-28 16:02:48 +02:00
Ruben Fiszel
34e2a8001a
feat: add parallelism control to forloops
2023-08-27 23:03:19 +02:00
Ruben Fiszel
f5121e9066
feat: lock inline scripts for apps on deploy
2023-08-26 09:12:19 +02:00
Ruben Fiszel
fbc62e8ca5
remove unecessary postgres transactions and improve performance
2023-08-22 00:34:44 +02:00
Ruben Fiszel
a4090f6ad5
improve sql query performances
2023-08-20 18:06:59 +02:00
Ruben Fiszel
de8a7279b6
feat: migrate state path to new schema
2023-08-11 18:54:47 +02:00
Ruben Fiszel
1d1cd31252
fix: fix clear schedule to be workspace specific
2023-08-08 14:10:56 +02:00
Ruben Fiszel
bf57c3a628
fix: fix draft permissions (require writer instead of owner)
2023-08-01 17:02:29 +02:00
Ruben Fiszel
4c870272d4
feat: add step's custom timeout
2023-07-30 20:42:24 +02:00
Ruben Fiszel
90d57e2fad
feat: lock depedency for the entire flow + dependency job depend on script/flow's tag
2023-07-26 21:14:14 +02:00
Ruben Fiszel
ae4dfe634f
UX nits + fix flow worker group
2023-07-25 16:14:23 +02:00
Ruben Fiszel
a0997911bf
feat: worker group for flows
2023-07-25 12:41:51 +02:00
Jakub Kołodziejczak
72d0d8a7f5
chore(backend): upgrade sqlx to ^0.7 ( #1865 )
...
* DRAFT chore(backend): upgrade sqlx to ^0.7
related to:
* https://github.com/windmill-labs/windmill/pull/1858
* https://github.com/launchbadge/sqlx/issues/1163#issuecomment-1627685514
* (vol. 2) in 0.7, `Transaction` can no longer implement `Executor` directly
ref: https://github.com/launchbadge/sqlx/blob/afb6b1066e61f8e3875f530d96cfb5a299f13fda/examples/postgres/transaction/src/main.rs#L14-L17
notice that I'm temporarly using my custom patch
https://github.com/mrl5/sqlx/commit/16e4c9a8f380214ad61b1744d3e1f5fa866ffbcc
it's related to https://github.com/launchbadge/sqlx/issues/2611
* post git rebase chores
* use upstream fix from 0.7.1
* fix compile
---------
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com >
2023-07-15 14:06:20 +02:00
Guillaume Bouvignies
e2fb35a487
feat: Per script concurrency limit with time window ( #1816 )
...
* Add concurrency a per-script concurrency limit
* Add a per-script per time window concurrency limit
* Improve feature with a better estimation of the next schedule timestamp
* Add concurrency limits for inline scripts
* Fix tests
* run sqlx prepare
* Add requeue event to job logs
2023-07-11 23:35:26 +02:00
Ruben Fiszel
4c594c0e64
feat: step mocking for flows
2023-06-22 12:01:08 +02:00
Ruben Fiszel
7e466b7715
feat: add cache as a primitive for flows ( #1671 )
...
* feat: add cache as a primitive for flows
* fix failure module
2023-06-04 14:39:10 +02:00
Ruben Fiszel
b6c0018e2a
feat(backend): add job_id as a query arg to force set the new job_id
2023-05-15 10:50:43 +02:00
Ruben Fiszel
f7374c8204
feat: add drafts for apps
2023-05-01 18:13:57 +02:00
Ruben Fiszel
a1966427e8
feat: introduce draft for flows
2023-05-01 09:31:22 +02:00
Ruben Fiszel
5d64185152
fix flow update update schedules
2023-04-30 16:18:43 +02:00