29ea5f0f7e
feat: Restartable flows ( #2514 )
...
* feat: Restartable flows for simple sequential flows
* check if status of previous module to initialize last_result
* compute result of forloop flows when needed
* Add possibility to restart a flow preview
* Re-compute leaf jobs when needed
* FE polishing
* Add tooltip on button and fix module not found error in preview
* Handle ListJob when computing leaf job from db
* Fix unused imports
* ./build_openapi.sh
* sqlx prepare
2023-10-30 12:51:56 +01:00
acfdca7e72
associate metrics with tags and not langs anymore
2023-10-26 23:52:37 +02:00
bb5aad4eb8
associate metrics with tags and not langs anymore
2023-10-26 23:44:25 +02:00
35665cf102
fix: move keep job directories and expose debug metrics to instance settings UI
2023-10-26 13:08:39 +02:00
57dc62b298
fix: prometheus metrics are an instance settings
2023-10-25 23:32:47 +02:00
d4da2de5c0
fix: improve concurrency limit lock
2023-10-25 00:17:38 +02:00
9f6f7150cd
feat: Priority worker tags ( #2504 )
...
* feat: Priority worker tags
* Fix deprecation warning
* fix tests by initializing the WorkerConfig properly
2023-10-24 17:59:31 +02:00
eacef8cd5b
fix: Track job UUIDs in concurrency table instead of a simple counter ( #2498 )
...
* fix: Track job UUIDs in concurrency table instead of a simple counter
* sqlx prepare
2023-10-24 09:28:46 +02:00
f3b709857f
fix: improve flow performance at high-throughput
2023-10-24 00:11:30 +02:00
ca4502f40b
remove spurious tracing::error
2023-10-23 19:46:37 +02:00
be13471771
fix: fix include_header
2023-10-23 17:04:16 +02:00
bd69bafe59
feat: Priority queue ( #2476 )
...
* BE v1 for priority queue
* Add FE prototype
* sqlx prepare
* Disply priority badge in job detail view
* sqlx prepare post merge
* Add priority number input field next to toggle
* increase dnd timeout for app events
* Update db migration
* Fix FE import
* Add badge to script/flow details page and fix EE-only mention in tooltip
---------
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com >
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
2023-10-23 14:22:59 +02:00
5f5604a2aa
feat: Approval step optionally require logged-in user ( #2462 )
...
* backend auth user validation
* Approval page suggesting login
* BE impl to support groups
* Add FE for setting suspend on flow step
* handle admin as a specific case
* restrict feature to entperprise only
* group names as static input transforms
* Suspend settings with tabs
* Update enterprise edition check
* cleanup
---------
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
2023-10-20 00:20:20 +02:00
09e29d6b3c
feat: Mute workspace error handler for flows and scripts ( #2458 )
...
* feat: Mute workspace error handler for flows and scripts
* implement BE muting
* Add tooltip to bell icon
* change field name to ws_error_handler_muted
* revert new field for queue table
* Error when error handler not set
* extract svelte component and use flow table column
* Fix flow error handler result arg
2023-10-17 22:07:13 +02:00
22ecc543df
improve error tracing
2023-10-16 19:45:43 +02:00
c15aca19e9
improve error handling after refactor
2023-10-16 18:40:01 +02:00
2ee57f3f84
feat: refactor entirely json processing in favor or rawjson to handle larger payloads ( #2446 )
...
* raw json
* raw json
* raw json
* raw json
* the big rawjson rewrite
* resolve merge conflicts
* all
* progress
* progress
* all compile
* remove mut
* remove mut
* remove mut
* arc queuedjob
* finish
* finish
* finish
* fixes
* progress
* fix result
* small fixes
* small fixes
* fix tests
* fix tests
* fix tests
* optimize eval timeout
* optimize eval timeout
* optimize eval timeout
* handle big args and result in get jobs
* improve args
* fix
* fix
* fix tests
* fix tests
* done
* add bigquery to native picker
* add bigquery
---------
Co-authored-by: gbouv <guillaume@windmill.dev >
2023-10-16 10:46:55 +02:00
a970108108
fix: Workspace error handler extra args are passed to job ( #2452 )
2023-10-13 20:48:56 +02:00
0965d67dc8
feat: Improve Slack schedule error handler and default to it ( #2439 )
...
* feat: Improve Slack schedule error handler and default to it
* refactor BE to re-use existing logic to handle error
* Fix svelte error
2023-10-12 15:11:05 +02:00
00434f1a78
fix: improve handling of large results by frontend
2023-10-08 15:37:10 +02:00
f6dab0576a
fix: tag id as flow ( #2318 )
2023-09-21 18:20:34 +02:00
323900e214
feat: dedicated benchmarks ( #2297 )
...
* feat: dedicated benchmarks
* feat: dedicated benchmarks
* fix: build
* fix: use ee for ci
* fix: ci
* fix: handle create jobs error
* fix: nits
2023-09-19 14:03:19 +02:00
23a0be78c3
fix concurrency limit with jobs scheduled in the future
2023-09-15 23:42:44 +02:00
e0ff5484e1
fix tests
2023-09-15 09:30:33 +02:00
216181075a
fix migraiton
2023-09-14 11:44:36 +02:00
52734a6c94
fix migration
2023-09-14 11:32:52 +02:00
4ad9b844f1
fix migration
2023-09-14 11:28:06 +02:00
dfcdb2d8ff
feat: worker groups admin panel ( #2277 )
...
* merge
* merge
* merge
* wg
* progress
* all
* all
* all
* all
* all
* all
* fix
* fix
2023-09-13 21:24:54 +02:00
00e131269e
feat: zero copy result for job result ( #2263 )
...
* feat: zero copy result for job result
* update
2023-09-11 08:00:02 +02:00
9e89bc95e3
improve benchmarks
2023-09-08 17:32:26 +02:00
5ac99b817e
feat: dedicated workers for native-throughput performance (EE only) ( #2239 )
...
* dedicated worker
* dedicated worker
* merge
* progress
* progress
* progress
* merge
* update
* sqlx
* fix imports
2023-09-06 10:32:53 +02:00
7982b75613
feat: submit result in background thread (unify architecture for dedicated worker) ( #2226 )
...
* merge
* all
* all
2023-09-04 01:56:23 +02:00
21e8d7694c
perf: improve queue performance ( #2222 )
...
* benchs
* progress
* prog
* progress
* progress
* progress
* update
* progress
* progress
* progress
* progress
* progress
* all
* all
* improve queries
* improve queries
* rm imv
* all
* all
2023-09-03 09:44:16 +02:00
24527d240b
feat: improve queue performance when queue grows large
2023-08-31 23:41:04 +02:00
f45b6dc088
feat: add workspace variable to worker tag
2023-08-31 11:00:57 +02:00
8d62fbdbdc
feat: add caching to flows and scripts ( #2193 )
...
* cachettl
* all
2023-08-29 13:00:20 +02:00
11c8f90daf
feat: concurrency limits for flows
2023-08-28 16:02:48 +02:00
38f4e7f69d
fix cancel jobs
2023-08-27 15:09:54 +02:00
e051451cd6
fix: canceling jobs
2023-08-27 14:40:20 +02:00
3d79187f31
feat: lock inline scripts for apps on deploy
2023-08-26 09:12:19 +02:00
29262130e1
encode special characters in postgres url
2023-08-25 14:38:30 +02:00
cbbfee8439
feat: schedule recovery handler ( #2126 )
...
* feat: schedule recovery handler
* fix: migration down
* fix: rename
* fix: adjust + add tests
* fix: merge + sqlx prepare
* fix: more complete recovery handler
* feat: schedule error and recovery times
* fix: schedule worker test
* feat: slack schedule handlers
* fix: update schedule handlers
2023-08-24 18:20:35 +02:00
6f40b77ba9
fix: fix cancel job for flows in some edge cases
2023-08-22 21:35:35 +02:00
6787c8f824
fix schedule edit issue
2023-08-22 19:30:55 +02:00
c05c9d2412
improve push method to reduce commit span
2023-08-22 17:26:51 +02:00
f0e6158c54
fix flow lock
2023-08-22 01:04:04 +02:00
c77d38563d
remove unecessary postgres transactions and improve performance
2023-08-22 00:34:44 +02:00
125a00fa8e
improve indices performances
2023-08-20 19:14:39 +02:00
e41a3fc1d2
improve sql query performances
2023-08-20 18:06:59 +02:00
1778ec1117
feat: respect lockfiles for bun
2023-08-12 20:49:36 +02:00
Guillaume Bouvignies
Ruben Fiszel
Ruben Fiszel
HugoCasa