b0660619c8
feat: add step's custom timeout
2023-07-30 20:42:24 +02:00
c9110575cd
feat: add bigquery ( #1934 )
...
* feat: add bigquery
* fix: remove debug logs
* fix: add records number limit
* fix: revert unwanted changes
* feat: bigquery enterprise only
* fix: google auth only when enterprise
* fix: rename bigquery scripts
2023-07-27 14:24:27 +02:00
838266bb2f
feat: lock depedency for the entire flow + dependency job depend on script/flow's tag
2023-07-26 21:14:14 +02:00
ea8a456acc
feat: handle worker groups with redis
2023-07-26 17:33:46 +02:00
35ea4f5f04
feat: add workspace specific tags
2023-07-26 17:33:46 +02:00
af7c92ac16
feat: worker group for flows
2023-07-25 12:41:51 +02:00
ac6c0e033c
Update jobs.rs
2023-07-24 21:54:24 +03:00
0f48c19d5a
fix: respect FIFO order for concurrency limit
2023-07-24 18:11:23 +02:00
957db65da8
fix: off by one concurrency limit fix
2023-07-22 17:05:11 +02:00
223b80768a
chore(backend): upgrade sqlx to ^0.7 ( #1865 )
...
* DRAFT chore(backend): upgrade sqlx to ^0.7
related to:
* https://github.com/windmill-labs/windmill/pull/1858
* https://github.com/launchbadge/sqlx/issues/1163#issuecomment-1627685514
* (vol. 2) in 0.7, `Transaction` can no longer implement `Executor` directly
ref: https://github.com/launchbadge/sqlx/blob/afb6b1066e61f8e3875f530d96cfb5a299f13fda/examples/postgres/transaction/src/main.rs#L14-L17
notice that I'm temporarly using my custom patch
https://github.com/mrl5/sqlx/commit/16e4c9a8f380214ad61b1744d3e1f5fa866ffbcc
it's related to https://github.com/launchbadge/sqlx/issues/2611
* post git rebase chores
* use upstream fix from 0.7.1
* fix compile
---------
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com >
2023-07-15 14:06:20 +02:00
0327b85f89
feat: Per script concurrency limit with time window ( #1816 )
...
* Add concurrency a per-script concurrency limit
* Add a per-script per time window concurrency limit
* Improve feature with a better estimation of the next schedule timestamp
* Add concurrency limits for inline scripts
* Fix tests
* run sqlx prepare
* Add requeue event to job logs
2023-07-11 23:35:26 +02:00
b7c7d564ca
feat: add mysql as native integration ( #1859 )
2023-07-11 22:53:02 +02:00
7f3c7ea9d1
Specific NOOP jobs benchmark ( #1810 )
...
* Refactor and fix NOOP benchmark
* Add endpoint to toggle workers on/off when compiled in benchmark mode
* Improve noop benchmark
2023-07-10 14:16:34 +02:00
69ee98a835
feat: workspace error handler ( #1799 )
...
* feat: add workspace error handler
* feat: run error handler as group
* fix: handler picker initial path
* fix(backend): separate global / workspace handlers
* fix(frontend): error handler picker tab change
---------
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
2023-07-06 21:43:15 +02:00
acd6a019c3
select + drawer fix + explicit hash
2023-07-05 10:01:07 +02:00
d64268f0a3
fix: fix global error handler
2023-07-04 22:13:01 +02:00
41213a61aa
feat: native fetch + native postgresql jobs ( #1796 )
...
* push
* test
* test
* done
* fix
* modify script lang enum
* fix tests
* update wasm
* fix tests
2023-07-04 19:39:59 +02:00
218ad892d7
feat: add configurable global error handler
2023-06-30 12:46:02 +02:00
81d62f9250
remove warnings
2023-06-29 12:42:09 +02:00
663e2148ac
feat: smtp support to invite users ( #1777 )
...
* email support
* everyhting
* smtp
* update
* update
* update
* setup backend test
2023-06-29 10:34:44 +02:00
01a5ae940f
add proto postgresql backend support as a job language
2023-06-26 18:23:14 +02:00
55734466dc
improve support for native http handling
2023-06-25 20:00:27 +02:00
6ddc434357
feat: cancel non-yet-running jobs and rework force cancellation
2023-06-25 18:02:00 +02:00
5cc75ac597
add proto native http, psql, graphql jobs in backend
2023-06-23 12:42:01 +02:00
734f75d493
feat: step mocking for flows
2023-06-22 12:01:08 +02:00
251de9b173
fix: correctly handle deeply nested results for out-of-order loops
2023-06-22 08:37:04 +02:00
027fa6ff09
feat: add cache as a primitive for flows ( #1671 )
...
* feat: add cache as a primitive for flows
* fix failure module
2023-06-04 14:39:10 +02:00
e91571a58b
rework premium workspace pricing
2023-05-28 13:00:21 +02:00
c93393d5c0
feat: schedule error handler ( #1636 )
...
* handleError
* revert
* all
2023-05-23 20:25:41 +02:00
9ea18b4593
feat(backend): add job_id as a query arg to force set the new job_id
2023-05-15 10:50:43 +02:00
e60a4b251e
feat(backend): cache hub scripts in the worker cache
2023-05-09 12:45:54 +02:00
796b346bfb
add cairo to openbb build
2023-05-09 11:11:09 +02:00
2d62ced3a5
fix script in schedule should use latest hash
2023-04-27 18:03:12 +02:00
4f7d7bb939
default worker handle other tags
2023-04-24 12:17:38 +02:00
02ba82064f
feat(backend): worker groups ( #1452 )
...
* tagged scripts
* tagged scripts
* fix
* fix
* fix
* all
* update sqlx
2023-04-23 16:57:23 +02:00
1ba0e24155
feat(backend): only run fully deployed scripts
2023-04-21 12:49:47 +02:00
be41e45130
split worker.rs into more files
2023-04-13 17:44:47 +02:00
63102b036c
feat(backend): Redis based queue ( #1324 )
...
* Merge?
* Fix V8 breaking change
* WIP
* WIP
* Cleanup
* Move to git reference
* Fix Merge conflict
* update
---------
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com >
2023-04-11 12:24:13 +02:00
66d2ae813a
fix tests + scheduled_for uses now instead of system time
2023-04-11 11:48:14 +02:00
bbb6a15da7
only register prometheus metrics if they are enabled
2023-04-09 15:39:25 +02:00
0b444ce395
feat: improved cron/schedule editor ( #1362 )
...
* basic cron schedule editing ui
* schedules run in a user-specified timezone
* fix other uses of CronInput component
* use now() from database to schedule next job
* offset -> IANA timezone conversion on db migration
* sqlx ci
---------
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com >
2023-04-05 16:37:24 +02:00
77079b4b68
consistent sort + minor nits
2023-03-30 17:27:21 +02:00
2b413dd6ab
feat: add force cancel
2023-03-30 00:42:13 +02:00
4fe2477940
handle space and uppercase in script_path
2023-03-29 16:16:14 +02:00
904d74187e
feat(backend): allow relative imports for python
2023-03-28 20:27:40 +02:00
0263c20a5b
introduce root_job and leaf_jobs for efficient result_by_id
2023-03-03 12:44:44 +01:00
10f4bf16c2
feat(backend): get_result_by_id do a downward pass to find node at any depth ( #1249 )
...
* downwardRec
* downwardRec
* any node
* any node
* any node
2023-03-01 11:33:48 +01:00
72836b7b96
feat(backend): use counter for sleep/execution/pull durations
2023-02-27 12:00:32 +01:00
d1be3192ea
remove references to starter workspace'
2023-02-22 13:56:24 +01:00
69d4a23b4f
send a webhook on new user + lazy static refactor ( #1203 )
...
* supercharge
* supercharge
* progress
* progress
* display config
* display config
* display config
* display config
* fix extensions
* fix build
* disable nsjail = false for test
2023-02-15 10:59:50 +01:00
Ruben Fiszel
HugoCasa
Ruben Fiszel
Jakub Kołodziejczak
Guillaume Bouvignies
Guillaume Bouvignies
Kai Jellinghaus
Oliver Veal