Commit Graph
1758 Commits
Author SHA1 Message Date
Ruben Fiszel cf9669c18d feat: invalidate result cache on flow or script change 2023-10-31 12:49:31 +01:00
Guillaume Bouvignies 729bf59558 chore: Add restarted flow test in worker.rs (#2524)
* chore: Add restarted flow test in worker.rs

* small refactor to rust code

* Fix unused imports
2023-10-31 09:14:14 +01:00
Ruben Fiszelandrubenfiszel a87a441c14 chore(main): release 1.194.0 (#2523)
* chore(main): release 1.194.0

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2023-10-30 20:17:31 +01:00
HugoCasa 302649faa8 fix: workspaced embeddings for resource types (#2525)
* fix: workspaced embeddings for resource types

* fix: remove admins only rts
2023-10-30 15:28:20 +01:00
Ruben Fiszel cd01734735 add more migration info at start 2023-10-30 15:17:32 +01:00
Guillaume Bouvignies 76a736aee6 feat: Restartable flows (#2514)
* feat: Restartable flows for simple sequential flows

* check if status of previous module to initialize last_result

* compute result of forloop flows when needed

* Add possibility to restart a flow preview

* Re-compute leaf jobs when needed

* FE polishing

* Add tooltip on button and fix module not found error in preview

* Handle ListJob when computing leaf job from db

* Fix unused imports

* ./build_openapi.sh

* sqlx prepare
2023-10-30 12:51:56 +01:00
Ruben Fiszel ed86a61cf0 improve slow pull metrics 2023-10-30 12:20:40 +01:00
Ruben Fiszel 82eaacb316 add support for pg-embed 2023-10-28 19:02:49 +02:00
Ruben Fiszel f94c9f8ec5 nit metrics 2023-10-28 16:21:30 +02:00
Ruben Fiszel 2cec6a0971 add more metrics 2023-10-28 15:35:45 +02:00
Ruben Fiszelandrubenfiszel 0a2648f560 chore(main): release 1.193.0 (#2513)
* chore(main): release 1.193.0

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2023-10-28 15:04:26 +02:00
Ruben Fiszel 23a6424125 add dedicated worker sender channel queue 2023-10-28 14:15:42 +02:00
Ruben Fiszel b8883481f4 feat: refactor metrics and add performance debug metrics (#2520)
* all

* feat: add debug metrics
2023-10-27 21:00:28 +02:00
Ruben Fiszel a1a4737ddf fix resource types embedding 2023-10-27 16:48:20 +02:00
Ruben Fiszel 5c4d1f734c add loki as optional feature flag 2023-10-27 11:51:26 +02:00
Ruben Fiszel f5eeccad24 associate metrics with tags and not langs anymore 2023-10-26 23:52:37 +02:00
Ruben Fiszel dc10aaa660 associate metrics with tags and not langs anymore 2023-10-26 23:44:25 +02:00
Ruben Fiszel 55ceca1913 fix: move keep job directories and expose debug metrics to instance settings UI 2023-10-26 13:08:39 +02:00
Ruben Fiszel ea28163865 fix: prometheus metrics are an instance settings 2023-10-25 23:32:47 +02:00
Ruben Fiszelandrubenfiszel 17f7356403 chore(main): release 1.192.0 (#2509)
* chore(main): release 1.192.0

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2023-10-25 10:13:51 +02:00
Ruben Fiszel 53c38f9176 improve key not found error 2023-10-25 09:59:49 +02:00
Ruben Fiszel 402193cef9 fix: do not share http_client in js_eval runtime 2023-10-25 09:51:20 +02:00
Ruben Fiszelandrubenfiszel b9c9a20dd6 chore(main): release 1.191.0 (#2506)
* chore(main): release 1.191.0

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2023-10-25 01:27:28 +02:00
Ruben Fiszel d44b078e70 fix: improve concurrency limit lock 2023-10-25 00:17:38 +02:00
Guillaume Bouvignies 51f2198c34 feat: Priority worker tags (#2504)
* feat: Priority worker tags

* Fix deprecation warning

* fix tests by initializing the WorkerConfig properly
2023-10-24 17:59:31 +02:00
Guillaume Bouvignies 927cbbe230 fix: concurrency limit EE feature warning (#2505)
* fix: concurrency limit EE feature warning

* fix deprecated usage

* skip serializing empty optional
2023-10-24 17:59:16 +02:00
Ruben Fiszel e79ca4e845 improve batch job api for scripts 2023-10-24 12:20:57 +02:00
Ruben Fiszelandrubenfiszel f752f83c94 chore(main): release 1.190.3 (#2502)
* chore(main): release 1.190.3

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2023-10-24 10:21:50 +02:00
Ruben Fiszel 12ebd75307 fix sqlx 2023-10-24 10:21:30 +02:00
Ruben Fiszelandrubenfiszel cc17e36702 chore(main): release 1.190.2 (#2501)
* chore(main): release 1.190.2

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2023-10-24 09:54:41 +02:00
Ruben Fiszel 176dd415b6 show psql version on start 2023-10-24 09:54:01 +02:00
Guillaume Bouvignies 96f3854145 fix: ListableQueuedJob were missing the priority field (#2500) 2023-10-24 09:49:14 +02:00
Ruben Fiszelandrubenfiszel 410cdd5526 chore(main): release 1.190.1 (#2497)
* chore(main): release 1.190.1

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2023-10-24 09:31:20 +02:00
Guillaume Bouvignies f428581269 fix: Track job UUIDs in concurrency table instead of a simple counter (#2498)
* fix: Track job UUIDs in concurrency table instead of a simple counter

* sqlx prepare
2023-10-24 09:28:46 +02:00
Ruben Fiszel d53549bb31 update rust-python to 3.0 (#2499) 2023-10-24 09:26:36 +02:00
Ruben Fiszel 1ec56c0e23 fix: improve flow performance at high-throughput 2023-10-24 00:11:30 +02:00
Ruben Fiszel 2bd629ecab fix: add shapefile to python remapping 2023-10-23 23:06:08 +02:00
Ruben Fiszel 7199bbce73 improve dedicated worker on default worker grou[ 2023-10-23 22:59:25 +02:00
Bonnie White 244a36e363 Update lib.rs (#2495) 2023-10-23 22:50:26 +02:00
Ruben Fiszel bed4b51c5b add support for batch flow jobs 2023-10-23 21:53:22 +02:00
Ruben Fiszelandrubenfiszel d75860af19 chore(main): release 1.190.0 (#2491)
* chore(main): release 1.190.0

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2023-10-23 21:49:32 +02:00
Ruben Fiszel 39f30785a0 feat: dedicated worker for python (#2492)
* update

* all
2023-10-23 20:21:16 +02:00
Ruben Fiszel d215bd18f7 remove spurious tracing::error 2023-10-23 19:46:37 +02:00
Ruben FiszelandHugoCasa ec65fa84cc fix: stats nits (#2490)
Co-authored-by: HugoCasa <hugo@casademont.ch>
2023-10-23 18:07:24 +02:00
Ruben Fiszelandrubenfiszel fa51a6cb4a chore(main): release 1.189.0 (#2481)
* chore(main): release 1.189.0

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2023-10-23 17:21:30 +02:00
HugoCasa 7037d70ca2 feat: add unique id (#2483)
* feat: add unique id

* fix: sqlx prepare

* feat: add disable option

* fix: cron schedule
2023-10-23 17:05:54 +02:00
Ruben Fiszel 44c3c96d3e fix: fix include_header 2023-10-23 17:04:16 +02:00
3f4af48b0b feat: Priority queue (#2476)
* BE v1 for priority queue

* Add FE prototype

* sqlx prepare

* Disply priority badge in job detail view

* sqlx prepare post merge

* Add priority number input field next to toggle

* increase dnd timeout for app events

* Update db migration

* Fix FE import

* Add badge to script/flow details page and fix EE-only mention in tooltip

---------

Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2023-10-23 14:22:59 +02:00
Guillaume Bouvignies af45ef06f2 fix: Update openapi definition to be compatible with oapi-codegen (#2487) 2023-10-23 14:18:24 +02:00
Ruben Fiszel 2b7018413a feat: dragndrop component on creation 2023-10-21 22:50:19 +02:00