Commit Graph
358 Commits
Author SHA1 Message Date
wendrul 60b036c1ae Add concurrency limits observability (#3586)
* Add concurrency_key table and field to payload

Add a new table custom_concurrency_key for storing concurrency keys on a
per job basis. Add the field to the job payload to populate the table on
creation of a new job.

* Rename to custom_concurrency_key

Be more explicit about the nature of the option variable by calling it
a more appropriate name.

* Delete concurrency_keys on delete_expire_items

* Propagate db errors up

* Add ref to EE changes

* update sqlx

* Add concurrency_key to tests

* Revert renaming of FlowValue field

FlowValue field concurrency_key must be named concurrency_key for
serialization purposes.

* Remove debug print statement

* Get concurrency_key from Job

Whether it is a Completed job or a queued one, add a ways to get the
associated concurrency key

* Add endpoint to get concurrency_key

* Add endpoint and button to get job concurrency_key

Add a line with a link on the FlowMetadata that goes to the
concurrency_groups page. add endpoint to get the concurrency_key of a
job

* Merge concurrency_key tables into one

migration + change all related querrys

* Add concurrency plot to the runs page

* Prepare sqlx

* Add concurrency Key filter on UI

* Prepare sqlx

* Prepare sqlx

* Fix filter and order query

The limit makes more sense if we cut the older rows, so order by
started_at

* Factor interpolation to reuse on concurrency key

Factor the arg interpolation logic into a function and finish the
processing of concurrency key before insertion

* Remove old concurrency key processing logic

* Second transaction with userdb

To send all concurrency intervals but revealing only uuids of accessible
jobs, make a second transaction with the userdb.

* Remove old second endpoint

the intervals endpoint now also gets the concurrencyt key information
for all jobs

* Show external jobs

* Put filters into a dropdown

Create a ToggleButtonMore and put elements into a dropdown

* Add toggle between two graphs

* Add filter functionality to concurrency graph

* Improve concurrency graph front

* Fix concurrency groups page

* Prepare sqlx

* Add ref to ee

* Change migration to create new table instead

Instead of renaming the custom_concurrency_key_ended atble, we create a
new table and we will delete custom_concurrency_key_ended in the future
when it is no longer linked to any jobs

* Do small UI improvements

* Fix range fusion by not filtering past jobs

Instead of filtering jobs in the backend on a startedAfter value, limit
the query to 1000 and query all possible towards the past to get a good
context for the graph in most sane situations

* Improve frontend UI
2024-05-15 20:15:14 +02:00
HugoCasa f7f7a6d85f feat: add php (#3725)
* feat: add php

* fix: nsjail + frontend build
2024-05-15 08:12:11 +02:00
Faton Ramadani 2cb04d544e fix(frontend): Fix FileInput state when hidden (#3730) 2024-05-14 17:12:09 +02:00
Ruben Fiszel 45b8f8dab7 fix: fix edit button on script row 2024-05-13 22:47:00 +02:00
Ruben Fiszel 26c4ccfdfe ux nits 2024-05-11 18:27:11 +02:00
1f64715043 feat: local typescript codebase as bundle (#3694)
* codebases

* codebases

* foo

* foo

* foo

* foo

* fix(frontend): Disable the insert button when required fields are empty strings (#3659)

* fix(frontend): use normal password mask for the sensitive fields of the resource editor

* handle super admins in password arg input

* chore(main): release 1.323.2 (#3660)

* chore(main): release 1.323.2

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>

* foo

* all

* s3_helpers move

* progress

* all

* progress

* progress

* progress

* progress

* codebase final

* update without ee

* sqlx

* all

* all

* all

* all

* all

* all

* all

* all

* all

* all

* all

* all

* all

* all

* all

* update

* all

* all

* all

---------

Co-authored-by: Faton Ramadani <faton.ramadani14@gmail.com>
Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2024-05-09 18:35:50 +02:00
Faton Ramadani 98f08c5e7b feat(frontend): Improve app components (#3672)
* fix(frontend): wip

* fix(frontend): wip

* fix(frontend): improve components

* fix(frontend): improve components

* fix(frontend): improve ranges

* fix(frontend): fix build
2024-05-07 18:04:12 +02:00
Faton Ramadani ab4d58f4b9 feat(frontend): Improve inputs (#3651)
* fix(frontend): Improve AgGrid Infinite table default codes + deprecated table + improve AutoDatatable

* fix(frontend): Handle undefined rowCount

* fix(frontend): Improve Ag Grid footer

* fix(frontend): Improve Deprecated badge

* fix(frontend): Improve inputs

* fix(frontend): revert select
2024-05-01 10:24:08 +02:00
Ruben Fiszel ec49d63a65 feat: add planned later toggle on runs 2024-04-24 18:17:25 +02:00
Faton Ramadani ce59a6719d fix marine button (#3602) 2024-04-24 11:50:07 +02:00
HugoCasa 9e36ae066c feat: hide scripts with on function main from operators + badge/filter for devs (#3584)
* feat: save in DB whether script has not main function

* fix: if cannot parse script args, clear schema

* feat: no main function badge and filter

* fix: sqlx

* fix: no main
2024-04-22 15:59:13 +02:00
AméliaandFaton Ramadani 4b593cb418 Darkmode rework (#3578)
* darkmode_v2

* darkmode_v2

* feat(frontend): Fix dark theme

* feat(frontend): Remove submodule

---------

Co-authored-by: Faton Ramadani <faton.ramadani14@gmail.com>
2024-04-22 12:19:23 +02:00
8cb7d29cf8 feat(frontend): Deeply nested Modals and Drawers (#3565)
* fix(frontend): Support deeply nested drawers and modals

* fix(frontend): Support deeply nested drawers and modals

* fix(frontend): Support deeply nested drawers and modals

* feat(frontend): fix name

* chore(main): release 1.308.2 (#3569)

* chore(main): release 1.308.2

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>

* feat(frontend): wip

* feat(frontend): wip

* fix(frontend): fix event propagation

* fix(frontend): fix drawers globally

* feat(frontend): Fix all drawers

* feat(frontend): split zIndexes in a new file

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2024-04-19 18:58:39 +02:00
Ruben Fiszel cb6efb08a2 feat: show more for logs on s3 directly possible from browser log viewer 2024-04-17 21:42:46 +02:00
Ruben Fiszel 30b962e2b8 fix: improve unsaved confirmation modal on flow draft 2024-04-14 23:17:06 +02:00
Faton Ramadani 7a3590fb84 fix(frontend): Fix s3 uploader (#3539)
* fix(frontend): Correctly handle multiple files

* fix(frontend): Correctly handle multiple files

* fix(frontend): improve comparaison

* feat(frontend): fix drag and drop
2024-04-12 11:45:11 +02:00
Ruben Fiszel ca9a2221ce nit for whitelabelling 2024-04-11 10:14:36 +02:00
Ruben Fiszel bb7c95a2b2 improve upload progress bar 2024-04-02 21:16:30 +02:00
Faton Ramadani 953b0396a6 feat(frontend): Add support for clearFiles in the file input component (#3483) 2024-03-28 11:44:10 +01:00
HugoCasa c34cd42605 feat: workspace renaming (#3452)
* feat: workspace renaming

* feat: openapi spec

* chore: sqlx prepare
2024-03-22 18:54:29 +01:00
Faton Ramadani 1ea5a68132 fix(frontend): add script history in the script menu on the homepage … (#3388)
* fix(frontend): add script history in the script menu on the homepage + move test an iteration

* fix(frontend): fix Test an iteration position
2024-03-11 09:34:43 +01:00
Ruben Fiszel ee961a31f0 feat: implement s3 oidc support + azure workload identity support 2024-03-08 22:51:16 +01:00
Faton RamadaniandHugoCasa c4f43bd2e7 feat(frontend): Added support for mysql, mssql and snowflake in the Database Studio (#3250)
* feat(frontend): Added support for mysql in the Database Studio

* feat(frontend): generic db

* feat(frontend): generic column def wip

* fix(frontend): adapt queries

* fix(frontend): adapt queries

* fix(frontend): wip

* fix(frontend): wip

* feat(frontend): remove useless runnable calls

* feat(frontend): MySQL + PSQL done, mssql wip

* feat(frontend): clean up

* feat(frontend): clean up

* feat(frontend): mssql: select + count done

* feat(frontend): mssql: update, insert and delete + fix policies

* feat(frontend): typo

* feat(frontend): fix build

* feat(frontend): improve perf + UI

* feat(frontend): add snowflake

* feat(frontend): fix count

* feat(frontend): debounce input

* feat(frontend): fix deploy button

* feat(frontend): remove ghost rows

* feat(frontend): Fix search

* feat(frontend): Fix search

* feat(fontend): remove bigquery

* feat(fontend): Fix performance issues + sorting

* feat(fontend): Fix lastRow

* feat(fontend): Fix build + search

* feat(fontend): fix mysql metadata

* feat(fontend): simplify code

* feat(fontend): remove cache + fix the number of calls

* feat(fontend): clean up

* feat(fontend): clean up

* feat(fontend): remove dead code

* feat(fontend): fix infinite scroll

* feat(fontend): fix count

* feat(fontend): remove unnecessary clearRows

* feat(fontend): add missing delete policy

* feat(fontend): fix search

* feat(fontend): fix search

* feat(fontend): roll back infiniteInitialRowCount

* feat(fontend): roll back infiniteInitialRowCount

* feat(fontend): add bigquery (#3326)

* feat(fontend): add bigquery

---------

Co-authored-by: HugoCasa <hugo@casademont.ch>

* feat(fontend): remove code duplication

* feat(fontend): add mapping for postgres

---------

Co-authored-by: HugoCasa <hugo@casademont.ch>
2024-03-05 08:52:20 +01:00
Faton Ramadani 3f00ac1de9 feat(frontend): Update shortcuts design (#3285)
* feat(frontend): Improve text colors + button shortcuts

* feat(frontend): revert theme changes

* fix(frontend): fix shortcuts

* fix(frontend): fix delete shortcut
2024-02-26 10:30:16 +01:00
Ruben Fiszel 11846561e2 improve togglebuttongroup 2024-02-21 15:35:50 +01:00
Faton Ramadani 07b1dcd980 feat(frontend): Button rework (#3216)
* feat(frontend): wip

* feat(frontend): wip

* feat(frontend): wip

* fix(frontend): improve buttons

* fix(frontend): improve buttons wip

* fix(frontend): wip

* fix(frontend): rework done

* feat(frontend): Fix grey buttons
2024-02-20 09:15:29 +01:00
Ruben Fiszel 1046c856e9 fix: improve date picker across app 2024-02-19 17:29:57 +01:00
Henri Courdent fee382f8fa Download file and file input borders (#3220) 2024-02-15 17:03:05 +01:00
HugoCasa 6eb1e27a74 feat: flow inputs ai gen (#3191)
* feat: flow inputs ai gen

* fix: prevent flow builder crash on AI gen

* fix: nits

* fix: adjust tab behavior
2024-02-10 19:51:44 +01:00
Guillaume Bouvignies 717ab49ed9 feat: Worker env variables are hidden to developers in the config panel (#3175) 2024-02-07 18:43:17 +01:00
Faton RamadaniandRuben Fiszel a06112abc9 feat(frontend): add status when a flow setting is enabled (#3161)
Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2024-02-06 16:05:20 +01:00
Faton Ramadani 7af751e557 fix(frontend): Fix operators actions + small UI fixes (#3157)
* feat(frontend): fix tree view expand all button + operator mode actions

* feat(frontend): fix deploy workspace when user have no access to target workspace
2024-02-06 11:37:00 +01:00
Ruben Fiszel 6065506441 improve alert component 2024-02-05 23:00:17 +01:00
Faton RamadaniandRuben Fiszel 7c1243597b feat(frontend): alert component (#3140)
* feat(frontend): add alert component

* feat(frontend): fix build

* feat(frontend): alert styling

* feat(frontend): add initial isCollapsed

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2024-02-05 17:23:18 +01:00
Guillaume Bouvignies bbda7cf268 feat: Support for Azure Blob storage (#3130) 2024-02-02 19:55:07 +01:00
HugoCasa 4ce3169574 feat: ai cron (#3128) 2024-02-01 16:48:55 +01:00
0003673e8d feat: migrate s3 client to object_store (#3116)
* feat: migrate s3 client to object_store

* remove multipart from open API

* Remove multipart in favor of a single stream

* progress report

* add progress reader on server side

* small nit fix

* fix read chunk

* Fix TS and python SDK

* Fix download button

* Fix download button object viewer

* fix list

* Better errors

* export loadS3FileContent

* revert changes SDK

* fix browser

* small file list unavailable fix

* Old endpoints throws informative error messages

* Typescript SDK uses raw fetch

* update python SDK

* Error if uploaded file > 50Mb

* revert python SDL changes

* Update python SDK method docs

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
2024-02-01 16:03:30 +01:00
Ruben Fiszel ff19d35d42 fix: fix RETENTION period setting UI 2024-01-31 11:02:28 +01:00
Faton Ramadani db82b29d3b feat(frontend): handle file default value (#3095) 2024-01-29 11:41:04 +01:00
Faton Ramadani b2228c19b0 fix(frontend): Fix currency input dark mode (#3085)
* fix(frontend): Fix curreny input dark mode

* fix(frontend): collapsible alert
2024-01-26 12:18:35 +01:00
Guillaume Bouvignies ef76a90e34 fix: Better UI for S3 download and S3 TS SDK endpoints (#3065)
* Better UI for S3 download and S3 TS SDK endpoints

* gitignore typescript client node_modules

* USe Windmill BE upload endpoint for TS SDK

* Use WM backend endpoint in Python upload SDK endpoint

* revert changes

* Add expiration for Python

* Add downaload endpoint

* Add toggle for public S3 resource

* revert changes to package.json

* Add link to doc page

* fix unauthorized bug
2024-01-25 15:34:40 +01:00
Guillaume Bouvignies 326eac46fc feat: File path is option when uploading a file to S3 (#3029)
* feat: File path is option when uploading a file to S3

* Add frontend

* Fix lock

* Drag and drop file upload UI
2024-01-19 14:17:42 +01:00
Ruben Fiszel c4320556fc adapt lock to new deserializer 2024-01-18 16:11:49 +01:00
Guillaume Bouvignies daaeb83002 feat: Browse s3 bucket content from workspace settings page (#3013) 2024-01-16 18:28:46 +01:00
Faton Ramadani bd8193defe feat(frontend): add specific bun and deno icons (#3006)
* feat(frontend): add specific bun and deno icons

* feat(frontend): wip

* feat(frontend): fix icons scale and position
2024-01-16 10:48:23 +01:00
Faton RamadaniandRuben Fiszel f94149f401 feat(frontend): Operator mode (#2973)
* feat(frontend): Operator mode

* feat(frontend): Operator mode

* feat(frontend): operator menu v2

* feat(frontend): operator menu v2

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2024-01-13 13:25:37 +01:00
Faton RamadaniandRuben Fiszel 5b49aa26b9 feat(frontend): s3 file upload (#2976)
* feat(frontend): wip

* feat(frontend): s3 file working

* feat(frontend): policy

* feat(frontend): policy

* feat(frontend): wip

* feat(frontend): merge main

* feat(frontend): update s3 upload logic

* feat(frontend): wip

* feat(frontend): wip

* feat(frontend): path template

* feat(frontend): done

* feat(frontend): clean up

* feat(frontend): fix dark mode

* feat(frontend): fix outputs + add component control

* feat(frontend): fix outputs + add component control

* Update components.ts

* Update components.ts

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2024-01-13 08:35:00 +01:00
Faton Ramadani c26398bc65 feat(frontend): add shortcuts to audit logs (#2975)
* feat(frontend): add shortcuts to audit logs

* feat(frontend): simplify audit logs shortcuts
2024-01-09 15:43:13 +01:00
Henri Courdent cc1da93e05 "Author" to "Developer", Premium plans tab, Flow inputs (#2952)
* Premium plans tab & Flow inputs

* Fix build
2024-01-06 16:55:43 +01:00
Ruben Fiszel 09c675779c small UX nits 2023-12-29 03:21:11 +01:00