316a2167e7
feat: postgres triggers ( #4860 )
...
* feat: init database triggers
* feat: ✨ wip: database_triggers
* feat: ✨ add database triggers front view
* feat: 🚧 database_triggers
* feat: 🚧 add definition in yaml, updated backend code and added migration
* feat: 🚧 updated migration file, update openapi.yml, updated database_triggers page and backend function
* fix: struct rust
* feat: 🚧 update migrate, database trigger backend function fixed
* feat: 🚧 add resource picker front, update backend function
* feat: 🚧 edit inner database inner, update triggers
* feat: 🚧 database_triggers
* feat: 🚧 update openapi yaml, prettied websocker trigger
* feat: 🚧 database_triggers
* feat: 🚧 add resource module, update variable file, working on main loop for database_trigger
* feat: 🐛 working sqlx query
* feat: 🚧 fix query with sqlx, added main loop
* feat: 🚧 add new column database_trigg
* feat: 🛂 run jobs works
* feat: 🚧 handling slot name and replication
* feat: restructring triggers, decoding trigger message on work
* feat: 🚧 database_trigger
* feat: 🚧
* feat: 🚧 converter done, work on custom script
* feat: 🚧 multiple trigger
* feat: 🚧 adding new argument function
* feat: 🚧 database_trigger
* feat: 🚧 add generate template for front, update script picker
* feat: 🚧 template script fix bug, work on restructing backend logic
* feat: 🚧 update autogenerated script, add persistence state for template script
* feat: 🚧 update structure client
* feat: 🚧 rewrited crud function
* feat: 🚧 added publication handler
* feat: 🚧 new ui finished
* feat: 🚧 added slot function hanlder finish front ux
* feat: ✨ ux improvement done, backend logic done
* feat: 🐛 fix where clause
* feat:
* feat:
* chore: update .sqlx and remove empty package
* fix: update publication and remove unneccessary print
* feat: finish converter to json, remove save button, remove unused crate
* feat: update migration for database trigger, fixed query, fixed frontend error with missing feature on back
* chore: update .sqlx
* chore: update sqlx
* chore: .sqlx
* chore: add unused
* fix: use right database resource in back and front
* fix build
* refactor:
* fix sqlx
* nits: retrieve all script from database trigger editor
* fix: template script object, fix route name
* merge main
* feat: rework ux
* feat/finish ux and update backend logic
* feat: database_trigger
* feat: database_trigger
* chore: update sqlx
* chore: fix ci
* nits: fix worker.rs
* feat: database_trigger
* Update frontend/src/lib/components/triggers/database/DatabaseTriggersPanel.svelte
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* feat:
* fix ci
* nits: database to postgres
* nits: fix .sqlx
* feat: add link to original code and open tab functionallity
* nits: update .sqlx
* nits: fix request type and yaml file
* nits: add abel suggestion
* fix: update .sqlx
* fix: update .sqlx
* nits: add comment to hex.rs
* nits: remove features, rename database to postgres name
* nits: replace database name by postgres
* nits: database name to postgres
* nits: update .sqlx
* nits: update .sqlx
* nit
* nit
* nits
* nit
* nits
* nits
* nits
* nits
* fix sqlx
* nits: update .vscode
---------
Co-authored-by: HugoCasa <hugo@casademont.ch >
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
2025-01-24 15:12:41 +01:00
Lucas Abel
83d24cb9ab
cache: better cache system ( #4951 )
...
* cache: consider source as untrusted
* cache: better scoped cache
* cache: non-lazy flow value parse error
* fixup! cache: consider source as untrusted
* fixup! cache: consider source as untrusted
* fixup! cache: better scoped cache
2024-12-20 11:19:57 +01:00
Lucas Abel
977ac5c3f3
feat(cache): remove persistent raw values from queue ( #4866 )
...
* feat(cache): remove persistent raw values from queue
* test: add tests and fix discovered regressions
* fix csharp executor after rebase
* invalidate script cache after locking
* fix lite flow version race
* fix flow dependencies lock race
* update version flag to `v.1.440`
2024-12-16 17:10:16 +01:00
Ruben Fiszel
c320862c51
make mail-send optional
2024-12-15 10:31:44 +01:00
Ruben Fiszel
51c0373b4c
feature gates more feature for faster compilation ( #4928 )
...
* cleanup
* cleanup
* all
* all
* all
* all
2024-12-15 00:00:37 +01:00
Ruben Fiszel
5bd0d556dd
add tls to tonic
2024-12-08 00:34:46 +01:00
Ruben Fiszel
6d047449e2
feat: add otlp support ( #4869 )
...
* all
* all
* add otel
* add otel
* update docker-image
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
2024-12-07 16:29:20 +01:00
Ruben Fiszel
b534ef6074
improve transparency for slow queries
2024-12-04 17:30:58 +01:00
Lucas Abel
3fbb2bfc8a
feat(cache): implement flow node caching ( #4808 )
...
* feat(cache): implement flow node caching
* feat(cache): implement script caching
* feat(cache): improve cache
2024-11-29 09:35:00 +01:00
Alexander Petric
8909bea935
feat(schedule): support for extended cron syntax ( #4754 )
...
* init
* croner with fall back on scheduling failure
* adding packages
* fallback mechanism v1
* removing debug console log
* improving cargo organization
* queue cargo.toml
* use workspace cargo-tz
* test next occurrence when creating new croner schedule
* toggle label
* treat legacy edit requests where no cron_version is provided as v1
* fix edit schedule
2024-11-21 19:24:38 +01:00
Lucas Abel
50ff183bae
feat(backend): monitor minimal version of living workers ( #4704 )
2024-11-14 12:33:50 +01:00
pyranota and Ruben Fiszel
c3ba832444
Annotations refactor ( #4512 )
...
* Refactor annotation system
* Move tests to different location
* Limit annotations per line (15)
* Write initial benchmark
* Optimize
* More optimizations
* Rewrite with 3x speed!
* Remove benchmarks
They were in wrong place and for development
* Polishing
* Remove unused leftover
* Integrate new annotation system
* Add comment explanation
* Remove `hashe-based matching`
Turned to be it is impure and non-deterministic method
* Add `tracing::error` for `// native` without `deno_core`
If you build backend without `deno_core` feature flag, and add //native
annotation to ts script, it would just silently exit.
This commit prints error to logs
* add more tests
* Update annotations.rs
---------
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
2024-10-17 09:14:31 +02:00
HugoCasa and Ruben Fiszel
41ff40f777
send stats when renewing key if last >24h ( #4430 )
...
* feat: send stats when renewing key if last >24h
* nits
* fix: sqlx
* nit
* renewal reason
* stats reason
* update ee ref
* Update ee-repo-ref.txt
---------
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
2024-09-30 12:23:07 +02:00
Ruben Fiszel
f189aaad5a
fix: improve suspend_first behavior and frequency
2024-09-28 15:46:50 +02:00
Ruben Fiszel
c62e152d27
feat: service logs ( #4244 )
2024-08-31 14:57:35 +02:00
Ruben Fiszel
e1223a6f24
fix: cache hub scripts in more cases + pre-cache hub scripts deps in deno
2024-08-27 02:30:54 +02:00
wendrul
200e22c026
feat: job search index backed up and loaded from s3 ( #4100 )
...
* Add fn to get logs from disk and store as string
* Update dependencies
* Add async
* Update dependecies
* Add missing async
* Move JOB_RETENTION_SECS to windmill_common
* Update ee repo ref
2024-07-23 19:35:29 +02:00
HugoCasa
79948d09bb
fix: worker memory usage ( #3845 )
2024-05-29 18:16:41 +02:00
HugoCasa
bba0091bff
fix: worker metrics ( #3837 )
...
* fix: worker metrics
* chore: sqlx
* chore: update ee ref
* fix: remove jemalloc stats unwrap
2024-05-29 01:12:00 +02:00
1f64715043
feat: local typescript codebase as bundle ( #3694 )
...
* codebases
* codebases
* foo
* foo
* foo
* foo
* fix(frontend): Disable the insert button when required fields are empty strings (#3659 )
* fix(frontend): use normal password mask for the sensitive fields of the resource editor
* handle super admins in password arg input
* chore(main): release 1.323.2 (#3660 )
* chore(main): release 1.323.2
* Apply automatic changes
---------
Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com >
* foo
* all
* s3_helpers move
* progress
* all
* progress
* progress
* progress
* progress
* codebase final
* update without ee
* sqlx
* all
* all
* all
* all
* all
* all
* all
* all
* all
* all
* all
* all
* all
* all
* all
* update
* all
* all
* all
---------
Co-authored-by: Faton Ramadani <faton.ramadani14@gmail.com >
Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com >
2024-05-09 18:35:50 +02:00
HugoCasa
cb132671d3
feat: critical error side channel ( #3625 )
...
* feat: critical error side channel
* feat: trigger workspace error handler or critical channel on schedule error handling failure
* fix: build
* feat: finish critical error side channel
* feat: channels instead of just emails + move to EE
* fix: remove superfluous func
* fix: nits + ee ref
* fix: open source build
* fix: nits
* chore: update ee ref
2024-05-02 20:21:23 +02:00
HugoCasa and Ruben Fiszel
c2d18a6d6f
feat keep sql columns ordering ( #3444 )
...
* feat: keep pg columns ordering
* feat: pass column order through flow status
* feat: sql ordering for all sql langs
* fix: sqlx build on mac + rename to _metadata
* Update JobPreview.svelte
* Update +page.svelte
* Update +page.svelte
* Update LogPanel.svelte
* Update +page.svelte
* Update LogPanel.svelte
* Update JobPreview.svelte
* fix: build
---------
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
2024-03-22 10:34:32 +01:00
Ruben Fiszel
ee961a31f0
feat: implement s3 oidc support + azure workload identity support
2024-03-08 22:51:16 +01:00
HugoCasa
9aa587c36f
feat: add ee flag to common ( #3300 )
2024-02-27 12:06:48 +01:00
Ruben Fiszel
82c8b1d1dd
chore: fasten compilation time
2024-02-24 16:29:35 +01:00
0003673e8d
feat: migrate s3 client to object_store ( #3116 )
...
* feat: migrate s3 client to object_store
* remove multipart from open API
* Remove multipart in favor of a single stream
* progress report
* add progress reader on server side
* small nit fix
* fix read chunk
* Fix TS and python SDK
* Fix download button
* Fix download button object viewer
* fix list
* Better errors
* export loadS3FileContent
* revert changes SDK
* fix browser
* small file list unavailable fix
* Old endpoints throws informative error messages
* Typescript SDK uses raw fetch
* update python SDK
* Error if uploaded file > 50Mb
* revert python SDL changes
* Update python SDK method docs
---------
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com >
2024-02-01 16:03:30 +01:00
Ruben Fiszel
ca4aac5eaa
feat: add ability to use secrets in pip requirements
2024-01-10 13:12:20 +01:00
Guillaume Bouvignies
08d24fe37b
feat: Job caching now works with S3 files ( #2934 )
2023-12-30 03:40:05 +01:00
Ruben Fiszel
353f4fcfdb
add loki as optional feature flag
2023-10-27 11:51:26 +02:00
HugoCasa
b076e093df
feat: add unique id ( #2483 )
...
* feat: add unique id
* fix: sqlx prepare
* feat: add disable option
* fix: cron schedule
2023-10-23 17:05:54 +02:00
Ruben Fiszel
79c4ee5e6f
feat: set instance settings from UI ( #2314 )
2023-09-20 23:15:19 +02:00
Ruben Fiszel
dfcdb2d8ff
feat: worker groups admin panel ( #2277 )
...
* merge
* merge
* merge
* wg
* progress
* all
* all
* all
* all
* all
* all
* fix
* fix
2023-09-13 21:24:54 +02:00
Ruben Fiszel
21e8d7694c
perf: improve queue performance ( #2222 )
...
* benchs
* progress
* prog
* progress
* progress
* progress
* update
* progress
* progress
* progress
* progress
* progress
* all
* all
* improve queries
* improve queries
* rm imv
* all
* all
2023-09-03 09:44:16 +02:00
Ruben Fiszel
69d4a23b4f
send a webhook on new user + lazy static refactor ( #1203 )
...
* supercharge
* supercharge
* progress
* progress
* display config
* display config
* display config
* display config
* fix extensions
* fix build
* disable nsjail = false for test
2023-02-15 10:59:50 +01:00
Ruben Fiszel
e0e74fbe00
remove tokio-console
2022-11-02 12:04:35 +01:00
Ruben Fiszel
bb4a620645
revert switching metrics to tiny-http
2022-10-30 01:55:44 +02:00
Kai Jellinghaus
6263e90735
restructure the entire backend layout using workspaces ( #815 )
2022-10-29 11:58:06 +02:00
Lucas Abel
Ruben Fiszel
Alexander Petric
pyranotaandRuben Fiszel
wendrul
Kai Jellinghaus