09fe535bdc
fix: service logs: aggregation query + killpill on index pull + retention period for logs on s3 ( #4795 )
...
* Search across all hosts in index. killpill on index pull
* Add retention period for service logs
* Remove console log
* monitor log_file when older than biggest retention period (job / log)
* Retention period deletes service and job logs
* Add setting to monitor logs out of s3
* Prepare sqlx
* Update ee repo ref
* Prepare sqlx
* Unused variables
2024-11-27 18:57:23 +01:00
c998102cf3
simplify logic to check for license key on workers
2024-11-27 18:51:06 +01:00
2668e37574
adding sqlx migration to grant windmill permissions to db user ( #4806 )
2024-11-27 18:27:06 +01:00
c25c638bdf
add more links to operators menu
2024-11-27 17:53:45 +01:00
2911775d0a
feat(backend): store flow inner modules into flow_node table ( #4778 )
2024-11-27 16:08:31 +01:00
34609a7d8c
Fix tar prefix ( #4781 )
...
* Fix tar prefix
* Use TAR_PIP(PYTHON_311)_CACHE_DIR instead
---------
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
2024-11-27 15:54:47 +01:00
d86ea30221
enable is_simple optimization for FlowScript ( #4799 )
...
* backend: remove some allocations in `worker_flow.rs`
* feat(backend): enable `is_simple` optimization for `FlowScript`
* fix: fix node retrieval for `flowscript` inner step
2024-11-27 10:06:19 +01:00
150ca33f0d
fix: disable flow_version_lite in dedicated workers ( #4800 )
2024-11-27 10:02:44 +01:00
e876ae4f42
fix(python): Merge to site-packages packages with same name ( #4793 )
...
* (python) Initially implement merge
Iterate overall all python paths and if same folder has same name multiple times,
then merge the content and put to <job_dir>/site-packages
Solves problem with imports for some dependencies.
Default layout (/windmill/cache/):
dep==x.y.z
└── X
└── A
dep-ext==x.y.z
└── X
└── B
In this case python would be confused with finding B module.
This function will convert it to (/<job_id>):
site-packages
└── X
├── A
└── B
This way python has no problems with finding correct module
* Better error-handling
* Optimize and fix bug
* Update backend/windmill-worker/src/python_executor.rs
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Update backend/windmill-worker/src/python_executor.rs
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Polish
* Add path to PathBuf
* Add & before PathBuf
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2024-11-26 18:24:26 +01:00
2427d64aa8
nit
2024-11-25 23:32:14 +01:00
e4784e89da
feat(backend): implement flow scripts ( #4748 )
...
* feat(backend): implement flow scripts
* conditionally resolve reduced flow value
* conditionally use flow scripts based on the min worker version
* grant all to `flow_{version_lite,node}`
* do not silently discard errors
* env: add flow script feature flag
* flow script on cloud automatically
---------
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com >
2024-11-25 23:20:51 +01:00
dd5081592f
email quotas only apply to top-level job
2024-11-25 16:20:55 +01:00
e81e239f43
fix: fix getting logs locally for ee without instance settings
2024-11-25 12:02:35 +01:00
cd7385f38d
improve error message for log file not found on ee
2024-11-25 11:07:48 +01:00
1baf9d008b
chore(main): release 1.430.2 ( #4782 )
...
* chore(main): release 1.430.2
* Apply automatic changes
---------
Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com >
2024-11-25 09:42:04 +01:00
29faefe856
fix: rename job workspace as well ( #4785 )
2024-11-25 08:09:30 +01:00
39b902c118
backend: keep tracking minimal worker version ( #4786 )
...
Be sure to also track the min version of workers that have been started
after the min version variable has been set. e.g. All workers are up to
date and `MIN_VERSION_IS_AT_LEAST_1_427` is set to true, a worker is
then powered on with an anterior version, leading to a false positive
value. This commit fix that.
2024-11-25 08:08:16 +01:00
6768e5bbbd
fix: retry on inserting completed job ( #4784 )
...
* fix: retry on pushing next scheduled job of schedule
* all
* improve error handling
* update sqlx
2024-11-25 01:33:44 +01:00
5ed0ae697b
improve backoff for schedules
2024-11-24 18:48:01 +01:00
89456f502f
remove rsmq
2024-11-24 11:04:54 +01:00
278f593358
fix: retry on pushing next scheduled job of schedule
2024-11-24 08:52:51 +01:00
e4f1ac1f7c
chore(main): release 1.430.1 ( #4780 )
...
* chore(main): release 1.430.1
* Apply automatic changes
---------
Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com >
2024-11-23 08:52:59 +01:00
495d4487bc
fix: expose DISABLE_DENO_LOCK
2024-11-23 08:39:57 +01:00
c194e124da
chore(main): release 1.430.0 ( #4764 )
...
* chore(main): release 1.430.0
* Apply automatic changes
---------
Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com >
2024-11-22 16:41:12 +01:00
4facf3ca3e
feat: Add a devops role to act as a "readonly admin" ( #4775 )
...
* Prepare sqlx
* Add devops role as bool
* Add devops reloe and use it for certain endpoints
* Critical alerts: complete devops role visiblity
* Update ee repo ref
* Prepare sqlx
2024-11-22 14:55:48 +01:00
e854318f29
Update lib.rs with python-taiga import alias ( #4776 )
...
* Update lib.rs with python-taiga import alias
* Update lib.rs
---------
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com >
2024-11-21 23:18:38 +01:00
8909bea935
feat(schedule): support for extended cron syntax ( #4754 )
...
* init
* croner with fall back on scheduling failure
* adding packages
* fallback mechanism v1
* removing debug console log
* improving cargo organization
* queue cargo.toml
* use workspace cargo-tz
* test next occurrence when creating new croner schedule
* toggle label
* treat legacy edit requests where no cron_version is provided as v1
* fix edit schedule
2024-11-21 19:24:38 +01:00
b49ba59da7
fix: infer python list inner type from default if unknown inner ( #4771 )
2024-11-21 14:44:19 +01:00
99ab5471fc
indexer: Add early exit on receiving of handoff signal ( #4773 )
2024-11-21 14:44:08 +01:00
e6c7fe7027
backend: rework raw values fetching logic ( #4770 )
2024-11-21 13:59:42 +01:00
c99d360c3c
fix: garbage collect job table + delete leaked ones ( #4767 )
2024-11-21 09:02:24 +01:00
8c021f941b
fix main
2024-11-20 23:36:31 +01:00
8f198ba68c
feat: Indexer improvements: s3 backup logic reworked, settings on the frontend ( #4763 )
...
* Add settings page + common code for indexer
* Prepare sqlx
2024-11-20 22:40:36 +01:00
3f74eeb684
chore(main): release 1.429.0 ( #4761 )
...
* chore(main): release 1.429.0
* Apply automatic changes
---------
Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com >
2024-11-20 20:46:56 +01:00
45ce5ff8c6
add FORCE_HOSTNAME env var
2024-11-20 16:07:24 +01:00
6924370f11
refactor sql result formatting ( #4760 )
2024-11-20 14:53:39 +01:00
83ac5f032e
chore(main): release 1.428.1 ( #4759 )
...
* chore(main): release 1.428.1
* Apply automatic changes
---------
Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com >
2024-11-20 10:12:08 +01:00
ff7c94c5a7
fix: grant all to new job table ( #4758 )
2024-11-20 09:44:34 +01:00
b4be86c706
chore(main): release 1.428.0 ( #4749 )
...
* chore(main): release 1.428.0
* Apply automatic changes
---------
Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com >
2024-11-19 20:19:21 +01:00
f59c0c0076
fix: prevent groups to be ill-defined with non writer owners
2024-11-19 20:13:54 +01:00
b3a7cb0583
feat: pdf file preview ( #4753 )
...
also fixes s3 missing content-length header
2024-11-19 19:09:20 +01:00
aae1d763b0
nit autoscaling
2024-11-19 14:28:12 +01:00
8b38b57638
chore(deps): bump thiserror from 1.0.69 to 2.0.3 in /backend ( #4738 )
...
Bumps [thiserror](https://github.com/dtolnay/thiserror ) from 1.0.69 to 2.0.3.
- [Release notes](https://github.com/dtolnay/thiserror/releases )
- [Commits](https://github.com/dtolnay/thiserror/compare/1.0.69...2.0.3 )
---
updated-dependencies:
- dependency-name: thiserror
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-19 13:49:14 +01:00
825143db28
chore(deps): bump tower-http from 0.5.2 to 0.6.2 in /backend ( #4743 )
...
Bumps [tower-http](https://github.com/tower-rs/tower-http ) from 0.5.2 to 0.6.2.
- [Release notes](https://github.com/tower-rs/tower-http/releases )
- [Commits](https://github.com/tower-rs/tower-http/compare/tower-http-0.5.2...tower-http-0.6.2 )
---
updated-dependencies:
- dependency-name: tower-http
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-19 13:45:27 +01:00
8e8608869c
chore(main): release 1.427.0 ( #4747 )
...
* chore(main): release 1.427.0
* Apply automatic changes
---------
Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com >
2024-11-19 11:32:00 +01:00
97457a5679
feat(backend): move some static fields out of job tables ( #4689 )
...
* feat(backend): move some static fields out of job tables
* backend: re-use `flow_value` if any and avoid clone
* update minimal version to 1.427.0
2024-11-19 11:27:55 +01:00
5e975260df
chore(main): release 1.426.1 ( #4741 )
...
* chore(main): release 1.426.1
* Apply automatic changes
---------
Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com >
2024-11-19 00:30:25 +01:00
4d9ec909d1
fix: playbook files permission mode incompatible with Windows ( #4740 )
2024-11-18 22:14:19 +01:00
ee9d3e0f3e
kafka frontend nits ( #4734 )
...
* kafka frontend nits
* don't make ws triggers admin only
* update ee ref
2024-11-18 19:23:29 +01:00
46fae2a6c2
chore(main): release 1.426.0 ( #4732 )
...
* chore(main): release 1.426.0
* Apply automatic changes
---------
Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com >
2024-11-18 17:14:55 +01:00
wendrul
Ruben Fiszel
Alexander Petric
Lucas Abel
pyranota
Ruben Fiszel
Patrick Dobbs
HugoCasa
dependabot[bot]