bdf21d340f
remove dbg! leftovers ( #6842 )
...
Signed-off-by: pyranota <pyra@duck.com >
2025-10-16 17:29:57 +00:00
1fdcf7a87b
fix compile
2025-10-16 17:21:09 +00:00
4674191e90
feat: dependency job debouncing ( #6769 )
...
* v0
Signed-off-by: pyranota <pyra@duck.com >
* optimize relocks
* make it work with relative relative imports
Signed-off-by: pyranota <pyra@duck.com >
* use fallback
Signed-off-by: pyranota <pyra@duck.com >
* remove dbg and todos
Signed-off-by: pyranota <pyra@duck.com >
* future proof a bit
Signed-off-by: pyranota <pyra@duck.com >
* cleanup
Signed-off-by: pyranota <pyra@duck.com >
* more cleanup
Signed-off-by: pyranota <pyra@duck.com >
* remove final TODO
Signed-off-by: pyranota <pyra@duck.com >
* do not use bytemuck
Signed-off-by: pyranota <pyra@duck.com >
* optimize hashing
Signed-off-by: pyranota <pyra@duck.com >
* implementation 1
Signed-off-by: pyranota <pyra@duck.com >
* almost v0
Signed-off-by: pyranota <pyra@duck.com >
* v0
Signed-off-by: pyranota <pyra@duck.com >
* add comments and use fallback
Signed-off-by: pyranota <pyra@duck.com >
* call dissolve for apps
Signed-off-by: pyranota <pyra@duck.com >
* add comms
Signed-off-by: pyranota <pyra@duck.com >
* refactor v0 (partially tested + dirty)
Signed-off-by: pyranota <pyra@duck.com >
* finishing
Signed-off-by: pyranota <pyra@duck.com >
* remove TODO
Signed-off-by: pyranota <pyra@duck.com >
* Update SQLx metadata
* silence unused argument
Signed-off-by: pyranota <pyra@duck.com >
* cleanup
Signed-off-by: pyranota <pyra@duck.com >
* implement rebuild_map endpoint
Signed-off-by: pyranota <pyra@duck.com >
* update windmill api client
Signed-off-by: pyranota <pyra@duck.com >
* almost finish with tests
Signed-off-by: pyranota <pyra@duck.com >
* add proper testing
Signed-off-by: pyranota <pyra@duck.com >
* remove unused fixtures
Signed-off-by: pyranota <pyra@duck.com >
* Update SQLx metadata
* partial cleanup
Signed-off-by: pyranota <pyra@duck.com >
* Update backend/windmill-worker/src/scoped_dependency_map.rs
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Update backend/windmill-common/src/scripts.rs
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* evil doings
Signed-off-by: pyranota <pyra@duck.com >
* more cleanup
* Update SQLx metadata
* more cleanup
Signed-off-by: pyranota <pyra@duck.com >
* fixing CI
Signed-off-by: pyranota <pyra@duck.com >
* remove python from default features
Signed-off-by: pyranota <pyra@duck.com >
* feat: dependency job debouncing
* checkpoint
Signed-off-by: pyranota <pyra@duck.com >
* more improvements
Signed-off-by: pyranota <pyra@duck.com >
* refactor: clean up dependency job debouncing implementation
- Add comprehensive comments explaining the debouncing mechanism
- Replace debug statements (dbg!) with proper tracing calls
- Extract helper functions to reduce code duplication:
- extract_to_relock_from_args() for extracting nodes/components
- accumulate_debounce_stale_data() for updating stale data
- Improve code readability and maintainability
Co-authored-by: Pyra <pyranota@users.noreply.github.com >
* cleanup
Signed-off-by: pyranota <pyra@duck.com >
* Update SQLx metadata
* Update backend/windmill-common/src/jobs.rs
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Update backend/windmill-common/src/jobs.rs
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Update backend/windmill-queue/src/jobs.rs
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* better error handling for helper
Signed-off-by: pyranota <pyra@duck.com >
* update ee-ref
Signed-off-by: pyranota <pyra@duck.com >
* test: add race condition test for dependency job debouncing
- Implement test_2 for scripts to test the race condition edge case
- Add comprehensive documentation comments to all test functions
- Remove empty test_2 stubs for flows (not needed)
- Keep test_2 stub for apps with TODO comment
The race condition test simulates the scenario where a job is marked
as running but debounce_key hasn't been cleaned up yet, forcing the
system to create a new job while reusing the existing debounce_key.
This edge case can occur due to the lack of transactions in the pull
function for performance reasons (see jobs.rs:4415-4425).
Co-authored-by: Pyra <pyranota@users.noreply.github.com >
* test: implement race condition test for dependency job debouncing
- Add comprehensive test_2 for script module that tests the race condition edge case
- Remove empty test_2 stubs from flows and apps modules
- Fix unused variable warning in worker_lockfiles.rs
- Add detailed comments explaining the race condition scenario and test logic
Co-authored-by: Pyra <pyranota@users.noreply.github.com >
* implement fallback
Signed-off-by: pyranota <pyra@duck.com >
* make it mostly work
* all tests are almost working
Signed-off-by: pyranota <pyra@duck.com >
* add comments a bit
Signed-off-by: pyranota <pyra@duck.com >
* Update backend/windmill-common/src/scripts.rs
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Update backend/windmill-worker/src/worker_lockfiles.rs
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* Update backend/windmill-worker/src/worker_lockfiles.rs
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* feat: improve debouncing documentation, tracing, and error handling
- Add comprehensive 3-phase debouncing documentation explaining push/accumulation/pull
- Enhance all tracing with structured logging (job_id, workspace_id, node_count, etc.)
- Add proper error handling with .map_err() and contextual messages
- Replace dbg!() with proper tracing::debug!()
- Replace todo!() with proper error handling
- Fix typos: 'and edge case' → 'an edge case', 'bc' → 'because'
- Fix debug variable name: 'debounce_job_id_0' → 'debounce_job_id_o'
- Add documentation for debounce cleanup and stale data retrieval
- Add trace-level logging for non-error paths to reduce noise
Co-authored-by: Pyra <pyranota@users.noreply.github.com >
* do some work for future improvements
Signed-off-by: pyranota <pyra@duck.com >
* fix tests
Signed-off-by: pyranota <pyra@duck.com >
* clippy
Signed-off-by: pyranota <pyra@duck.com >
* update sqlx
Signed-off-by: pyranota <pyra@duck.com >
* clippy
Signed-off-by: pyranota <pyra@duck.com >
* update ee ref
Signed-off-by: pyranota <pyra@duck.com >
* flag tests behind the feature, add timeout
Signed-off-by: pyranota <pyra@duck.com >
* fix timeout + cleanup
Signed-off-by: pyranota <pyra@duck.com >
* cleanup
Signed-off-by: pyranota <pyra@duck.com >
* row lock debounce_key
Signed-off-by: pyranota <pyra@duck.com >
* addressing TODOs
Signed-off-by: pyranota <pyra@duck.com >
* fix test
Signed-off-by: pyranota <pyra@duck.com >
* ee ref
Signed-off-by: pyranota <pyra@duck.com >
* ee repo
Signed-off-by: pyranota <pyra@duck.com >
---------
Signed-off-by: pyranota <pyra@duck.com >
Co-authored-by: Pyra <92104930+pyranye@users.noreply.github.com >
Co-authored-by: GitHub Action <action@github.com >
Co-authored-by: windmill-internal-app[bot] <windmill-internal-app[bot]@users.noreply.github.com>
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>
Co-authored-by: Pyra <pyranota@users.noreply.github.com >
Co-authored-by: claude[bot] <41898282+claude[bot]@users.noreply.github.com>
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
2025-10-16 16:49:35 +00:00
a427feb543
fix compile
2025-10-16 16:28:04 +00:00
6c52db97ca
nit compile
2025-10-16 16:24:36 +00:00
76643ae900
fix: add configurable timeout sse stream
2025-10-16 15:29:49 +00:00
34e118c6ad
chore(main): release 1.561.0 ( #6838 )
...
* chore(main): release 1.561.0
* Apply automatic changes
---------
Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com >
2025-10-16 15:07:59 +00:00
53649c8f1f
fix(backend): revert flow node opti for ai agents ( #6840 )
...
* Revert "feat(backend): use flow nodes opti for ai agent steps (#6808 )"
This reverts commit e5ea3e4a57
2025-10-16 14:05:06 +00:00
c5acb4785d
use excluded where relevant
2025-10-16 09:19:44 +00:00
95b1dbf958
feat: ansible playbook execution git repo mode (repo viewer + UI utils) ( #6831 )
...
* Improve minio on flake.nix
* Add first asset parsing logic for ansible
* Correct html gt sign
* Decouple s3 file picker from drawer
* Factor duplicate code into snippet
* Update S3FilePickerInner to be compatible
* Fix pane shrinking issue
* Git repo viewer
* Change GitRepoViewer
* Endpoints for git repo visualizer
* Move git repo viewer to its own component
* Add button to populate git repo viewer
* Update parser yaml for new ansisble features (repo viewer)
* Reflect parser changes for ansible
* Add button to add the git repo mode of declaration for ansible
* Factor function
* Playbook + inventories into the drawer
* Add button to add inventories from s3
* Move tests to lib.rs
* Inventory loading from s3
* Move get github app token logic to be reused by ansible
* Update parser and ansible executor
* Use the correct path for inventories
* Add nushell to flake for wasm builds
* Add published parser
* Update hubPaths with clone and upload to s3
* Update ee-repo to the branch ref
* Fix npm run check
* Update cargo.lock
* Change labels on buttons
* Remove debug log
* Update ee-repo-ref
* Fix ee issues
* Update ee-repo ref
* Fix typo
* Fix ee
* Update ee-repo-ref
* Fix missing imports
* Unused var
* Fix typo
* Layout improvents
* Fix typos
* Remove unused function and log
---------
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
2025-10-16 09:08:18 +00:00
2dff7aa169
chore(main): release 1.560.0 ( #6823 )
...
* chore(main): release 1.560.0
* Apply automatic changes
---------
Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com >
2025-10-15 22:39:10 +00:00
922704ea12
fix: always create instance groups with uuid ( #6826 )
...
* fix: always create instance groups with uuid
* Update SQLx metadata
* repo ref
---------
Co-authored-by: windmill-internal-app[bot] <windmill-internal-app[bot]@users.noreply.github.com>
2025-10-15 22:30:09 +00:00
b55e7e778c
fix: fix concurrency key filter
2025-10-15 22:24:11 +00:00
08b31c00fb
error
2025-10-15 22:12:09 +00:00
e5ea3e4a57
feat(backend): use flow nodes opti for ai agent steps ( #6808 )
2025-10-14 18:06:27 +00:00
a3abb5fcd6
feat: add support for zoho oauth ( #6809 )
2025-10-14 17:32:24 +00:00
b1b15663c9
fix: bug for loop flow inconsistent state ( #6815 )
...
* fix
* Update frontend/src/lib/components/flows/content/FlowLoop.svelte
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-10-14 16:00:15 +00:00
924976b69f
chore(main): release 1.559.0 ( #6796 )
...
* chore(main): release 1.559.0
* Apply automatic changes
---------
Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com >
2025-10-14 15:27:13 +00:00
763c42aa1f
chore(mcp): display API endpoint tools in MCP URL generation ( #6811 )
...
* chore(mcp): display API endpoint tools in MCP URL generation
- Add list of 24 API endpoint tools that are always available via MCP
- Display API endpoints as green badges below scripts/flows list
- Update tooltip to mention 'scripts, flows, and API endpoints'
- Show count of available API endpoints in the UI
API endpoints include operations for variables, resources, scripts, flows,
jobs, schedules, and workers.
Co-authored-by: windmill-internal-app[bot] <windmill-internal-app[bot]@users.noreply.github.com>
* better
* nit
---------
Co-authored-by: claude[bot] <41898282+claude[bot]@users.noreply.github.com>
Co-authored-by: windmill-internal-app[bot] <windmill-internal-app[bot]@users.noreply.github.com>
2025-10-14 09:22:58 +00:00
705c7a0bf4
feat(rust): add resource types ( #5843 )
...
* feat(rust): add resource types
* write tests
* copy from go-resources
* implement frontend for rust
* update
* update cli
* update tests
* update
Signed-off-by: pyranota <pyra@duck.com >
* fix package-lock
* fix ci
* update parser
Signed-off-by: pyranota <pyra@duck.com >
* Update frontend/src/lib/components/Editor.svelte
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
---------
Signed-off-by: pyranota <pyra@duck.com >
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-10-13 19:15:44 +00:00
30e48735e5
fix: Safeguard prevents button from deleting non-fork workspaces ( #6795 )
...
* Fix: Safeguard to prevent `delete fork` button from deleting non-fork workspaces
* fix typo
* Consistent prefix
2025-10-10 18:53:30 +00:00
dd500e9247
fix: show workspace prefix to non superadmins for app deploy custom path ( #6793 )
2025-10-10 18:52:56 +00:00
7b5a02be4b
feat: add support for contextual vars in SQL ( #6791 )
2025-10-10 18:52:24 +00:00
9d85d80e45
chore(main): release 1.558.1 ( #6789 )
...
* chore(main): release 1.558.1
* Apply automatic changes
---------
Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com >
2025-10-09 21:08:10 +00:00
592c3067ed
fix: support pg jsonb array ( #6788 )
2025-10-09 21:01:43 +00:00
7e1384b050
make js expr more resilient in case where previous result is error
2025-10-09 20:59:00 +00:00
a8d3c39570
chore(main): release 1.558.0 ( #6787 )
...
* chore(main): release 1.558.0
* Apply automatic changes
---------
Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com >
2025-10-09 19:46:04 +00:00
0910ec972d
feat: allow setting custom cors header on http trigger ( #6786 )
...
* feat: allow setting custom cors header on http trigger
* preflight
* headers one by one
* perf: optimize conditional_cors_middleware by checking existing headers first
Improves performance by iterating through existing headers once and using
flags to track which CORS headers need to be inserted, avoiding unnecessary
header lookups for the common case where headers are not present
Co-authored-by: Ruben Fiszel <rubenfiszel@users.noreply.github.com >
* refactor: use not_insert flags in conditional_cors_middleware for clarity
Changed the conditional_cors_middleware logic to use not_insert_* flags
instead of needs_* flags as suggested, which better represents the intent
when iterating through existing headers first.
Co-authored-by: Alexander Petric <alpetric@users.noreply.github.com >
---------
Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>
Co-authored-by: Ruben Fiszel <rubenfiszel@users.noreply.github.com >
2025-10-09 19:41:54 +00:00
471e48b65b
feat: Database manager for Ducklake instance catalogs ( #6785 )
...
* OVERRIDE_DATA_PATH
* DB Manager for Ducklake instance catalog debugging
2025-10-09 16:28:11 +00:00
58c5e61b86
feat(backend): allow specifying powershell module versions ( #6781 )
...
* feat(backend): allow specifying powershell module versions
* fix build
* fix windows
2025-10-09 16:23:27 +00:00
ad3b898b4e
chore(main): release 1.557.0 ( #6779 )
...
* chore(main): release 1.557.0
* Apply automatic changes
---------
Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com >
2025-10-09 05:13:16 +00:00
2218b41ced
feat(flow): show tool usage in flow conversations ( #6771 )
...
* save each assitant and tool message
* fix result assistant message logic
* nit
* poll conversation messages
* styling and backend nits
* stream tools
* fix tools streaming
* cleaning
* cleaning + handle tool errors
* flag flow errors
* cleaning
* use separate manager
* cleaning
* fix refresh
* cleaning
* cleaning
* Update SQLx metadata
* fix migration
* reuse memory id + add timeout to polling
* cleaning
* no error if stream complete
* fix memory for nested agents
* fix chat enabled for nested agents
* cleaning
* Update SQLx metadata
* nit
---------
Co-authored-by: windmill-internal-app[bot] <windmill-internal-app[bot]@users.noreply.github.com>
2025-10-09 05:07:18 +00:00
cf6bdfc5ac
fix: validate that instance group exists before adding to workspace ( #6777 )
...
* fix: validate that instance group exists before adding to workspace
* Update SQLx metadata
* Update SQLx metadata
* sqlx
* ee repo ref
---------
Co-authored-by: windmill-internal-app[bot] <windmill-internal-app[bot]@users.noreply.github.com>
2025-10-08 22:29:05 +04:00
85fac0f730
chore(main): release 1.556.1 ( #6775 )
...
* chore(main): release 1.556.1
* Apply automatic changes
---------
Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com >
2025-10-08 10:25:28 +00:00
9bc296aa40
fix: better handle already completed jobs cases
2025-10-08 10:06:15 +00:00
41088354aa
chore(main): release 1.556.0 ( #6764 )
...
* chore(main): release 1.556.0
* Apply automatic changes
---------
Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com >
2025-10-08 09:54:26 +00:00
b28be41222
feat: support for protected private hub ( #6762 )
...
* feat: support for protected private hub
* nits
* nits
2025-10-08 09:33:28 +00:00
82c83ff658
feat: add dynamic skip for schedules ( #6739 )
...
* feat: add dynamic skip for schedules
* npm check
* accidental rename
* fixing tests
* Update SQLx metadata
* simplify api / queries
---------
Co-authored-by: windmill-internal-app[bot] <windmill-internal-app[bot]@users.noreply.github.com>
2025-10-08 09:18:15 +00:00
0af13254f8
fix: fix scheduling of flows with cached results based on inputs ( #6774 )
2025-10-08 09:14:13 +00:00
25c6be0961
feat: parallel loop as expr ( #6743 )
...
* ok
* revert
* backward compatible
* nits
* nits
* perf
* ok
* nits
2025-10-08 06:57:22 +00:00
ad43a718be
fix: correct otel log levels ( #6772 )
...
* fix: correct otel log levels
* oss
2025-10-08 06:47:05 +00:00
3621dea804
upgrade duckdb rs ( #6770 )
2025-10-08 06:46:50 +00:00
7e53dc2814
internal: fix flake and cli dev usage ( #6761 )
...
* fix flake
* fix cli build
* fix deno_ffi
2025-10-07 08:07:47 +00:00
963c5a5965
fix: better ducklake setup ( #6763 )
...
* stash
* Much better ducklake setup UX
* nits
* mistake
* sqlx prepare
2025-10-07 07:00:00 +00:00
c28140c6be
chore(main): release 1.555.2 ( #6758 )
...
* chore(main): release 1.555.2
* Apply automatic changes
---------
Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com >
2025-10-06 15:20:47 +00:00
48febb85d2
chore(flow): clean flow conversation code ( #6755 )
...
* use own folder for memory
* fixes
* better chat interface
* fix export tab
* move in folder
* dont show flow graph if chat mode
* fix
* fix too long title
* fix user message
* fix
* fix
* remove from server
* cleaner
* cleaning
* cleaning
* cleaning
2025-10-06 15:10:29 +00:00
8aafb63d51
Timestamp input in db manager ( #6754 )
...
* nullable by default
* unrelated nits
* native timezone input postgres
* Fix timestamptz NaiveDateTime conversion is pg_executor
* remove consolelog
2025-10-06 15:10:17 +00:00
ac1df9b798
fix(backend): use correct ai tool job dir ( #6757 )
2025-10-06 13:35:59 +00:00
dc308d0131
chore(main): release 1.555.1 ( #6752 )
...
* chore(main): release 1.555.1
* Apply automatic changes
---------
Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com >
2025-10-04 17:11:37 +00:00
12ecf1dcd1
chore(main): release 1.555.0 ( #6744 )
...
* chore(main): release 1.555.0
* Apply automatic changes
---------
Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com >
2025-10-03 17:34:09 +00:00
Pyra
Ruben Fiszel
hugocasa
wendrul
Alexander Petric
dieriba
centdix
Diego Imbert