mirror of
https://github.com/windmill-labs/windmill.git
synced 2026-08-18 16:02:10 +00:00
c4adaeeabd
* feat: improve piptar upload with sequential background task queue Replace simultaneous piptar uploads with sequential processing via background job queue while keeping dependency installation parallelized. Key changes: - Add PiptarUpload job kind and database migration - Queue piptar uploads instead of using tokio::spawn - Implement job handler for sequential S3 uploads - Maintain parallel dependency installation as requested 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Ruben Fiszel <rubenfiszel@users.noreply.github.com> * Remove PiptarUpload job kind migration files Refactoring piptar uploads to use tokio channel instead of Windmill jobs. Migration files are no longer needed. 🤖 Generated with [Claude Code](https://claude.ai/code) Co-authored-by: Ruben Fiszel <rubenfiszel@users.noreply.github.com> * Refactor piptar uploads from Windmill jobs to tokio channel Replace the complex job queue infrastructure for piptar uploads with a simple tokio channel approach as requested. This maintains sequential upload behavior while keeping dependency installation parallel. Key changes: - Add PIPTAR_UPLOAD_CHANNEL global channel for sequential processing - Replace JobPayload::PiptarUpload with simple channel send - Remove PiptarUpload from JobKind enum and all job handling code - Remove job dispatcher case from worker.rs - Simplify upload logic while maintaining same functionality Benefits: - Reduced complexity by removing unnecessary job infrastructure - Sequential uploads without blocking dependency installation - Better separation of concerns 🤖 Generated with [Claude Code](https://claude.ai/code) Co-authored-by: Ruben Fiszel <rubenfiszel@users.noreply.github.com> * Update worker.rs * Update python_executor.rs --------- Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com> Co-authored-by: Ruben Fiszel <rubenfiszel@users.noreply.github.com> Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
Windmill Backend
This folder holds all backend components, the src/ folder only contains files used to build the "root" binary.
Components
| name | description |
|---|---|
| windmill-api | The API server, exposing functionality to other components and the frontend |
| windmill-audit | Contains audit functionality, allowing different components to record important actions |
| windmill-common | Common code shared by all crates |
| windmill-queue | Contains job & flow queuing functionality, commonly written to by the API server and read from by workers |
| windmill-worker | The worker. Used to process and execute flows & jobs. |
| parsers | Contains code to parse signatures in different langauges. |
Compile sqlx for offline ci
cargo sqlx prepare --workspace -- --bin windmill --features enterprise