mirror of
https://github.com/windmill-labs/windmill.git
synced 2026-09-07 08:02:40 +00:00
Extract the MSSQL s3 ingest+upload logging pattern into a reusable `s3_stream_and_upload_with_logs` helper and apply it to the PostgreSQL, MySQL, OracleDB, BigQuery, and Snowflake executors. Each s3 streamed query now emits periodic progress lines, an ingest-done line, and an upload+transcode-done line to the job output, matching MSSQL. `convert_json_line_stream` now returns `BoxStream<'static, _>` so the output stream can be forwarded to `s3.upload` from inside the generic helper without lifetime gymnastics; the two existing callers already boxed the result, so behavior is unchanged. Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Windmill Backend
This folder holds all backend components, the src/ folder only contains files used to build the "root" binary.
Components
| name | description |
|---|---|
| windmill-api | The API server, exposing functionality to other components and the frontend |
| windmill-audit | Contains audit functionality, allowing different components to record important actions |
| windmill-common | Common code shared by all crates |
| windmill-queue | Contains job & flow queuing functionality, commonly written to by the API server and read from by workers |
| windmill-worker | The worker. Used to process and execute flows & jobs. |
| parsers | Contains code to parse signatures in different langauges. |
Compile sqlx for offline ci
cargo sqlx prepare --workspace -- --bin windmill --features enterprise