7de98c0df4
feat: add OTel metrics support ( #8442 )
...
* [ee] feat: add OTel metrics support
Add OpenTelemetry metrics export for Windmill operational metrics.
When the OTel metrics toggle is enabled in instance settings (EE),
Windmill exports 16 metrics to any OTLP-compatible collector, letting
users observe queue depths, worker execution, DB pool state, and health
without a separate Prometheus setup.
Changes:
- otel_oss.rs: no-op stubs for OSS builds
- monitor.rs: queue count/running count gauges, zombie counters, DB pool
monitoring (shared single DB query and loop with Prometheus)
- worker.rs: execution count/duration, worker busy, pull duration
- jobs.rs: queue push/delete/pull counters
- health.rs: DB latency gauge
- main.rs: call monitor_pool_otel unconditionally
- InstanceSetting.svelte: enable metrics toggle for EE licenses
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
* chore: update ee-repo-ref.txt for OTel metrics
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
* feat: add worker_started, worker_uptime, health_status, health_db_unresponsive OTel metrics
Wire up 5 additional metrics to reach parity with Prometheus:
- worker_execution_failed: wired in add_completed_job_error (was defined but unused)
- worker.started: incremented on worker startup
- worker.uptime: recorded each loop iteration
- health.status: phase gauge (healthy/degraded/unhealthy)
- health.db_unresponsive: flag (0/1)
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
* chore: update ee-repo-ref.txt
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
* chore: update ee-repo-ref to fbe68e4aa621e30378995cfd328a6ccf74176614
This commit updates the EE repository reference after PR #469 was merged in windmill-ee-private.
Previous ee-repo-ref: 6fa1881aafdfb60f4abf11a37f01f6fedaecb3ec
New ee-repo-ref: fbe68e4aa621e30378995cfd328a6ccf74176614
Automated by sync-ee-ref workflow.
* fix: remove duplicate cfg attr and duplicate OTel pool reporting
- Remove duplicate #[cfg(feature = "prometheus")] on monitor_pool
- Remove OTel block from monitor_pool; monitor_pool_otel is the sole
OTel reporter, eliminating duplicate windmill.db.pool.* metrics in
EE builds
- Simplify monitor_pool back to its original Prometheus-only structure
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
---------
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
Co-authored-by: windmill-internal-app[bot] <windmill-internal-app[bot]@users.noreply.github.com>
2026-03-19 08:10:37 +00:00
..
2026-03-17 01:50:16 +00:00
2026-03-05 18:11:40 +01:00
2026-03-11 00:10:29 +00:00
2026-03-05 18:11:40 +01:00
2025-11-24 17:39:35 +00:00
2026-03-18 08:15:04 +00:00
2026-03-17 20:14:02 +00:00
2026-03-17 12:48:59 +00:00
2026-03-05 18:11:40 +01:00
2025-09-11 07:57:01 +00:00
2026-03-18 08:15:04 +00:00
2026-03-13 08:21:15 +00:00
2026-03-17 01:20:09 +00:00
2026-03-17 01:20:09 +00:00
2026-03-17 16:02:54 +00:00
2026-03-17 12:49:25 +00:00
2026-01-08 06:29:49 +00:00
2026-03-16 12:07:45 +00:00
2025-10-22 15:56:36 +00:00
2026-02-04 09:28:01 +00:00
2026-03-05 18:11:40 +01:00
2026-03-10 12:38:43 +00:00
2026-03-05 18:11:40 +01:00
2026-02-26 14:03:46 +00:00
2026-03-17 01:20:09 +00:00
2026-02-26 14:03:46 +00:00
2026-03-18 12:50:50 +00:00
2026-03-18 12:50:50 +00:00
2026-03-17 01:20:09 +00:00
2026-03-10 05:22:12 +00:00
2026-03-05 18:11:40 +01:00
2026-03-18 12:03:01 +00:00
2026-03-17 12:48:59 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2026-01-13 16:33:32 +00:00
2026-03-13 20:31:06 +00:00
2026-03-05 18:11:40 +01:00
2026-02-26 14:03:46 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2026-03-16 15:30:59 +00:00
2026-02-18 16:33:54 +00:00
2026-02-03 17:20:35 +00:00
2026-02-10 16:27:48 +00:00
2026-02-10 16:27:48 +00:00
2026-03-16 14:10:29 +00:00
2026-03-05 18:11:40 +01:00
2026-03-16 14:10:29 +00:00
2026-03-05 18:11:40 +01:00
2025-12-08 16:42:35 +00:00
2026-03-05 18:11:40 +01:00
2025-10-30 06:47:26 +00:00
2025-10-22 15:56:36 +00:00
2026-02-25 15:06:12 +00:00
2025-06-29 22:46:27 +00:00
2025-12-23 15:26:23 +00:00
2025-10-28 17:52:04 +00:00
2025-12-04 22:09:25 +00:00
2026-02-12 09:50:01 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2026-02-16 15:52:02 +00:00
2026-02-15 15:53:03 +00:00
2025-12-04 22:09:25 +00:00
2025-10-22 15:56:36 +00:00
2026-03-07 19:51:38 +01:00
2026-03-05 18:11:40 +01:00
2026-02-05 13:48:32 +00:00
2026-02-12 09:50:01 +00:00
2026-02-02 10:09:40 +00:00
2025-06-27 15:26:03 +00:00
2026-03-05 18:11:40 +01:00
2026-03-10 18:25:09 +00:00
2025-10-22 15:56:36 +00:00
2025-12-19 20:33:03 +00:00
2026-02-26 14:02:11 +00:00
2026-02-23 17:53:09 +00:00
2026-02-12 09:50:01 +00:00
2025-10-28 11:36:05 +00:00
2025-10-28 11:36:05 +00:00
2026-03-05 18:11:40 +01:00
2025-10-22 15:56:36 +00:00
2025-10-27 15:49:27 +00:00
2026-03-13 05:48:20 +00:00
2026-03-07 19:51:38 +01:00
2026-03-05 18:11:40 +01:00
2026-03-07 19:51:38 +01:00
2025-07-11 09:56:53 +00:00
2026-03-04 10:46:34 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2026-02-04 18:48:51 +00:00
2026-02-04 18:48:51 +00:00
2026-03-04 10:46:34 +00:00
2026-03-04 10:46:34 +00:00
2026-01-22 16:20:01 +00:00
2026-02-28 09:11:00 +00:00
2026-01-28 13:56:35 +00:00
2026-03-05 18:11:40 +01:00
2025-12-16 21:16:42 +00:00
2026-02-11 19:29:44 +00:00
2026-02-20 16:28:40 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2025-12-04 22:09:25 +00:00
2025-12-01 11:18:37 +00:00
2025-10-29 21:03:12 +00:00
2026-02-12 09:50:01 +00:00
2026-02-26 14:02:11 +00:00
2026-02-25 12:05:22 +00:00
2026-03-05 18:11:40 +01:00
2026-03-17 01:20:09 +00:00
2025-07-07 10:27:09 +00:00
2026-01-15 10:12:28 +00:00
2026-03-11 22:42:15 +00:00
2026-02-19 09:33:33 +00:00
2026-02-03 17:20:35 +00:00
2025-10-22 15:56:36 +00:00
2025-10-22 15:56:36 +00:00
2026-02-23 17:53:09 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2026-03-04 10:53:01 +00:00
2025-11-21 13:01:33 +00:00
2026-03-04 10:46:34 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2026-03-19 06:35:02 +00:00
2026-03-19 06:23:38 +00:00
2026-03-17 01:20:09 +00:00
2025-10-22 15:56:36 +00:00
2026-02-12 18:20:22 +00:00
2026-02-12 09:50:01 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 06:19:51 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2026-02-24 06:37:55 +00:00
2026-03-05 06:19:51 +00:00
2026-03-17 20:14:33 +00:00
2025-09-29 07:34:38 +00:00
2025-08-19 02:12:57 +00:00
2026-03-05 18:11:40 +01:00
2026-01-15 10:12:28 +00:00
2025-12-08 19:08:14 +01:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2026-03-10 10:13:26 +00:00
2026-03-05 18:11:40 +01:00
2026-02-03 17:20:35 +00:00
2026-02-03 17:20:35 +00:00
2026-02-24 19:55:20 +00:00
2026-03-05 18:11:40 +01:00
2025-11-04 19:13:09 +00:00
2025-10-22 15:56:36 +00:00
2026-03-05 18:11:40 +01:00
2026-03-16 12:06:18 +00:00
2026-02-09 18:13:18 +00:00
2026-03-05 18:11:40 +01:00
2026-03-17 01:20:09 +00:00
2026-02-03 17:20:35 +00:00
2025-09-19 17:32:09 +00:00
2025-10-22 15:56:36 +00:00
2025-12-08 16:42:35 +00:00
2026-03-05 18:11:40 +01:00
2025-12-04 22:09:25 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2025-10-22 15:56:36 +00:00
2026-02-18 11:06:04 +00:00
2026-03-05 18:11:40 +01:00
2026-01-29 22:31:49 +00:00
2025-11-19 21:25:57 +00:00
2025-10-22 15:56:36 +00:00
2025-12-12 22:53:21 +00:00
2025-10-22 15:56:36 +00:00
2025-10-22 15:56:36 +00:00
2025-10-17 13:58:00 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2025-10-22 15:56:36 +00:00
2025-11-28 16:00:11 +00:00
2025-10-22 15:56:36 +00:00
2026-02-23 17:53:09 +00:00
2026-03-18 12:50:50 +00:00
2025-12-04 22:09:25 +00:00
2025-11-29 01:23:47 +00:00
2026-02-24 06:37:55 +00:00
2026-03-05 18:11:40 +01:00
2026-01-21 19:38:28 +00:00
2026-02-12 09:50:01 +00:00
2026-03-05 18:11:40 +01:00
2026-02-23 15:59:39 +00:00
2026-03-05 18:11:40 +01:00
2026-03-17 01:19:46 +00:00
2026-03-05 18:11:40 +01:00
2026-03-19 08:10:37 +00:00
2026-03-17 20:14:02 +00:00
2026-03-17 15:26:04 +00:00
2026-02-12 09:50:01 +00:00
2026-03-05 18:11:40 +01:00
2026-01-08 06:24:23 +00:00
2025-10-22 15:56:36 +00:00
2026-02-03 17:20:35 +00:00
2026-03-17 01:20:09 +00:00
2025-07-19 06:59:49 +00:00
2026-01-20 13:38:02 +00:00
2026-02-03 17:20:35 +00:00
2025-12-20 15:43:44 +02:00
2025-12-26 23:21:42 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2025-12-04 22:09:25 +00:00
2025-10-22 15:56:36 +00:00
2026-03-05 18:11:40 +01:00
2026-02-13 00:00:36 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2025-10-22 15:56:36 +00:00
2025-12-04 22:09:25 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2025-10-21 15:28:52 +00:00
2026-03-05 18:11:40 +01:00
2026-01-13 15:20:06 +00:00
2025-11-04 19:13:09 +00:00
2025-10-22 15:56:36 +00:00
2026-03-05 18:11:40 +01:00
2025-08-19 02:12:57 +00:00
2026-03-05 18:11:40 +01:00
2025-12-27 12:35:19 +00:00
2026-02-17 12:48:58 +00:00
2026-02-17 12:48:58 +00:00
2026-02-12 09:50:01 +00:00
2026-02-10 16:49:25 +00:00
2026-03-17 01:20:09 +00:00
2026-02-11 06:27:21 +00:00
2026-03-07 19:51:38 +01:00
2026-03-07 19:51:38 +01:00
2026-03-10 17:58:37 +00:00
2026-02-25 15:06:12 +00:00
2026-02-12 09:50:01 +00:00
2025-12-04 22:09:25 +00:00
2026-02-12 09:50:01 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2026-02-10 16:49:25 +00:00
2026-03-05 18:11:40 +01:00
2025-12-19 20:33:03 +00:00
2025-10-22 15:56:36 +00:00
2026-02-17 16:32:25 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2026-02-12 09:50:01 +00:00
2026-03-05 18:11:40 +01:00
2025-08-30 02:32:35 +00:00
2026-03-05 18:11:40 +01:00
2026-02-19 09:33:33 +00:00
2025-12-04 22:09:25 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2025-11-24 19:43:14 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2025-08-19 22:09:01 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2025-08-31 16:19:04 +00:00
2026-03-05 18:11:40 +01:00
2025-10-22 15:56:36 +00:00
2025-06-30 00:07:35 +00:00
2025-08-06 22:40:42 +00:00
2026-02-23 17:53:09 +00:00
2026-01-20 18:30:52 +00:00
2026-02-23 17:53:09 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2025-12-08 16:42:35 +00:00
2026-03-11 17:52:26 +00:00
2025-10-22 15:56:36 +00:00
2026-03-05 06:19:51 +00:00
2026-03-19 05:49:44 +00:00
2026-03-05 18:11:40 +01:00
2026-03-03 12:37:37 +00:00
2026-01-22 15:55:18 +00:00
2026-03-05 18:11:40 +01:00
2026-02-03 17:20:35 +00:00
2026-03-05 18:11:40 +01:00
2025-11-29 01:23:47 +00:00
2025-05-28 10:19:31 +02:00
2026-03-05 18:11:40 +01:00
2026-03-16 14:10:29 +00:00
2026-02-19 09:33:33 +00:00
2026-02-03 17:20:35 +00:00
2026-03-17 01:20:09 +00:00
2026-03-17 01:20:09 +00:00
2026-03-19 06:23:38 +00:00
2025-11-24 21:41:05 +00:00
2026-03-05 18:11:40 +01:00
2025-10-23 17:16:42 +00:00
2025-10-22 15:56:36 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2026-02-09 18:22:22 +00:00
2026-03-10 05:22:12 +00:00
2025-10-22 15:56:36 +00:00
2026-03-05 18:11:40 +01:00
2025-07-29 19:28:54 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2026-02-19 09:33:33 +00:00
2026-02-28 07:01:23 +00:00
2026-02-04 18:48:51 +00:00
2025-10-27 14:29:53 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2026-02-23 17:42:50 +00:00
2026-03-05 18:11:40 +01:00
2026-03-13 08:21:15 +00:00
2026-03-17 01:19:46 +00:00
2026-03-05 18:11:40 +01:00
2025-06-28 20:13:55 +02:00
2026-02-23 17:53:09 +00:00
2025-12-04 22:09:25 +00:00
2025-12-04 22:09:25 +00:00
2026-03-10 18:25:09 +00:00
2026-03-07 21:41:14 +00:00
2026-03-05 18:11:40 +01:00
2026-01-22 15:55:18 +00:00
2026-03-09 19:39:24 +00:00
2026-03-05 18:11:40 +01:00
2026-02-05 14:00:15 +00:00
2026-03-05 18:11:40 +01:00
2025-06-12 15:44:35 +02:00
2025-10-29 21:03:12 +00:00
2026-02-28 08:52:10 +00:00
2026-02-28 08:52:10 +00:00
2026-02-16 15:52:02 +00:00
2026-03-05 18:11:40 +01:00
2026-03-05 18:11:40 +01:00
2026-02-05 13:45:09 +00:00
2026-02-19 09:33:33 +00:00
2026-03-05 18:11:40 +01:00
2025-12-27 12:35:19 +00:00
2026-02-09 00:23:42 +00:00
2026-03-05 18:11:40 +01:00
2026-02-15 16:32:38 +00:00
2026-03-17 17:04:18 +00:00
2025-06-17 18:24:30 +02:00
2026-02-28 08:52:10 +00:00
2026-01-19 19:14:18 +00:00
2026-01-19 19:14:18 +00:00
2026-03-18 12:50:50 +00:00
2026-03-16 15:37:28 +00:00
2025-11-28 16:00:11 +00:00
2026-02-25 12:05:22 +00:00
2025-12-23 18:19:30 +00:00
2026-03-05 18:11:40 +01:00