Commit Graph
2891 Commits
Author SHA1 Message Date
udev 9525aad6fe fix: grpc use native/webpki trust store (#11083) 2026-03-31 11:28:53 +05:30
ByteBaker 881cdfb03f chore: upgrade DB_SCHEMA_VERSION for new service discovery 2026-03-31 01:23:28 +05:30
ByteBaker 881a6611c0 feat: simplify service discovery feature (#10946)
## Core changes

- **Schema**: `service_streams_dimensions` table dropped entirely.
Service rows gain `disambiguation JSONB`, `set_id`, and
`field_name_mapping JSONB`. Incidents: `correlation_key VARCHAR`
replaced with `group_values JSONB`.
- **Migrations**: 6 new sea-orm DSL migrations (raw SQL strings removed
for cross-backend consistency; GIN index creation remains raw SQL — no
native sea-orm support).
- **`ServiceIdentityConfig`**: `fqn_priority_dimensions` replaced with
`distinguish_by` list. `max_total_service_rows` renamed from
`max_total_services` (unit = rows, not logical services).
- **Meta types**: `CorrelationConfidence`, `ConfidenceLevel`,
`DimensionMatchDetail` removed from `correlation.rs`.
`SemanticFieldGroup` → `FieldAlias` (fields are aliases to group IDs,
not full group descriptors).
- **Handlers**: Authorization checks added to list, correlate, and
get-config endpoints. `_grouped` endpoint removed; `_recommendations`
endpoint added.
- **Cleanup job**: Leader election added (smallest UUID ingester wins);
hardcoded 1h interval + 30-day stale threshold replace the removed
configurable env vars.
- **Processing mode removed**: Compactor-mode path removed; single
ingester-only path remains.
- **UI**: FQN priority config replaced with `distinguish_by` field
selector. New `ServiceIdentitySetup.vue` guided setup flow.
`is_scope`/`is_stable`/`normalize` toggles removed from semantic group
editor. ~13-14 FQN-related i18n keys removed from each of 12 locale
files.

## Env var changes

Removed (15):
- `O2_SERVICE_STREAMS_SAMPLE_EVERY_NTH_STREAM` → renamed (see below)
- `O2_SERVICE_STREAMS_SAMPLE_EVERY_NTH_FILE`
- `O2_SERVICE_STREAMS_RECORD_SAMPLE_PERCENT`
- `O2_SERVICE_STREAMS_STABLE_DIMENSION_THRESHOLD`
- `O2_SERVICE_STREAMS_TRANSIENT_DIMENSION_THRESHOLD`
- `O2_SERVICE_STREAMS_MAX_STREAMS_PER_SERVICE`
- `O2_SERVICE_STREAMS_MIN_CORRELATION_CONFIDENCE`
- `O2_SERVICE_STREAMS_PROCESSING_MODE`
- `O2_SERVICE_STREAMS_BATCH_MAX_SERVICES`
- `O2_SERVICE_STREAMS_CLEANUP_INTERVAL_MINS`
- `O2_SERVICE_STREAMS_STALE_THRESHOLD_HOURS`
- `O2_SERVICE_STREAMS_MAX_TOTAL_DIMENSIONS`
- `O2_SERVICE_STREAMS_MAX_TOTAL_VALUES`
- `O2_SERVICE_STREAMS_CHANNEL_CAPACITY`
- `O2_SERVICE_STREAMS_MAX_FLUSH_RETRIES`

Renamed:
- `O2_SERVICE_STREAMS_SAMPLE_EVERY_NTH_STREAM` →
`O2_SERVICE_STREAMS_SAMPLE_RATE` (default: 10)

Kept:
- `O2_SERVICE_STREAMS_ENABLED` (default: false)
- `O2_SERVICE_STREAMS_SAMPLE_WINDOW_SECS` (default: 300)
- `O2_SERVICE_STREAMS_BATCH_FLUSH_INTERVAL_SECS` (default: 600)
- `O2_SERVICE_STREAMS_MAX_TOTAL_SERVICES` (default: 500,000)

Added:
- `O2_SERVICE_STREAMS_TRACKED_ALIAS_IDS` — comma-separated alias group
IDs tracked system-wide by default; "service" always implicit

Design at: designs/correlation/proposal-v2
2026-03-30 13:47:40 +05:30
Huaijin beaeaee55b fix: report to remote not blocking (#11053) 2026-03-30 14:30:34 +08:00
Sai Nikhil 1a9837bd12 fix: pass search inspect env via config (#11051) 2026-03-30 10:25:31 +05:30
udev bac462cd38 fix: return tls client config without arc (#11055) 2026-03-30 11:54:49 +08:00
udev 1c7a3135de feat: add patch panel apis (#11025) 2026-03-28 03:15:34 +05:30
Subhra264 6a6914213d fix: Include the error field in alert/pipeline history query (#11050)
Currently the alert/pipeline history api does not include the error
field in the history query from the triggers stream. This pr fixes this.
2026-03-27 18:40:36 +05:30
a2db37e237 fix: check trigger again next week when pipeline is disabled similar to alerts (#11040)
Currently, when a pipeline is disabled, the scheduled job we don't
delete, but we check after 5mins. 5mins is too frequent to check this,
instead we should follow the same like alerts and reports that checks
again after a week.

---------

Signed-off-by: Yashodhan Joshi <yjdoc2@gmail.com>
Co-authored-by: Yashodhan Joshi <yashodhan@openobserve.ai>
Co-authored-by: Yashodhan Joshi <yjdoc2@gmail.com>
2026-03-27 17:19:43 +05:30
ByteBaker 9c245882d2 fix: anomaly status verbiage + owner issue 2026-03-25 14:15:38 +05:30
477ec39db2 feat: add support for sourcemaps for RUM (#10259)
This ads support for sourcemaps in RUM

Design at :
https://github.com/openobserve/designs/blob/main/application-monitoring/rum/sourcemap-be.md

---------

Signed-off-by: Yashodhan Joshi <yjdoc2@gmail.com>
Co-authored-by: Yashodhan Joshi <yjdoc2@gmail.com>
Co-authored-by: sai nikhil kethe <nikhil@openobserve.ai>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2026-03-24 21:18:06 +05:30
Subhra264 11e16f47eb fix: don't do unnecessary lowercasing of user emails (#10938) (#10985) 2026-03-23 10:04:53 +01:00
Subhra264 c0c0f53fec fix: don't run gc if file cur_size is 0 (#10989) 2026-03-23 10:04:18 +01:00
ByteBaker 4a6c9efdb1 chore: enable UI toggle for self-org usage reporting 2026-03-23 13:17:46 +05:30
ByteBaker f7b5bcdc91 chore: enable service graph by default, drop runtime config knobs
Remove O2_SERVICE_GRAPH_ENABLED and O2_SERVICE_GRAPH_QUERY_TIME_RANGE_MINUTES.
Service graph now runs unconditionally on enterprise ingester nodes.
Query window defaults to 60m constant; UI time range picker controls actual queries.

Also remove checks for this on the UI. Keep only enterprise level checks.
2026-03-23 12:17:53 +05:30
Huaijin 825a57eea8 fix: traces latest stream api (#10993)
- close #10986
2026-03-23 13:19:53 +08:00
vnghia 583e588fee fix: change log level from warn to debug for file deletion (#10991) 2026-03-23 12:08:34 +08:00
Franklyn Dsouza f742b19065 perf: Batch schema evolution checks in handle_otlp_request (#10947) 2026-03-22 22:35:13 +01:00
Huaijin b3a9b3c14f perf: preserve fetch when rewriter FilterExec (#10971) 2026-03-21 20:15:35 +08:00
udev d3f6a333f9 feat: summary for tool responses (#10955) 2026-03-20 18:22:22 +05:30
Hengfei Yang b6e8ce9400 fix: show fts field values (#10975) 2026-03-20 14:57:30 +08:00
36c2ef4418 feat: anamoly detection p2 (#10940)
Design at: anomaly-detection

---------

Signed-off-by: loaki07 <rustyloaki@gmail.com>
Co-authored-by: Bhargav <BJP232004@GMAIL.COM>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: claude[bot] <41898282+claude[bot]@users.noreply.github.com>
Co-authored-by: Loakesh Indiran <undefined@users.noreply.github.com>
Co-authored-by: ByteBaker <42913098+ByteBaker@users.noreply.github.com>
Co-authored-by: Shrinath Rao <shnath@openobserve.ai>
2026-03-19 21:36:06 +05:30
Hengfei Yang 99dfc8a683 refactor: unify HTTP server initialization with tracing option (#10970) 2026-03-19 16:11:59 +08:00
Hengfei Yang d88f978e48 refactor: simplify path handling in middleware and router configuration (#10960) 2026-03-18 19:53:19 +08:00
1a6a53a0ed feat: pivot table support on dashboard (#10774)
Design at:
https://github.com/openobserve/designs/tree/main/dashboards/dashboard-pivot-table-support

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: claude[bot] <41898282+claude[bot]@users.noreply.github.com>
Co-authored-by: Abhay Padamani <undefined@users.noreply.github.com>
2026-03-18 17:12:17 +05:30
Hengfei Yang f53c858035 feat: add configuration option for field values in FST logs page (#10951) 2026-03-18 17:28:19 +08:00
Hengfei Yang b50de58a97 refactor: update schema field naming and enhance metadata extraction methods (#10945) 2026-03-18 09:01:31 +08:00
Hengfei Yang fcb04b9a76 fix: node list api should working on querier (#10937) 2026-03-17 20:04:26 +08:00
Ashish Kolhe ec0dc67d5a fix: for prometheus metadata api (#10934) 2026-03-17 15:25:35 +05:30
Hengfei Yang 53668c8c1a chore: update dependencies in Cargo files (#10929) 2026-03-17 11:14:14 +05:30
Subhra264 b5b67a41aa fix: when alert does not return any result, don't make dedup fields in triggers stream true (#10914) 2026-03-17 09:04:36 +08:00
Subhra264 04de59b188 fix: do not call roles openfga api if user email is empty (#10832) 2026-03-17 09:03:03 +08:00
Hengfei Yang dafa382abb fix: handle serde_json arbitrary_precision number in VRL parse_json (#10920) 2026-03-16 21:07:35 +08:00
Subhra264 3760b55cf9 fix: multi-window dashboard should support vrl functions (#10860)
Currently dashboard with Multi-window set up does not really run the
result array vrl functions. This pr adds support for vrl function when
`/_search_multi_stream` is used. When `per_query_response` is true, and
the vrl function is result array vrl function, the function is applied
on the whole combined response (including both the time windows). The
input of the result array vrl function becomes a 2d array where each
child array represent a time window.

Otherwise, if `per_query_response` is false, or the vrl function is not
result array vrl function, then the function is applied individually on
every result of every time-window queries.
2026-03-16 13:04:28 +05:30
Hengfei Yang 5d4a909813 fix: create trigger schema (#10896) 2026-03-13 22:36:41 +08:00
udevandHarsh Mahajan 32fdd60b2d fix: assistant issues (#10893)
- **require confirmation to update_stream_settings**
- **fix: adding query param into doc**
- ** fix: partial text rendering and traces search**

---------

Co-authored-by: Harsh Mahajan <007harshmahajan@gmail.com>
2026-03-13 17:25:50 +05:30
Hengfei Yang 9e7336897e fix: extract auth for ratelimit (#10887) 2026-03-13 15:21:31 +08:00
Hengfei Yang 518761b6ca fix: add random jitter to keep-alive mechanism and delay after node registration (#10883) 2026-03-13 11:50:53 +08:00
Sai Nikhil d2861433fa fix: search inspector UI (#10749) 2026-03-13 09:57:29 +08:00
udev a1ba8b1b71 feat: Ai metering for cloud (#10824) 2026-03-13 00:57:31 +05:30
Hengfei Yang 76c4f5c423 fix: trace stream api (#10880) 2026-03-12 22:38:43 +08:00
Huaijin 49fdc1de51 fix: count optimizer in tantivy (#10878) 2026-03-12 19:06:43 +08:00
Yashodhan JoshiandYashodhan Joshi 4143973bd6 fix: add reporting for org exppiry and daily no log report (#10870)
cherry pick from #10823 

This adds two new reporting jobs for cloud
- a daily job for no ingestion in last 24 hours
- a daily job for non expired non subscribed orgs for how much of the
expiry is remaining

---------

Signed-off-by: Yashodhan Joshi <yjdoc2@gmail.com>
Co-authored-by: Yashodhan Joshi <yjdoc2@gmail.com>
2026-03-12 12:13:45 +05:30
Subhra264 31d1ad6a23 fix: Add Alert history datepicker and consider max query range set for triggers stream in the organizations (#10796) 2026-03-12 10:28:16 +08:00
Hengfei Yang b7a28e11e3 perf: improve storage read performance (#10862) 2026-03-12 10:09:09 +08:00
BhargavandYashodhan Joshi b92701b79e fix: org list auth check (#10850)
Signed-off-by: Yashodhan Joshi <yjdoc2@gmail.com>
Co-authored-by: Yashodhan Joshi <yjdoc2@gmail.com>
2026-03-11 13:53:01 +05:30
Hengfei Yang 72160a4cf5 perf: create partitions for table file_list_history based on config (#10840) 2026-03-11 13:51:41 +08:00
Subhra264andHengfei Yang 3d9369910d fix: rbac for alerts trigger api (#10834)
Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
2026-03-11 10:34:05 +08:00
Loakesh Indiran b82271f70b feat: add anomaly detection (#10538) 2026-03-11 10:25:46 +08:00
Huaijin 8212ca6f8e refactor: split the tantivy out of core (#10825)
perpare for tantivy benchmark
2026-03-10 17:16:45 +08:00