Commit Graph
3700 Commits
Author SHA1 Message Date
Hengfei Yang 2cb55bb6b5 fix: reset stream stats with limit (#6995) 2025-06-02 16:01:43 +08:00
Sai Nikhilandoasisk 3c5ae41210 fix: add output format type for external destination(pipeline destination) (#6993)
1.This PR adds the output format to the external destination either json
/ ndjson , bydefault it is json

---------

Co-authored-by: oasisk <ashish.j.kolhe@gmail.com>
2025-06-02 11:59:49 +05:30
Sai Nikhil 2db1d49fc3 fix: log page download count issue , service account description field added (#6892)
1. This PR fixes the log page download count mismatch issue so when user
tries to get 1 to 100 records we are actually sending from as 1 which is
incorrect because BE expects from 0 so modified we now send -1 from user
input eg: user enters 1 we send it as 0 , user sends 50 send 49 this
will make sure that actual records are being downloaded
2. This PR also fixes the service account issue so we dont need first
name and last name for the service account so we removed that and added
description in place of that , removed them in the service account list
as well |
#6887
#6837
2025-06-02 11:27:52 +05:30
Hengfei Yang 4a60d6a0de fix: reset stream stats with limit (#6992) 2025-06-02 13:05:59 +08:00
Taiming LiuandSubhra264 f18c098bdb chore: porting pipeline fix to main (#6986)
Co-authored-by: Subhra264 <chakrabortysubhradeep556@gmail.com>
2025-06-01 16:14:57 -07:00
Taiming Liu 5ca894aa2b fix: pipeline next_run_at with delay (#6872) 2025-06-01 10:21:20 +08:00
udevandHengfei Yang ba6ba30d65 feat: add histogram metric for file access analysis (#6982)
This histogram metric should allow understanding the age of files
handled by querier.
Example queries
`histogram_quantile(0.95,
rate(zo_file_access_time_bucket{stream_type='logs'}[5m]))`

---------

Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
2025-05-31 21:55:06 +08:00
Omkar Kesarkhane 63d6db94fe fix: http2 streaming pagination fix (#6864) 2025-05-31 21:20:26 +08:00
Hengfei Yang 64e3d7d101 fix: update stream stats timeout (#6984) 2025-05-31 02:14:43 +08:00
Omkar Kesarkhane 3441d5455f feat: Support to pass context in O2 AI (#6978)
Support to pass context in O2 AI from logs, dashboard (add_panel) pages
2025-05-30 22:27:26 +05:30
Hengfei Yang 39a0deee33 perf: optimize stream stats calculate with limit (#6981)
This PR fixed the issue when compactor not working for a long time, it
will have millions files need to be update stream stats. it will take a
long time or time out.
2025-05-30 23:24:51 +08:00
Neha P 415816d98b test: logs-historgram-error-assertions (#6806)
- Verify error handling and no results found with histogram
- Verify error handling with histogram toggle off and on
- Verify histogram toggle persistence after multiple queries
- Verify histogram toggle with empty query
- Verify histogram toggle with complex query
2025-05-30 20:10:12 +05:30
Omkar Kesarkhane 0fb48ae80b fix: Logs UI Issues (#6796) 2025-05-30 21:50:47 +08:00
Subhra264 0ab0ea1989 fix: convert frequency interval to seconds for reports to calculate next run at (#6977)
Fixes #6918
2025-05-30 21:21:04 +08:00
Abhay PadamaniandHengfei Yang c836bf74b7 fix: return original query if not able to parse via parser (#6976)
- Parser fails to parse Data fusion functions which throws error.
- Pass original user written query if not able to parse.

Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
2025-05-30 21:20:04 +08:00
Subhra264andsai nikhil kethe 197d4b6252 feat: return ai_enabled boolean in the config api (#6971)
Co-authored-by: sai nikhil kethe <nikhil@openobserve.ai>
2025-05-30 21:18:22 +08:00
Shyam PanjiyarandHengfei Yang dc99038a32 test: Updated change organisation validation playwright (#6912)
Updated Page change organisation validation

---------

Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
2025-05-30 16:59:23 +05:30
Hengfei Yang d9fa16fd7e fix: file list dump with multiple account (#6974) 2025-05-30 18:49:37 +08:00
Hengfei Yang d37e7a9855 fix: plan error when join multiple tables (#6973) 2025-05-30 18:48:27 +08:00
ktx-akshay 4f08efd8ea fix: dashboard visualization-vrl flaky test case (#6877) 2025-05-30 15:43:34 +05:30
Hengfei Yang 34a07e55ab fix: add use_cache for traces latest api (#6970) 2025-05-30 17:23:05 +08:00
Omkar KesarkhaneandSai Nikhil 666dfcdb62 fix: Updated UI unit test setup (#6520)
Co-authored-by: Sai Nikhil <nikhil@openobserve.ai>
2025-05-30 13:21:40 +05:30
Subhra264 c8bee3ff9f fix: passcode reset for root user (#6968)
Fixes #6928 

Currently if the root user resets the ingestion passcode token, the
cache is not updated for root user, hence on refresh it still shows the
old passcode even though it is changed. As a result, the ingestion
passcode token shown on UI does not work.
2025-05-29 22:09:07 +05:30
Abhay Padamani 046d97e175 fix: NOT IN filter parsing issue for visualization (#6966)
- `NOT IN`, `Starts With` and `Ends With` filters support for
visualization.
2025-05-29 18:25:05 +05:30
Hengfei Yang 9eeb8b3ca3 fix: Query leader on super cluster always use all of the CPU (#6962)
fixed: #6960
2025-05-29 18:55:22 +08:00
Abhay Padamani 04085ffe8a feat: group trellis chart for multiple y axis (#6951)
- Group trellis series for multi Y-axis is `false`

![image](https://github.com/user-attachments/assets/69714ac7-863a-4354-940b-aaf7838a0b08)

- Group trellis series for multi Y-axis is `true`

![image](https://github.com/user-attachments/assets/aa035859-6530-4f2b-94e0-3aac250f01ea)
2025-05-29 14:28:23 +05:30
Omkar Kesarkhane f499a9a9b8 fix: Added label for duration field in traces (#6939)
Duration field was getting added to query as `duration (us)`. Added
label key in field object for displaying label
2025-05-29 13:11:35 +05:30
Siddharth d16b813ca7 refactor: Writer new method & Reader test (#6917) 2025-05-29 09:23:57 +08:00
Taiming Liu 961976f8df fix: ent build (#6957) 2025-05-28 09:43:42 -07:00
Hengfei Yang fa6454267c feat: add search scheduler (#6950)
impl #6948

- [x] When we run query, we get node list and check the node CPU, drop
at most 20% querier nodes.
- [x] When download file, we first try to download from original node(
by consistent hashing), then download from object store.
- [ ] ? should also apply this logic for ingester node ?
- [x] Fixed metrics keep increase issue of DownloadManager
2025-05-28 23:31:57 +08:00
Bhargav e4eacc1471 fix: added missing org identifier in url (#6952) 2025-05-28 18:16:24 +05:30
Sai Nikhil 980c928635 fix: show service accounts in enterprise version only (#6947) 2025-05-28 16:36:45 +05:30
Hengfei Yang 02f29edc3a fix: node list API by router (#6946) 2025-05-28 17:44:23 +08:00
Ashish Kolhe 9e37bd11f8 fix: consider global data retension (#6943) (#6945) 2025-05-28 16:36:57 +08:00
Bhargav 0e11dcbb7d fix: user list issue (#6940) 2025-05-28 12:45:09 +05:30
Shyam Panjiyar 3fbe1e17dc test: Resolved issues after Integrating organization pytest (#6942)
Resolved issues after Integrating organization pytest
2025-05-28 12:13:21 +05:30
Yashodhan JoshiandYashodhan Joshi 7540824633 fix: use _all_ in org related api call perm checks (#6920)
Fixes permission check for organization related api. In ofga when we set
a role with org perms, it sets to `org:_all_{org}` but in the check , we
check for permission on `org:{org}` which causes users with role having
permission on org, not be able to rename org. This fixes it by updating
it to correct check.

---------

Signed-off-by: Yashodhan Joshi <yjdoc2@gmail.com>
Co-authored-by: Yashodhan Joshi <yjdoc2@gmail.com>
2025-05-28 11:02:01 +05:30
Huaijinandhengfei yang b205571e1f chore: update datafusion to v46.0.0 (#6924)
Co-authored-by: hengfei yang <hengfei.yang@gmail.com>
2025-05-28 12:56:10 +08:00
Hengfei Yang 44f435028e fix: if gRPC can't start we should stop the app (#6925)
- [x] fix: if gRPC can't start we should stop the app #6874
- [x] feat: remove match_all_raw #6935
- [x] feat: node list API will return by router
2025-05-28 08:42:49 +08:00
udev 6c6fb38b77 fix: values api response total (#6934)
the values response hits always honor the size, but the total field
which indicates the count of responses is returning incorrect results.
This PR fixes it.

This PR also fixes a migration issue where the ID field were used as i64
ref: #5612
2025-05-27 22:56:58 +05:30
udev b01000f338 fix: handle stream unwrap in AI handler (#6938) 2025-05-27 20:31:08 +05:30
udev ae7623f4bb fix: do division first while calculating partitions (#6931)
We see an overflow when we multiply the query duration to a large
storage size, to fix it we divide the storage size first with the data
retention time
2025-05-27 18:46:14 +05:30
Shyam PanjiyarandSubhradeep Chakraborty 289d6234e5 test: new org created pytest (#6926)
New organizations created

---------

Co-authored-by: Subhradeep Chakraborty <chakrabortysubhradeep556@gmail.com>
2025-05-27 17:54:43 +05:30
Hengfei Yang d8349974f5 perf: use tantivy to optimize histogram & count without filter (#6930) 2025-05-27 19:46:32 +08:00
31703cc9d2 feat: o2 AI Agent (#6899)
this PR introduces o2 ai agent with this user able to ask o2 ai about
sql query , vrl query and logs

---------

Co-authored-by: Subhradeep Chakraborty <chakrabortysubhradeep556@gmail.com>
Co-authored-by: Taiming Liu <liutaiming3@gmail.com>
2025-05-27 15:09:19 +05:30
Hengfei Yang b134b6e872 fix: stream stats for super cluster (#6921)
The issue is when we get cluster list we didn't filter the alert querier
cluster then the stats duplicated. The fix in o2 enterprise. this pr
only update some logs.
2025-05-27 15:36:06 +08:00
Patrick Sullivan 9241470365 fix: Add explicit ordering to pagination in migrations (#5668) 2025-05-27 15:02:05 +08:00
Patrick Sullivan b99f6d994a fix: Migration to delete dashboards with JSON data that cannot be parsed (#5612) 2025-05-27 14:59:13 +08:00
Omkar Kesarkhaneandktx-vaidehi cbeb8af531 fix: Dashboard drilldown editor issue (#6893) (#6913)
In dashboard panel edit mode, repeatedly adding and closing a drill-down
with an SQL query causes the UI to freeze due to a memory leak in the
Quasar dialog component.

Co-authored-by: ktx-vaidehi <vaidehi.akhani@kiara.tech>
2025-05-27 11:32:44 +05:30
Ashish Kolhe de5da35d0d feat: add ndjson as output format (#6919) 2025-05-27 08:51:10 +05:30