Commit Graph
1582 Commits
Author SHA1 Message Date
Sai Nikhilandoasisk 3c5ae41210 fix: add output format type for external destination(pipeline destination) (#6993)
1.This PR adds the output format to the external destination either json
/ ndjson , bydefault it is json

---------

Co-authored-by: oasisk <ashish.j.kolhe@gmail.com>
2025-06-02 11:59:49 +05:30
Sai Nikhil 2db1d49fc3 fix: log page download count issue , service account description field added (#6892)
1. This PR fixes the log page download count mismatch issue so when user
tries to get 1 to 100 records we are actually sending from as 1 which is
incorrect because BE expects from 0 so modified we now send -1 from user
input eg: user enters 1 we send it as 0 , user sends 50 send 49 this
will make sure that actual records are being downloaded
2. This PR also fixes the service account issue so we dont need first
name and last name for the service account so we removed that and added
description in place of that , removed them in the service account list
as well |
#6887
#6837
2025-06-02 11:27:52 +05:30
Omkar Kesarkhane 63d6db94fe fix: http2 streaming pagination fix (#6864) 2025-05-31 21:20:26 +08:00
Omkar Kesarkhane 3441d5455f feat: Support to pass context in O2 AI (#6978)
Support to pass context in O2 AI from logs, dashboard (add_panel) pages
2025-05-30 22:27:26 +05:30
Omkar Kesarkhane 0fb48ae80b fix: Logs UI Issues (#6796) 2025-05-30 21:50:47 +08:00
Abhay PadamaniandHengfei Yang c836bf74b7 fix: return original query if not able to parse via parser (#6976)
- Parser fails to parse Data fusion functions which throws error.
- Pass original user written query if not able to parse.

Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
2025-05-30 21:20:04 +08:00
Subhra264andsai nikhil kethe 197d4b6252 feat: return ai_enabled boolean in the config api (#6971)
Co-authored-by: sai nikhil kethe <nikhil@openobserve.ai>
2025-05-30 21:18:22 +08:00
Omkar KesarkhaneandSai Nikhil 666dfcdb62 fix: Updated UI unit test setup (#6520)
Co-authored-by: Sai Nikhil <nikhil@openobserve.ai>
2025-05-30 13:21:40 +05:30
Abhay Padamani 046d97e175 fix: NOT IN filter parsing issue for visualization (#6966)
- `NOT IN`, `Starts With` and `Ends With` filters support for
visualization.
2025-05-29 18:25:05 +05:30
Abhay Padamani 04085ffe8a feat: group trellis chart for multiple y axis (#6951)
- Group trellis series for multi Y-axis is `false`

![image](https://github.com/user-attachments/assets/69714ac7-863a-4354-940b-aaf7838a0b08)

- Group trellis series for multi Y-axis is `true`

![image](https://github.com/user-attachments/assets/aa035859-6530-4f2b-94e0-3aac250f01ea)
2025-05-29 14:28:23 +05:30
Omkar Kesarkhane f499a9a9b8 fix: Added label for duration field in traces (#6939)
Duration field was getting added to query as `duration (us)`. Added
label key in field object for displaying label
2025-05-29 13:11:35 +05:30
Bhargav e4eacc1471 fix: added missing org identifier in url (#6952) 2025-05-28 18:16:24 +05:30
Sai Nikhil 980c928635 fix: show service accounts in enterprise version only (#6947) 2025-05-28 16:36:45 +05:30
Bhargav 0e11dcbb7d fix: user list issue (#6940) 2025-05-28 12:45:09 +05:30
Hengfei Yang 44f435028e fix: if gRPC can't start we should stop the app (#6925)
- [x] fix: if gRPC can't start we should stop the app #6874
- [x] feat: remove match_all_raw #6935
- [x] feat: node list API will return by router
2025-05-28 08:42:49 +08:00
31703cc9d2 feat: o2 AI Agent (#6899)
this PR introduces o2 ai agent with this user able to ask o2 ai about
sql query , vrl query and logs

---------

Co-authored-by: Subhradeep Chakraborty <chakrabortysubhradeep556@gmail.com>
Co-authored-by: Taiming Liu <liutaiming3@gmail.com>
2025-05-27 15:09:19 +05:30
Omkar Kesarkhaneandktx-vaidehi cbeb8af531 fix: Dashboard drilldown editor issue (#6893) (#6913)
In dashboard panel edit mode, repeatedly adding and closing a drill-down
with an SQL query causes the UI to freeze due to a memory leak in the
Quasar dialog component.

Co-authored-by: ktx-vaidehi <vaidehi.akhani@kiara.tech>
2025-05-27 11:32:44 +05:30
Ashish Kolhe de5da35d0d feat: add ndjson as output format (#6919) 2025-05-27 08:51:10 +05:30
Abhay Padamani 9c57a6edc9 feat: axis value support for drilldown (#6894)
- `series.__axisValue` variable support to pass axis value for
drilldown.


![image](https://github.com/user-attachments/assets/24fdee9a-9098-4d5c-a08e-cd23ff3894a6)


![image](https://github.com/user-attachments/assets/38dea00a-20f7-4dc6-84e8-0c79835c9dfe)
2025-05-26 11:54:23 +05:30
+2 0d9f47966b feat: Organization revamp (#5579)
Fixes #5131 
Addresses #5408 

### Revamp
- Created a new table to store organizations in the `organizations`
table. Earlier, we never stored organizations in any table, rather we
used to store the organizations in the meta table as part of the `user`
json.
- The users and organization membership relations are now moved to its
own separate tables - `users` and `org_users`.

### New changes

**API changes** -
- `/organizations` - `POST` api to create an org and save it in the meta
table. In non-enterprise version, currently only the root user can
create the org. For enterprise version with rbac enabled, anyone with
`CREATE` access for organizations can create the organization and
becomes an admin. Root user can always create an organization.
- `/{org_id}/rename` - `PUT` api to rename the existing org. Only root
user and the admins of the org can access this API.

The payload for following APIs are changed -
- `POST api/{org_id}/roles` - `{"name":"new_role"}` is changed to
`{"role":"new_role"}
- `POST api/{org_id}/users/{user}` -
`{"role":"viewer","custom_role":["role_name"]}` is the new payload where
`custom_role` is optional and is array of custom roles (only works in
enterprise with rbac enabled) which will be assigned to the user. The
value of `role` can be standard role or as well as any custom role (when
it is custom role, the standard role assigned to the user is decided
based on the enterprise env variable - `O2_DEX_DEFAULT_ROLE`).
- `POST api/{org_id}/users`- the payload -
```
{"email":"user@user.com","role":"viewer","custom_role":["create_org_permission"],"password":"12345678", "first_name": "", "last_name":""}
```

- `PUT api//{org_id}/users/{email_id}` the payload -
```
{"first_name":"Hello","last_name":"j","role":"viewer","isExternal":false,"change_password":false,"password":"","custom_role":["create_org_permission"]}
```


A new ENV variable is introduced - `ZO_CREATE_ORG_THROUGH_INGESTION`
(default `false`) which if true, an org will automatically created when
ingesting data to a new org. If false, user can not create org by
ingesting data to new org, they need to first call the `POST
/organizations` API.

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

**New Features**
- Added a `cloud` feature for enhanced organizational management
capabilities.
- Introduced new methods for managing organizational users and
asynchronous message processing.
- Enhanced user invitation and membership features, including improved
role handling.
- Implemented configurable ingestion URL support across various
components.
- Added new functionality for user management and organization handling
in the super cluster architecture.

**Improvements**
- Refined user authentication and authorization processes, including
error handling.
- Updated database schema to support multi-organization architecture.
- Enhanced pagination settings and UI components for better user
experience.
- Improved handling of organization names and user roles in
notifications and alerts.
- Streamlined service account token management with visibility
enhancements.
- Enhanced the `AddUpdateOrganization` component with improved user
input handling and validation.
- Updated the `AppOrganizations` component to dynamically load the
appropriate organization management interface.
- Improved the `ServiceAccountsList` component with updated pagination
options and token handling logic.

**Bug Fixes**
- Resolved issues with user role assignments and organization management
inconsistencies.
- Corrected routing and navigation logic for login and logout processes.
- Addressed various error handling scenarios in user and organization
processes.
- Fixed issues with the visibility of service account options in the
`EditGroup` and `EditRole` components based on the cloud configuration.

**Breaking Changes**
- Significant restructuring of user and organization data models.
- Changes to authentication workflows and configuration handling.
- Removal of certain components related to user and organization
management.
- Updated the logic for determining the ingestion URL across various
components.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Signed-off-by: Yashodhan Joshi <yjdoc2@gmail.com>
Co-authored-by: Bhargav <BJP232004@GMAIL.COM>
Co-authored-by: Taiming Liu <liutaiming3@gmail.com>
Co-authored-by: hengfei yang <hengfei.yang@gmail.com>
Co-authored-by: harshiv-7 <harshiv@openobserve.ai>
Co-authored-by: Huaijin <haohuaijin@gmail.com>
Co-authored-by: Zhao.wei <weizhao029@gmail.com>
Co-authored-by: ShyamOOAI <shyam@openobserve.ai>
Co-authored-by: oasisk <ashish.j.kolhe@gmail.com>
Co-authored-by: sai nikhil kethe <nikhil@openobserve.ai>
Co-authored-by: Yashodhan Joshi <yashodhan@openobserve.ai>
Co-authored-by: Yashodhan Joshi <yjdoc2@gmail.com>
2025-05-25 21:53:55 -07:00
Abhay Padamaniandktx-akshay c87a7b7a90 fix: pass query as single line for partition and search API call (#6815)
- #6816

---------

Co-authored-by: ktx-akshay <akshay.patil@kiara.tech>
2025-05-23 10:46:48 +05:30
367ddcd821 feat: streaming aggr support for http (#6854)
Co-authored-by: sai nikhil kethe <nikhil@openobserve.ai>
Co-authored-by: omkark06 <omkar@zinclabs.io>
2025-05-22 11:49:54 +05:30
ktx-vaidehi 3a6f16a5d4 fix: dashboard go to logs vrl issue (#6862) 2025-05-21 14:53:14 +05:30
udev da2a769762 feat: Add HTTP2 Streaming support (#6721) (#6827) 2025-05-20 00:06:05 +08:00
Sai Nikhil 2d00c6e9b7 fix: pipeline list show cron expression if enabled (#6808)
if cron is enabled for scheduled pipeline then it should it be shown in
the listing page
and it should show cron column as true 
This PR fixes #6809
2025-05-15 11:34:58 +05:30
Abhay Padamaniandktx-akshay 7d6b828646 fix: dashboard panel error msg automation issue (#6787)
Co-authored-by: ktx-akshay <akshay.patil@kiara.tech>
2025-05-12 17:47:28 +05:30
ktx-vaidehi b824dacce1 fix: dashboard annotations api response for some charts (#6769) 2025-05-09 16:48:34 +05:30
Subhra264andsai nikhil kethe 330cf14ec0 fix: ZO_DEFAULT_MAX_QUERY_RANGE_DAYS env should be returned by streams list api (#6762)
Fixes #6753

---------

Co-authored-by: sai nikhil kethe <nikhil@openobserve.ai>
2025-05-09 14:22:58 +05:30
Omkar Kesarkhane 5e9db8c3f3 fix: Stack Overflow when updating log search results (#6706) 2025-05-08 18:28:47 +05:30
Sai Nikhil ea866c0475 fix: highlight syntax in logs page (#6647)
1. This PR reintroduces the highlighting the particular keywords that
are there in the match_all or fuzzy_match_all conditions
2025-05-08 10:00:52 +05:30
Bhargav 45e3014707 fix: added error message code for cancelled search query (#6748) 2025-05-07 17:04:43 +05:30
Sai Nikhilandktx-abhay 1d0ec690fa fix: search field not found issue (#6745)
1. this PR fixes not showing what is the search field that was not found
in both logs page and dashbaords panel
2. alert list pagination fix

---------

Co-authored-by: ktx-abhay <abhay.padamani@kiara.tech>
2025-05-07 14:14:24 +05:30
ktx-akshay dbd6c1017b test(dashboard): add geomap and map test cases (#6722) 2025-05-06 19:14:13 +05:30
Abhay Padamaniandloaki07 e9243ac4e6 fix: encode search query if ZO_UI_SQL_BASE64_ENABLED=true (#6556)
- #6515

---------

Co-authored-by: loaki07 <rustyloaki@gmail.com>
2025-05-06 13:03:31 +05:30
Abhay Padamani bc0b7dcebb fix: loading indicator while loading folders, dashboard or tabs in drilldown pop up (#6720)
- #6718
2025-05-05 15:39:58 +05:30
ktx-vaidehi 9f0f478544 fix: dashboard match_all operator (#6711) 2025-05-02 18:10:02 +05:30
dependabot[bot] 1e95857433 chore(deps-dev): bump vite from 6.2.6 to 6.3.4 in /web (#6695) 2025-05-02 15:08:55 +08:00
Abhay Padamani 84c506ef17 fix: cancel running queries on logs visualization toggle (#6685)
- #6686
2025-04-30 14:17:31 +05:30
bff9364ac7 feat: add EventProgress server event (#6668)
- [x] add `percent` calc, based on the query duration

---------

Co-authored-by: ktx-vaidehi <vaidehi.akhani@kiara.tech>
Co-authored-by: omkark06 <omkar@zinclabs.io>
Co-authored-by: Kirtan Thakkar <kirtan@kiara.tech>
2025-04-29 17:38:58 +05:30
Sai Nikhil 7cdc675506 fix: changed the start time of explore of enrichment table from 1min to 1sec (#6652)
1. this PR fixes the issue of #6645
2025-04-27 08:22:22 +05:30
Sai Nikhil c503eb4881 fix: node list UI issues (#6651)
1. This PR fixes the minor issues that are there in node list UI 
2. --> when the node is offline or prepare state then the border to the
particular is not shown
3. --> change header of TCP to TCP Connections in table
2025-04-26 11:24:25 +05:30
ktx-vaidehi ee4bd26065 fix: dashboard table wrap in reports (#6650) 2025-04-25 23:19:49 +05:30
e89423ca49 fix: cherry-pick rc7 fixes (#6649)
- [x] fix: `tokio_tungstenite` max msg limit config
- [x] honor user cancel in ui (logs, dashboards) if
`should_client_retry` is `true`, and is in loop.
- [x] fix: `values` event to send `cancel` response if search query
cancelled
- [x] handle `values` event error in ui

---------

Co-authored-by: omkark06 <omkar@zinclabs.io>
Co-authored-by: udev <uddhav@openobserve.ai>
2025-04-25 22:01:31 +05:30
Abhay Padamani baa3579739 fix: track canceled search and do not retry if search is canceled (#6643) 2025-04-25 15:40:00 +05:30
Taiming Liuandsai nikhil kethe c19b649da1 feat: delay for scheduled pipelines (#6616)
Co-authored-by: sai nikhil kethe <nikhil@openobserve.ai>
2025-04-24 22:30:34 -07:00
Ashish KolheandBhargav c1172e10fc fix: default histogram enabled (#6636)
Co-authored-by: Bhargav <BJP232004@GMAIL.COM>
2025-04-24 18:35:01 +05:30
Sai Nikhil d2190eef68 fix: indexing for the nodelist UI should be done in FE (#6633)
1. This PR fixes the issue that sometimes BE may return id's in non
sorting manner which is used in FE so now we are making the indexing in
the FE so that it will always be in sorted manner
2.it was handled in both normal cluster and super cluster as well
2025-04-24 16:35:59 +05:30
Sai Nikhil aa10d42e01 fix: removed console logs from logs page (#6625)
this PR removes the console logs that were added during WITH query
development
2025-04-24 07:12:51 +05:30
Omkar Kesarkhane 6dcb24a4f3 fix: Traces UI Issues (#6606) 2025-04-23 08:59:08 +05:30
Sai Nikhil 5373f210dd fix: import dest , alert issues (#6612)
fixes the issue of #6611
2025-04-23 05:49:00 +05:30