Commit Graph
3037 Commits
Author SHA1 Message Date
Shyam Panjiyar 340fec113c test: Deleting logo Management to execute from Open Source (#5682)
Deleting logo Management to execute from enterprise

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Removed Features**
	- Removed logo management test suite and associated page objects
- Eliminated methods for updating custom logo text and uploading logos
in management page

- **Impact**
- Logo management testing functionality has been completely removed from
the test suite
	- No current capability to test logo-related operations

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-13 17:43:36 +05:30
Sai Nikhil 70db08e257 fix: changing pipeline org in edit mode (#5681)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
  - Enhanced route navigation logic for pipeline editing.
- Added confirmation dialog for unsaved changes when leaving pipeline
edit view.

- **Bug Fixes**
  - Prevented access to pipeline edit view without a valid pipeline ID.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-13 16:34:46 +05:30
Sai Nikhil 4be182a536 fix: pipeine redirection issue resolved (#5678)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

fix for #5677

## Summary by CodeRabbit

- **New Features**
- Enhanced pipeline navigation by including organization identifier when
routing to pipeline editor

- **Improvements**
- Removed hardcoded pipeline names, suggesting a move towards more
dynamic data handling
- Improved routing logic to pass organization context between components

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-13 14:03:22 +05:30
Abhay Padamani 7dbc1e12b2 fix: dashboard move to another folder issue (#5676)
- #5675 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced dashboard folder selection by adding active folder context to
the selection dropdown for importing from JSON files, URLs, and JSON
strings.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-13 11:57:40 +05:30
Huaijin e81d8da46a fix: union all with order by (#5674) v0.14.1-rc3 2025-01-13 12:11:18 +08:00
Zhao.wei 1a5350f62b feat: improve trace max query range (#5613) 2025-01-12 17:51:18 +08:00
Hengfei Yang 445a50ddde fix: metrics Mismatch between schema and batches (#5673) 2025-01-12 15:13:00 +08:00
Huaijin 36de81c437 feat: impl join right table only match once (#5661) 2025-01-11 11:57:57 +08:00
Hengfei Yang 44b5daf949 feat: add limit for uds (#5669) 2025-01-11 09:59:59 +08:00
Patrick SullivanandTaiming Liu 500c53295c feat: New MoveAlert endpoint (#5626)
Adds a new endpoint for moving an alert between different folders.

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
	- Added ability to move alerts between folders.
	- Introduced new endpoint for moving alerts.
- Enhanced alert management with improved validation and error handling.

- **Bug Fixes**
	- Improved alert retrieval to include folder context.

- **Documentation**
	- Updated OpenAPI documentation to include new alert movement endpoint.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Taiming Liu <liutaiming3@gmail.com>
2025-01-10 11:18:54 -06:00
Subhra264 fe9eaa1f0e fix: move dashboard rbac ownership (#5671)
When we move a dashboard from one folder to another, currently the rbac
relations are not updated, so the folder still points to the old folder
as `parent` in the ofga `tuple` database.

This PR fixes this issue by updating the `parent` relationship between
the dashboard and the old and new folders.

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Enhanced dashboard management with improved access control integration
- Added support for setting and removing parent relations for dashboards
using OpenFGA system

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-10 22:14:52 +05:30
Neha P 2bf8bb3720 test: add test function pytest cases (#5667)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Tests**
	- Added comprehensive test cases for API function creation
- Included tests for invalid payloads, text-only inputs, and special
character scenarios
	- Verified successful function creation with valid payloads

- **Chores**
- Updated `.gitignore` to exclude temporary directories, configuration
files, and build artifacts

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-10 19:17:47 +05:30
Ashish Kolhe 7a9a2c52eb fix: migration failing without specifying fetch order (#5665)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Chores**
	- Enhanced database migration script to improve record processing order
	- Added logging for KSUID generation during migration process
	- Updated import statements to support query ordering functionality

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-10 18:01:45 +05:30
Hengfei Yang 2c7f4dff53 fix: aws ingestion (#5660) 2025-01-10 18:53:44 +08:00
Huaijin 46cc4cb880 feat: search job return total result (#5663)
- [x] for search job, in `total` field, will return the total records
numbers.
- [x] if not set the from and size when get result, we set default from
= 0 and size = 100
2025-01-10 18:03:24 +08:00
ktx-vaidehi d9e9717435 fix: dashboard stacked chart with variables throwing error (#5657)
- #5658 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Bug Fixes**
- Improved error handling in SQL query parsing to prevent unexpected
crashes
    - Updated internal logic for processing dashboard data sources

- **Refactor**
- Enhanced SQL utility functions to provide more robust data conversion
mechanisms

The changes focus on improving the reliability and error management of
dashboard and query-related functionality.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
v0.14.1-rc2
2025-01-10 12:31:07 +05:30
Shyam Panjiyar 6d50fe4f9f test: Updated Logo Management Page Playwright (#5650)
Updated Logo Management Page 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
	- Added a new page object for logo management in UI testing.
	- Introduced functionality to generate random logo names.
	- Enhanced logo upload and management test capabilities.

- **Tests**
	- Updated logo management test suite with more robust interactions.
	- Improved test navigation and logo management workflows.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-10 11:52:54 +05:30
Huaijin 3c3d9a46e8 feat: retention for search jobs (#5655)
close #5645 

## New Env
```
ZO_SEARCH_JOB_RETENTION
```

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

## Release Notes

- **New Features**
  - Added configurable search job retention setting
  - Implemented job retention management for search jobs

- **Enterprise Features**
  - Enhanced job deletion mechanism based on retention period
  - Added ability to automatically clean up older search jobs

- **Configuration**
- New option to specify how long search jobs are kept (default: 30 days)

These updates improve system management and provide more control over
job lifecycle, particularly for enterprise users.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-10 10:10:41 +05:30
Patrick Sullivan c2ccf4a3a1 fix: Fix new UpdateAlert endpoint (#5652) 2025-01-09 21:42:56 -06:00
Patrick Sullivan 0383959603 fix: Mirgration to use KSUIDs instead of auto-incrementing integers as PKs (#5651)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **Database Migration**
- Transitioned database tables to use KSUIDs (K-Sortable Unique
Identifiers) as primary keys.
- Recreated `folders`, `dashboards`, and `alerts` tables with a new
identifier system.
- Updated `id` and `folder_id` fields in `alerts`, `dashboards`, and
`folders` tables from numeric to string types.
- Ensured unique identifiers are generated upon creation of new folders
and dashboards.
	- Preserved existing data during the migration process.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-09 21:05:18 -06:00
Taiming Liu 9927d2e4a7 fix: add a distributed lock for database migration (#5653) 2025-01-09 17:52:51 -08:00
Patrick Sullivan 8cdf9aff3b fix: Fix UpdateAlert v2 endpoint (#5647)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Bug Fixes**
	- Improved alert update and enablement process
	- Enhanced transactional handling for alert state changes

- **Refactor**
- Updated alert management logic to provide more robust state
transitions

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-09 14:50:33 -06:00
Hengfei Yang a686ec6927 fix: metrics ingestion with otlp json (#5649) 2025-01-10 00:22:36 +08:00
Omkar Kesarkhane 24551266b1 fix: fixed x-axis type for trellis chart (#5641)
#5638 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **Bug Fixes**
	- Improved error handling in dashboard configuration.
	- Enhanced x-axis type configuration for trellis layouts.
- Refined chart configuration to handle scenarios with no series data
more gracefully.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-09 20:12:33 +05:30
Huaijin 43b7bad404 feat: add pagination for search job result (#5640)
- [x] list status order by createdat desc
- [x] add pagination for search job result
```
curl --request GET \
  --url 'http://localhost:5080/api/default/search_jobs/bL3PkaKBp9maA6DpJ8Z/result?from=10&size=30' 
```
2025-01-09 17:41:40 +08:00
Hengfei Yang 3baaf1a8c2 fix: mmdb client error after update asn file (#5636) 2025-01-09 16:18:23 +08:00
Shyam Panjiyar 78306b7083 test: service accounts PyTest (#5625)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **Tests**
	- Added comprehensive end-to-end tests for service account management.
- Implemented tests for retrieving, creating, updating, refreshing, and
deleting service accounts.
- Included validation for handling invalid email formats during service
account creation.
- Ensured proper validation of API responses and status codes for
service account operations.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-09 12:54:44 +05:30
Omkar Kesarkhane 4ad642ad99 fix: Bar Chart not rendering as expected when breakdown is present (#5624)
#5597 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **Bug Fixes**
- Improved label retrieval process to handle cases with undefined axis
keys.
  - Enhanced series generation logic for bar and horizontal bar charts.

These updates ensure a more reliable experience when processing chart
configurations in the dashboard.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-09 12:07:56 +05:30
Hengfei Yang f4a7388aae feat: add option for extra default index fields (#5631) 2025-01-09 12:47:18 +08:00
Taiming Liu fa96ae2c6d fix: pipeline migration name (#5611)
fix: #5608
2025-01-08 18:01:47 -08:00
Hengfei Yang 5e449ce63c feat: add option for compact old data (#5615) 2025-01-09 08:53:21 +08:00
Shyam Panjiyar 895c0642c0 test: Have added negative test cases for new folders (#5586)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **Tests**
- Added comprehensive test cases for dashboard and alerts folder
functionalities.
	- Introduced tests for unauthorized access scenarios.
	- Added error handling tests for invalid inputs and folder IDs.
- Improved test coverage for various edge cases, including responses for
empty and invalid folder IDs.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-08 21:51:58 +05:30
Ashish Kolhe d6fc3fe53c fix: panic when mmdb download is disabled (#5623)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Enhanced configuration handling for enterprise geographic IP
enrichment when the enterprise feature is enabled.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-08 18:51:16 +05:30
Ashish Kolhe b4999c7f65 fix: restrict service accounts login to web (#5621)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Security Enhancement**
	- Added validation to prevent service accounts from logging in
- Implemented additional authentication checks during user login process

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-08 18:04:38 +05:30
Ashish Kolhe 92b75075c7 fix: allow geo lite db with enterprise mmdb (#5620)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **Refactor**
- Simplified the Maxmind database download and client initialization
process.
	- Streamlined logic for handling file downloads and client updates.
- Removed unnecessary conditional checks, enhancing the overall flow of
operations.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-08 17:12:37 +05:30
Omkar Kesarkhane 6a114d65ba fix: added notification on cancelling query (#5619)
#5617 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Bug Fixes**
- Improved search operation cancellation by adding user notifications
when a search is canceled.

- **User Experience**
- Enhanced feedback mechanisms for search and histogram query
cancellations.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-08 15:42:13 +05:30
Huaijin d7dd9128b7 feat: support limit join's right side (#5616)
related #5602

## New env
```
ZO_FEATURE_JOIN_RIGHT_SIDE_MAX_ROWS=0
```
default is 0, means disable
2025-01-08 15:40:13 +08:00
Hengfei Yang 3be0d3eda3 ci: add more debug tools (#5601) 2025-01-07 12:09:48 +08:00
ktx-vaidehi 472a78e74e fix: dashboard maps data based on map json data (#5596)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Data Updates**
	- Enhanced country list with new entries and abbreviated names
- Refined country name representations for improved clarity and
consistency
	- Updated list of countries with more standardized naming conventions

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-06 18:30:31 +05:30
Huaijin 1a27d16e1e feat: batch read data to avoid metrics OOM (#5584) v0.14.1-rc1 2025-01-06 20:11:56 +08:00
Sai Nikhil ca3e7b706a fix: only 1 source node is allowed while creating / editing pipeline (#5593) 2025-01-06 19:11:45 +08:00
Sai Nikhil fc79499043 fix: Stream settings page design issues (#5595)
This PR fixes some minor issues related to design of stream settings
page
1. reduced some spacing in add fields popup and also maintained styling
of add fields button same as whole application
2. time at the top to be splitted to start and end time for better
readability

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **UI/UX Improvements**
	- Refined styling for stream field inputs and schema components
	- Updated button and div styling for better visual presentation
	- Added labels for start and end times to improve clarity
	- Adjusted layout and spacing of components for enhanced readability

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-06 16:21:30 +05:30
Subhra264 0e0b19034d fix: return error if old dashboard delete fails in move dashboard (#5594)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Bug Fixes**
    - Enhanced error handling for dashboard movement operations
- Improved error reporting when deleting dashboards from old folders
during move operations

- **New Features**
    - Added more detailed error tracking for dashboard-related actions

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-06 13:42:22 +05:30
Subhra264 a95c37e729 fix: GET dashboard RBAC issue (#5592)
Currently the RBAC does not work with GET /dashboard api. With this pr,
it should work now.

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
	- Enhanced dashboard request authorization handling
- Improved request authentication logic for dashboard-related GET
requests
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-06 12:39:55 +05:30
Ashish Kolhe 8cbb6f223e feat: add minimum allowed refresh interval (#5590)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **New Features**
	- Added a new configuration option for minimum auto-refresh interval.
- Expanded configuration response to include minimum auto-refresh
interval setting.

- **Improvements**
- Enhanced configuration capabilities for controlling automatic refresh
frequency.
- Corrected type for result cache discard duration to ensure it is
treated as a numeric value.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-06 11:59:56 +05:30
Huaijin ad54320f09 feat: add search job partition result and cache (#5585) 2025-01-06 12:32:51 +08:00
Sai Nikhil 73663fb0a3 feat: Feat/extended retention days (#5539)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced date-time selection component with new props for visibility
and functionality.
	- Added a tabbed interface for schema settings and extended retention.
- Introduced new date retention management options with improved
validation and user interaction.
- Improved localization with new confirmation and date-related messages.

- **Bug Fixes**
	- Refined date selection logic and validation.
	- Added user confirmation for date deletion.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-06 09:44:47 +05:30
Hengfei Yanganddomyway 39c44de0e5 fix: debug the RUM deadlock (#5558)
for debug the #5398

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **Configuration**
  - Added new configuration option to disable keep-alive connections
  - Adjusted HTTP server connection timeout settings

- **Authentication**
  - Enhanced token validation with improved traceability
- Updated authentication methods to support more detailed request
tracking

- **Performance**
  - Optimized client lock management in MaxMind database downloader
  - Refined request handling in RUM ingestion APIs

- **Logging**
  - Improved logging for authentication and request processing
  - Added trace ID support for better request tracking
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: domyway <weizhao029@gmail.com>
2025-01-06 10:58:08 +08:00
iQQBot ae0f8feba7 fix: dup attributes in link and event (#5583) 2025-01-04 21:52:10 +08:00
Zhao.wei 1ec9471aa3 feat: restrict max hours service account (#5574) 2025-01-04 21:23:05 +08:00