Commit Graph
261 Commits
Author SHA1 Message Date
Bhargav 74c9aa6236 fix: fix automation changes (#5763)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Tests**
- Enhanced UI testing for visualization page by improving index field
search interactions
- Updated test case to verify data display and input field manipulation
after page refresh

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-21 20:38:55 +05:30
Neha P 311153e89e test: selected-duration-results (#5756)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced a method to set log date and time filters to the current
day.
- Enhanced log query testing with improved date and time selection
functionality.

- **Tests**
	- Updated test suites to incorporate the new log date filtering method.
- Added test cases for verifying log results based on selected date and
time settings.

- **Refactor**
- Improved test code organization by introducing a dedicated `LogsPage`
class.
	- Streamlined log interaction methods in test scripts.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-21 18:07:20 +05:30
Shyam Panjiyar aa96a8a1e5 test: New alerts endpoints PyTest (#5630)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **Tests**
- Added comprehensive end-to-end (E2E) tests for the alert management
API.
- Implemented tests for retrieving alerts, creating new alerts,
enabling/disabling alerts, triggering alerts, and deleting alerts.
- Included validation checks and response status code assertions for all
API functionalities.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-20 17:31:34 +05:30
Neha P 59c61f268c test: enrichment-pipeline-test (#5731)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **Tests**
- Updated test cases for pipeline creation and action handling with
corrected boolean value casing.
	- Added new test case to validate pipeline creation failure scenario.
- Enhanced UI testing for enrichment table functionality by adding
date-time button interaction and visibility checks.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-17 16:27:15 +05:30
Neha P fd084dd7f0 test: e2e-enrichment-test (#5697)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **Tests**
- Re-enabled previously skipped test for uploading enrichment table with
VRL.
- Added new test case to verify error handling when CSV file is not
provided during enrichment table upload.
	
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-14 20:46:10 +05:30
Shyam Panjiyar 340fec113c test: Deleting logo Management to execute from Open Source (#5682)
Deleting logo Management to execute from enterprise

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Removed Features**
	- Removed logo management test suite and associated page objects
- Eliminated methods for updating custom logo text and uploading logos
in management page

- **Impact**
- Logo management testing functionality has been completely removed from
the test suite
	- No current capability to test logo-related operations

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-13 17:43:36 +05:30
Neha P 2bf8bb3720 test: add test function pytest cases (#5667)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Tests**
	- Added comprehensive test cases for API function creation
- Included tests for invalid payloads, text-only inputs, and special
character scenarios
	- Verified successful function creation with valid payloads

- **Chores**
- Updated `.gitignore` to exclude temporary directories, configuration
files, and build artifacts

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-10 19:17:47 +05:30
Shyam Panjiyar 6d50fe4f9f test: Updated Logo Management Page Playwright (#5650)
Updated Logo Management Page 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
	- Added a new page object for logo management in UI testing.
	- Introduced functionality to generate random logo names.
	- Enhanced logo upload and management test capabilities.

- **Tests**
	- Updated logo management test suite with more robust interactions.
	- Improved test navigation and logo management workflows.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-10 11:52:54 +05:30
Hengfei Yang a686ec6927 fix: metrics ingestion with otlp json (#5649) 2025-01-10 00:22:36 +08:00
Shyam Panjiyar 78306b7083 test: service accounts PyTest (#5625)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **Tests**
	- Added comprehensive end-to-end tests for service account management.
- Implemented tests for retrieving, creating, updating, refreshing, and
deleting service accounts.
- Included validation for handling invalid email formats during service
account creation.
- Ensured proper validation of API responses and status codes for
service account operations.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-09 12:54:44 +05:30
Shyam Panjiyar 895c0642c0 test: Have added negative test cases for new folders (#5586)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **Tests**
- Added comprehensive test cases for dashboard and alerts folder
functionalities.
	- Introduced tests for unauthorized access scenarios.
	- Added error handling tests for invalid inputs and folder IDs.
- Improved test coverage for various edge cases, including responses for
empty and invalid folder IDs.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-08 21:51:58 +05:30
Shyam Panjiyar dd25a1da66 test: New Folders API test cases in PyTest (#5570)
New Folders API test cases 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **Tests**
- Added comprehensive API testing for dashboard and alert
functionalities.
- Implemented test cases for retrieving, creating, updating, and
deleting dashboard and alert folders.
- Ensured proper response status code validation for various API
operations.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2025-01-04 00:27:49 +05:30
c32c9dac7b feat: functions UI design revamp (#5549)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Added a new function testing capability for VRL (Variable Runtime
Language) functions.
- Introduced interactive UI components for testing and managing
functions, including `FunctionsToolbar`, `TestFunction`, and
`FullViewContainer`.
  - New API endpoint for testing VRL functions against a set of events.
  - Added new localization strings for user interface elements.

- **Improvements**
- Refined UI components for better user experience, including sidebar
management and editor functionalities.
- Enhanced function management with improved error handling and
validation.
- Improved code structure and maintainability across multiple
components.

- **Bug Fixes**
  - Addressed various minor formatting and syntax issues.
  - Improved error handling in function testing and management.

- **Enhancements**
- Updated the `QueryEditor` component for improved formatting and error
diagnostics.
- Enhanced Playwright tests for better targeting and reliability in
function management scenarios.
- Improved layout and responsiveness of several components, including
`AssociateFunction` and `ScheduledAlert`.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: udev <uddhavdave1@gmail.com>
Co-authored-by: udev <uddhav@openobserve.ai>
2025-01-03 15:24:59 +05:30
Shyam Panjiyar f003d32308 test: join automation updated (#5416)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
	- Added a quick mode toggle button on the Logs Page.
- Introduced new methods for validating log displays and error messages.
- New test cases to verify the functionality of toggling quick mode and
interacting with interesting fields.

- **Bug Fixes**
- Enhanced test scenarios to ensure correct display of streams and count
queries during log searches.
	- Improved verification of results after executing queries.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-31 11:16:42 +05:30
Shyam Panjiyar f1d7a0de9a test: Updated for report automation with playwright (#5401)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced multiple new test cases for creating and deleting reports,
enhancing the testing coverage for report functionalities.

- **Tests**
- Added specific tests for various report scheduling options, including
"Now" and "Later" types.
- Updated existing test case for creating, using, and deleting
dashboards and reports to include detailed method calls for report
creation.

- **Chores**
- Added several new asynchronous methods to streamline the report
creation and scheduling process, improving interaction robustness.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-30 14:32:44 +05:30
Patrick Sullivan c89b715119 feat: Alerts API v2 - part 2 - rename methods (#5470)
#5253 

Part 2 in a series of PRs to add new Alerts endpoints that support
parent folders and KSUIDs

This PR just renames various methods

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Introduced new alert management structures and request/response bodies
for creating, updating, and listing alerts.
	- Added unique identifier support for alerts.
- **Bug Fixes**
	- Enhanced error handling for alert creation and updates.
- **Documentation**
- Updated OpenAPI documentation to include new alert-related request and
response types.
- **Refactor**
- Renamed functions for clarity in alert management, including retrieval
and deletion by name.
- **Tests**
- Updated integration tests to reflect changes in alert deletion
methods.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-27 08:28:26 -06:00
Shyam Panjiyar 9ebf7c677c test: PyTest organizations Updated (#5465)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Bug Fixes**
- Improved clarity in passcode-related tests by renaming variables and
updating assertion messages.
	- Enhanced specificity in testing passcode responses and updates.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-26 14:19:33 +05:30
Shyam Panjiyar 593b1ea787 test: added PyTest for reset passcode (#5461)
added PyTest for reset passcode 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Tests**
- Added a new end-to-end test for the passcode reset functionality,
ensuring successful operation and response validation.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-26 12:51:57 +05:30
Huaijin 1bceeef0a8 feat: support cross stream type join (#5452)
close #5420 

- [x] set tantivy index as default index
- [x] support cross stream type join like below
```
select t1.ip, t2.name from logs.t1 as t1 join enrich.t2 as t1 on t1.ip = t2.ip
```

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **New Features**
- Introduced a new `TableReferenceExt` module to enhance SQL-related
functionalities.
	- Added a new `StreamTypeProvider` struct for managing table providers.
- **Improvements**
	- Updated configuration defaults for inverted index formats.
- Enhanced handling of stream names and types throughout various
functions for better type safety.
	- Improved logging with structured stream information.
- Refined the processing of the `MatchAll` condition in SQL-like
expressions.
- **Bug Fixes**
- Expanded string matching for `StreamType` to accommodate additional
input formats.
- **Documentation**
	- Retained help comments for context on configuration fields.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-25 21:46:05 +08:00
Neha P 8e6e968997 test: add fuzzy and values UI test (#5435)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced a new test suite for end-to-end testing of fuzzy matching
SQL queries.
- Added new test cases for verifying API data display and error message
handling in the UI.

- **Bug Fixes**
- Improved reliability of existing tests by enhancing visibility checks
before UI interactions.

- **Tests**
- Added helper functions for dynamic timestamp generation and SQL query
posting in the testing framework.
- Updated existing tests to streamline processes and improve interaction
logic.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-24 14:37:33 +05:30
BhargavandHengfei Yang aaa2db6732 feat: additional values for index size and docs count added (#5423)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Added labels for "Index Size", "Docs Count", "Function", "Pipeline",
"Pipelines & Functions", "Alerts", and "Dashboards" in the home section.
- Enhanced the home view to display additional metrics: Index Size,
Document Count, Dashboard Count, and Pipelines alongside existing data.
- Introduced new summaries for pipelines, alerts, and dashboards in
organizational data.

- **Bug Fixes**
- Improved layout and styling for better data presentation in the home
view.
- Updated validation logic for the home page to reflect new label
changes.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
2024-12-23 13:45:44 +05:30
Patrick Sullivan 386906f6a7 feat: Migrate alerts data out of meta table into alerts table (#5390)
#5253 

The overall goal of this PR is to migrate alerts data out of `meta`
table into `alerts` table. To accomplish this three main changes are
made. Unfortunately, all three of these changes need to be synchronized
and submitted in the same PR.

1. A new migration script is added to
- Parse alerts JSON currently stored in the `meta` table into Rust
models for alerts. These Rust models are isolated to the migration
script since they represent the schema of alerts as they are stored in
the `meta` table before this migration executes.
    - Convert those Rust models into Sea ORM entities for alerts.
- Insert all the Sea ORM entities for alerts into the new `alerts`
table.
2. Create get/put/delete/list methods for accessing the data in the
`alerts` table
    - These functions use SeaORM to query and update the database.
- These functions must also convert between SeaORM alert entities and
the application's current data model for alerts (as defined in
`config::meta::alerts`.
- It's entirely expected that the models inside `config::meta::alerts`
will change over time. When this happens in the future, developers will
need to update the transformation functions between SeaORM alert
entities and the models in `config::meta::alerts`. Luckily, the compiler
should help to direct developers to where these transformation functions
need to be updated.
3. Update the old logic in `/src/service/db/alerts.rs` that previously
read and wrote alerts to the `meta` table so that it now reads and
writes alerts to the `alerts` table.
- The methods for accessing the `meta` table included logic for
triggering "cache update events" to the cluster coordinator and for
sending events to the super cluster queue. Since the new logic accesses
the `alerts` table rather than the `meta` table, this logic for emitting
events had to be reproduced.


<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced a new `ListAlertsParams` struct for flexible querying of
alerts.
  - Enhanced `TriggerCondition` struct with new timing parameters.
- Added new error variants for improved error handling in alert
management.
- Created a comprehensive alert management system with CRUD operations.
- Added integration tests for various functionalities related to alerts
and dashboards.
- Introduced a new `Alerts` variant in the `FolderType` enum for better
folder management.

- **Bug Fixes**
  - Improved error handling for folder deletion when alerts are present.

- **Documentation**
- Updated documentation for several functions to clarify their scope and
functionality.

- **Chores**
  - Added new dependencies to support additional functionality.
  - Introduced migration scripts for database schema changes.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-20 20:17:58 -06:00
Hengfei Yang 8f6c5e8312 fix: add limit for full text search field must by text (#5422) 2024-12-20 19:47:20 +08:00
ktx-vaidehiandKirtan Thakkar 5c2857ff86 feat: on click of refresh button or apply button only apply variables (#5077)
- #4885 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced refresh button functionality in dashboard panels, providing
visual feedback when variable data changes.
- Introduced a new utility function to check if variables are fully
loaded before updates.
- Added computed properties and event emissions to improve user
interaction and responsiveness to variable updates.
- Improved error handling and logging in dashboard components for better
user visibility.
- Introduced new methods for handling user interactions in variable
selection components.

- **Bug Fixes**
- Improved test case flows for dashboard settings and variable settings,
ensuring smoother interactions in automated tests.

- **Documentation**
- Updated tooltips and button states for better user guidance regarding
variable changes.

- **Chores**
- Streamlined test cases by removing redundant steps, enhancing clarity
and efficiency.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Kirtan Thakkar <kirtan@kiara.tech>
2024-12-19 23:57:48 +05:30
Abhay Padamani e0cc7c0ed6 fix: metrics page changes (#5409)
- #5193 


![image](https://github.com/user-attachments/assets/cd6f4a46-11e7-4e1e-b38a-b1c6bd58286f)



<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Summary by CodeRabbit

- **New Features**
	- Introduced PromQL mode handling in the dashboard panel.
- Enhanced metrics page layout with new components:
DateTimePickerDashboard, AutoRefreshInterval, ChartSelection,
CustomHTMLEditor, CustomMarkdownEditor, DashboardQueryBuilder,
DashboardErrorsComponent, PanelSchemaRenderer, PanelSidebar,
RelativeTime, and QueryInspector.
	- Added localization support for metrics in the search context.

- **Bug Fixes**
- Improved error handling for loading stream fields and validating panel
configurations.
- Stream type selection visibility now adapts based on dashboard panel
data type.
- Enhanced user interaction by simulating keyboard input for
organization selection.
	- Reduced validation requirements for the metrics page.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-19 18:46:47 +05:30
Neha P eecafe12ac test: pipeline updated assertions (#5413)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced a new suite of Playwright tests for validating enrichment
table functionality.
- Added new functions for enhanced navigation and interaction within the
pipeline UI.
- Added tests to assert the data in every derived stream with condition,
function and only source + derived stream
- Added tests to assert if user clicks on any menu option and cancel on
dialog box, user stays on pipeline page
- Added tests to assert if user clicks on dashboard menu option and
accept on dialog box, user navigates to dashboard page

  
- **Bug Fixes**
- Improved error handling in tests to ensure accurate feedback during
interactions.

- **Chores**
- Updated the GitHub Actions workflow to include additional integration
tests.
- Removed outdated test files related to function management, Kinesis
ingestion, and reporting functionality.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-19 17:14:37 +05:30
Shyam Panjiyar 49f5716b6b test: Service-Account-updated-automation (#5406)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Chores**
	- Removed automated UI tests for managing service accounts.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-19 13:58:20 +05:30
Loakesh Indiranandhengfei yang 8d234483d2 fix: check invalid stream_name during bulk ingestion (#5403)
#5378

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **Bug Fixes**
- Enhanced error handling for invalid stream names during ingestion,
ensuring appropriate logging and response for empty or invalid entries.
- Updated assertions in tests to reflect the correct handling of invalid
bulk payloads by the API, ensuring errors are present for invalid
submissions.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: hengfei yang <hengfei.yang@gmail.com>
2024-12-18 18:08:31 +05:30
Neha P ec5400e11e test: pytest-scheduled-pipeline (#5385) 2024-12-17 18:10:39 +05:30
Neha P 38ee5dfe0c test: pipeline-api-tests (#5380)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **Tests**
- Introduced a new end-to-end test for pipeline creation, enabling, and
disabling.
- Utilized parameterization to test various scenarios with different
pipeline names, actions, and expected HTTP status codes.
- Removed the previous end-to-end tests related to user token
management, which included user token retrieval and email verification
processes.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-17 16:25:35 +05:30
Shyam Panjiyar ca7b05aba6 test: service account API access automation (#5258)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **Bug Fixes**
- Updated the locator for the management menu item to enhance navigation
reliability.
- Streamlined the control flow by removing unnecessary wait times in the
management navigation process.

- **New Features**
- Added methods for managing service accounts, including adding,
validating, and deleting service accounts.
- Introduced a new test suite for validating service account
functionality, covering error handling and successful operations during
creation.
- Added a new method for automatic login based on visibility of the
login option.

- **Improvements**
- Updated the login method to ensure it waits for the correct login page
URL before proceeding.
- Simplified the login process in UI tests by removing unnecessary
parameters and wait times.
- Enhanced test scripts with improved structure and clarity, including
comments for better understanding.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-17 09:50:29 +05:30
Neha P 505bd69aa3 test: e2e-enrichment-bulkapi-pytest (#5371)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced end-to-end testing for bulk ingestion with comprehensive
coverage.
- Enhanced functionality for managing enrichment tables, including
adding, uploading, and deleting entries.

- **Bug Fixes**
- Improved error handling and user interaction checks in the enrichment
table upload process.

- **Tests**
- Added multiple new test cases for enrichment table functionality,
including upload and error handling scenarios.
	- Updated existing test cases for consistency and improved logic.

- **Chores**
- Standardized import statements and improved overall test structure for
clarity.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-16 17:13:55 +05:30
Taiming Liu 45419b5700 chore: defer sea_orm migration after legacy migration done (#5358)
This pr propose to defer recently added and soon-to-be-added migrations
to be executed after the version-based migration is done with the meta
table.
2024-12-15 19:13:54 -08:00
Neha P aded5ce3cf test: enrichment table testcase (#5313)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Introduced a new test case for uploading enrichment tables, enhancing
pipeline functionality validation.

- **Bug Fixes**
	- Improved error handling for required fields in existing tests.

- **Tests**
- Organized and structured existing test cases for better execution flow
and added wait times for asynchronous operations.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-10 11:42:56 +05:30
Sai Nikhil ea2fff7f43 fix: Stream settings page redesign (#5265)
This PR solves the issue #5216 #5224 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Enhanced user interface for the log stream input fields with improved
layout and visibility, including dynamic width adjustments and clearer
labeling.
	- Added a new column to display index size in the log streams table.
- Introduced pagination management for schema fields, allowing for
dynamic updates to the number of rows displayed.
- Added a new prop, `isInSchema`, to enhance component layout based on
schema inclusion.

- **Bug Fixes**
	- Improved error messaging for invalid data retention periods.

- **Documentation**
- Updated language localization for clarity in schema field
descriptions.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-09 19:52:27 +05:30
Sai Nikhil f895dc32e2 fix: removal of previous node option in pipelines node (#5142)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Introduced new stream types: "metrics" and "traces" in the Query
component.
	- Added a warning message for unsaved changes in the Pipeline Editor.
- Enhanced user experience with a new informational card in the
Condition component.

- **Improvements**
- Simplified components by removing previous node selection
functionality across multiple components.
	- Streamlined drag-and-drop functionality for better user interactions.
	- Improved error handling and feedback for SQL query validation.

- **Bug Fixes**
	- Reactivated tests for error handling in pipeline functionality.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-09 16:57:42 +05:30
Hengfei Yang c3b04a0f07 perf: improve nats lock (#5268) 2024-12-06 16:22:03 +08:00
Bhargav 8a439782b0 feat: destination and template movement under management (#5263)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Introduced new routing for "destinations" and "templates" under the
settings section.
	- Added a new `alertList` route, replacing the previous alerts route.

- **User Interface Changes**
- Removed tabbed navigation for alerts, destinations, and templates,
simplifying the layout to direct routing.
- Enhanced styling for icons in the header section for a more polished
appearance.
	- Updated the icon for the "organization" tab.

- **Bug Fixes**
- Standardized notification messages during save operations for better
user feedback.
- Updated functionality of back navigation buttons to emit a cancel
event instead of navigating back.

These updates enhance navigation and improve user experience within the
application.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-06 11:12:11 +05:30
Bhargav ed4c6f6edc fix: locator issue for management menu (#5260)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Bug Fixes**
- Updated locator strings for the management menu item to improve
element selection accuracy.
	- Ensured correct targeting of the file upload input for logo uploads.

These changes enhance the reliability of the management page
interactions without altering existing functionalities.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-05 12:29:05 +05:30
Patrick Sullivan 856e1adaf3 feat: "HTTP Layer" dashboard models (#5236)
## Summary

This PR only refactors code and should not result in any behavioral
changes.

This PR follows #5220 and creates separate "HTTP Layer" models for each
our dashboard HTTP API endpoints.

By separating the "HTTP Layer" models from the "Service Layer" dashboard
models we will now (in future PRs) be able to...
- add folder name and folder ID fields to each item returned by the
`ListDashboards` endpoint - Step 3 of #5198
- remove dashboard details from the each item returned by the
`ListDashboards` endpoint - Step 1 of #5196

Unfortunately, this PR does not yet accomplish fully decoupling the
"HTTP Layer" dashboard model from the "DB Layer" dashboard model since
both layers still use the same same JSON de/serialization logic defined
on the structs inside `config/meta/dashboards`. So changes to that model
and the corresponding JSON de/serialization logic could still introduce
silent breaking changes into both the interface with the DB and the HTTP
API. This PR moves us closer to decoupling those models, though future
work will be necessary to fully decouple them.

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced new data structures for handling dashboard-related HTTP
requests and responses, enhancing clarity and type safety.
- Added support for creating, updating, and listing dashboards with
structured request and response bodies.

- **Documentation**
- Updated OpenAPI documentation to reflect new schemas for dashboard
operations, improving API clarity and specificity.

- **Refactor**
- Removed outdated dashboard structures and streamlined request handling
logic for improved maintainability.
- Updated integration tests to align with the new dashboard data
structures.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-04 18:01:44 -06:00
Bhargav c686380d97 feat: Initial left navigation changes (#5241)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced layout structure and visual presentation in the MainLayout
component.
- Updated navigation item display properties for improved user
experience.
- Added a tooltip to the Theme Switcher for contextual information on
theme modes.
	- Introduced a new language selection entry in the user interface.
- Improved error handling and user feedback in the log search interface.
- Adjusted layout heights in various components for better visual
presentation.
	- Added a new method for refreshing timezone in the traces component.
	- Improved loading spinner visibility in RUM components.

- **Bug Fixes**
- Corrected localization for "Real User Monitoring" to "RUM" in the
English language file.

- **Refactor**
- Simplified the template structure in the MenuLink component for better
semantic clarity.
- Improved drawer visibility control and responsiveness in the
MainLayout component.
- Enhanced error handling and loading state management in the traces and
logs components.
- Updated height calculations for various components to optimize layout.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-04 18:48:03 +05:30
ShyamOOAI 6f52dc444d test: Change Org (#5201)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Introduced comprehensive UI testing for the Home, Ingestion, Login,
Logs, Metrics, Traces, Pipelines, Rum, Dashboard, Alerts, Reports, Data,
IAM, and About pages.
- Added functionality to handle organization changes and validations
across multiple pages, including default organization selections.
- New test suite for validating organization change scenarios across
various pages.
	- Enhanced login functionality for internal users.
- Introduced new classes and methods for the Metrics, Streams, Rum, and
Alerts pages to support UI testing.
- Added new classes for the Data and IAM pages, expanding testing
capabilities.
	- Enhanced Management page with navigation and validation capabilities.
- New methods for validating page URLs and content across various pages.

- **Bug Fixes**
- Improved validation methods to ensure proper navigation and content
checks on various pages.

- **Documentation**
- Updated testing framework to include new test cases and improved
structure for organization change tests.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-04 11:01:16 +05:30
ShyamOOAI 28319bdac3 test: Update coverage report (#5107)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced `LogsPage` with improved date and time selection, timezone
management, and clipboard operations.
- Introduced `ManagementPage` for UI testing, allowing logo updates and
management functionalities.
- Added new tests for time zone changes and streamlined test scenarios
on the logs page.
- Introduced a suite of tests for joining logs, validating various join
scenarios.

- **Bug Fixes**
- Updated confirm button interaction in `ReportsPage` to ensure
visibility before clicking.

- **Documentation**
- Improved clarity and purpose of test scenarios through restructuring
and simplification.

- **Chores**
- Added `logoManagement.spec.js` and `join.spec.js` to the Playwright UI
integration tests for expanded coverage.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-29 05:54:29 +05:30
Patrick Sullivan faa8929ae1 feat: migrate dashboards out of meta table and into their own table (#5146)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Enhanced dashboard management with new methods for retrieving
properties like ID, owner, title, and description.
- Added functionality for creating, updating, listing, and deleting
dashboards through a new service module.
- Introduced a new `dashboards` table in the database, with migrations
for creation and population.

- **Bug Fixes**
- Improved error handling for dashboard retrieval and management
operations, providing clearer responses for various conditions.

- **Documentation**
- Updated documentation to reflect new methods and error handling
improvements.

- **Refactor**
- Streamlined the dashboard handling logic in service and database
modules, reducing complexity and enhancing modularity.
- Enhanced error handling logic in dashboard management functions for
better clarity and control flow.
- Refined the dashboard retrieval process to improve clarity in control
flow and error handling.
- Updated the logic for dashboard operations to simplify version
handling and reduce redundancy.
- Improved the overall structure and organization of the dashboard
management code.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-26 19:22:40 -08:00
Patrick Sullivan 46cce3de59 feat: JSON-indpendent hashing of dashboard models (#5133)
The previous mechanism for generating hashes for dashboard models
depended on hashing the JSON representation of the dashboard that was
stored in the `meta` table.

As part of the migration of dashboards out of the `meta` table and into
a dedicated `dashboards` table, this ☝️ presented some problems:

Specifically when we want to translate from the Dashboard ORM model to a
`core::meta::dashboards::Dashboard` model, we need to generate the hash
at the time of translation since `hash` is a field on
`core::meta::dashboards::Dashboard`. We can't simply generate a hash
from the JSON stored in the `dashboards.data` column because this JSON
no longer contains fields for `title`, `owner`, `description`, and
`role`. Those fields are now stored in DB columns, and changes to those
columns in the DB columns would *not* result in changes to the hash on
the JSON blob.

Therefore, rather than hashing the JSON blob, this PR implements hash
functions on the Rust types for the dashboards. Therefore changes to
fields in those Rust structs will result in changes to the hash values,
but changes to the way in which the data is stored in the DB will not
affect the hash values.

⚠️ Note that this PR is changing the hash function on the dashboard
models, so hashes generated for the same model before and after this
deployment will not be the same. My understanding is that this shouldn't
be an issue since hashes are just used as a way of checking on the UI if
the dashboard model has been updated to avoid overwriting the changes of
another user. I believe that this change to the dashboard function might
just have the effect (around the time of deployment) where it would
appear to the UI that the dashboard has been updated when, in fact, it
has not.

https://github.com/openobserve/o2-enterprise/actions/runs/11979723563

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced a new type alias `OrdF64` for enhanced precision in
floating-point operations.
- Added the `Hash` trait to multiple dashboard-related structs and
enums, enabling their use in hash-based collections.

- **Bug Fixes**
- Improved error handling and assertion clarity in API testing for
folder and dashboard operations.

- **Chores**
- Standardized hashing mechanism for dashboard objects in database
operations.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-25 10:23:38 -06:00
Hengfei Yang d6487eb9fe ci: update rust version (#5143) 2024-11-25 19:20:07 +08:00
Patrick SullivanandTaiming Liu a8647d3bbe feat: move dashboards module to config crate (part 1/2 of feature 5068) (#5113)
This is the first PR for #5068 .

We need to move `dashboards` into the `config` crate so that DB access
functions in the `infra` crate can return types defined in the
`dashboards` module.

When the `dashboards` module is in the `openobserve` crate we cannot use
them in the `infra` crate since that would introduce a circular
dependency.

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Introduced a new function to move dashboards, enhancing dashboard
management capabilities.
- Added a new `SendReport` trait for improved report handling and
modularity.
- Enhanced error handling across various dashboard and report management
functions.

- **Improvements**
- Updated import paths for better clarity and organization, particularly
for dashboard-related modules.
- Improved timestamp handling for alerts to ensure accurate tracking of
updates.
- Enhanced OpenAPI documentation to reflect updated schema references
for dashboards.
	- Expanded development dependencies to support improved functionality.
- Enhanced the logic for handling report triggers based on frequency
types.

- **Bug Fixes**
- Refined error handling in dashboard creation and deletion functions to
provide clearer responses.
- Standardized error handling across report management functions for
consistency.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Taiming Liu <liutaiming3@gmail.com>
2024-11-22 13:23:40 -06:00
Neha P 8fb58346a1 test: pytest-join-queries testcases (#5128)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced a new JSON file for SQL join query test cases, enhancing
the variety and coverage of tests.
- Added multiple new test cases for various SQL join operations,
improving testing capabilities.

- **Bug Fixes**
- Improved error handling in data ingestion steps to ensure successful
test execution.

- **Refactor**
- Transitioned from hardcoded test data to a parameterized approach for
better maintainability and flexibility in testing.
	- Updated method signature to streamline test parameters.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-22 18:05:24 +05:30
Bhargav bbb8aa9b9b fix: refactoring organization handling (#5074)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced a reactive variable for organization data, improving state
management.
- Updated functionality to accept an object for organization data,
enhancing input validation and handling.

- **Bug Fixes**
- Enhanced error handling for better debugging without altering existing
functionality.

- **Refactor**
- Improved readability and maintainability of the layout component with
formatting adjustments and refined logic.
- Updated test cases to reflect changes in URL structure for
consistency.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-19 17:13:38 +05:30
ktx-akshayandktx-vaidehi c5b60c3aaf test: dashboard vrl testcases (#4130)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Enhanced Playwright test suite for dashboard functionalities,
including comprehensive tests for VRL functions, dashboard settings, and
data validation.
- Added new test cases for creating, deleting, and updating dashboards,
as well as applying dynamic filters.
- Introduced automation for the login process and improved the
validation of user inputs in dashboard tests.

- **Bug Fixes**
- Improved error handling and visibility checks in dashboard tests to
ensure user inputs are validated correctly.

- **Chores**
- Updated import statements across multiple test files to utilize a
local module for better fixture management.
- Added a new test file for VRL visualization tests to expand
integration coverage.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: ktx-vaidehi <vaidehi.akhani@kiara.tech>
2024-11-14 19:16:17 +05:30