Commit Graph
128 Commits
Author SHA1 Message Date
Bhargav bbb8aa9b9b fix: refactoring organization handling (#5074)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced a reactive variable for organization data, improving state
management.
- Updated functionality to accept an object for organization data,
enhancing input validation and handling.

- **Bug Fixes**
- Enhanced error handling for better debugging without altering existing
functionality.

- **Refactor**
- Improved readability and maintainability of the layout component with
formatting adjustments and refined logic.
- Updated test cases to reflect changes in URL structure for
consistency.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-19 17:13:38 +05:30
ktx-akshayandktx-vaidehi c5b60c3aaf test: dashboard vrl testcases (#4130)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Enhanced Playwright test suite for dashboard functionalities,
including comprehensive tests for VRL functions, dashboard settings, and
data validation.
- Added new test cases for creating, deleting, and updating dashboards,
as well as applying dynamic filters.
- Introduced automation for the login process and improved the
validation of user inputs in dashboard tests.

- **Bug Fixes**
- Improved error handling and visibility checks in dashboard tests to
ensure user inputs are validated correctly.

- **Chores**
- Updated import statements across multiple test files to utilize a
local module for better fixture management.
- Added a new test file for VRL visualization tests to expand
integration coverage.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: ktx-vaidehi <vaidehi.akhani@kiara.tech>
2024-11-14 19:16:17 +05:30
Neha P be8a00f543 test: e2e-pipeline-testcases (#5017)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced a new `PipelinePage` class for enhanced UI testing of the
pipeline management interface.
- Added a comprehensive suite of Playwright tests to validate pipeline
creation, editing, and deletion functionalities.

- **Bug Fixes**
- Corrected the test filename in the workflow configuration to align
with naming conventions.

- **Chores**
- Removed the outdated `pipeline.spec.js` test file to streamline the
testing suite.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-13 17:35:21 +05:30
Omkar Kesarkhane cb21395382 fix: e2e test coverage setup (#4897)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Added support for code coverage reporting with the integration of
`vite-plugin-istanbul`.
	- Introduced a new configuration file for code coverage settings.

- **Improvements**
	- Updated project to use ECMAScript modules for better compatibility.
- Enhanced UI test coverage with additional test cases and improved
error handling.
- Refactored test suites to utilize a custom module for better
organization and maintainability.
- Improved the login process and dashboard loading in test cases for
better reliability.

- **Bug Fixes**
- Resolved issues related to import statements affecting test execution.

- **Documentation**
- Updated `.gitignore` to exclude coverage directories from version
control.

These updates enhance the functionality, maintainability, and
reliability of the application and its testing framework.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-13 15:13:36 +05:30
ktx-vaidehi 8456ae5ecf test: dashboard settings (#4990)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Introduced multiple new test files for dashboard functionalities,
including settings for variables, tabs, and general settings.
- Enhanced testing capabilities with new test cases covering various
scenarios for managing dashboard elements.

- **Improvements**
- Added `data-test` attributes to various UI components across multiple
files, improving testability for automated testing.

- **Bug Fixes**
- Updated import paths for JSON data files to ensure proper referencing
in tests, enhancing overall test reliability.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-13 10:44:13 +05:30
Sai Nikhil d8a62bd908 fix: pipeline issues (#4993)
This PR solves the below fixes
SQL error to be displayed while creating query type source node.
 Function is overlapping when we get. error while creating function.
 All validations need to be fixed
Confirmation message to not display, if user edits but does not change
anything and clicks on back icon
 Pipeline Preview for every node we are getting extra white background
Function added in a pipeline should not be allowed to delete until user
deletes the pipeline
 when user cancels any node creation any selection will be reset


<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Enhanced user interaction and responsiveness in the pipeline editor
components, including improved handling of node selections and
validations.
- Introduced new tab for "streamPipelines" in the Functions view,
replacing the previous "enrichmentTables" tab.
- Added notifications for missing required fields during function
creation and condition saving.
- Implemented dynamic styling for function nodes based on user
interactions.
- Improved validation logic for cron expressions and SQL queries,
providing immediate feedback on input errors.
- Introduced user selection tracking and tooltips for various node types
to enhance clarity and usability.
- Updated data-test attributes across components for improved testing
capabilities.

- **Bug Fixes**
- Improved error handling and notifications for user inputs,
particularly regarding cron expressions and SQL query validations.
- Enhanced state management and error feedback for user selections
across various components.

- **Documentation**
- Updated internal logic descriptions for better clarity on component
behaviors and user interactions.

- **Style**
- Added tooltips for node types to enhance user experience and
visibility of node details.
- Introduced new styling for node handles to improve maintainability and
consistency.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-12 16:05:58 +05:30
ShyamOOAI edbb812116 test: e2e test case for report (#4977)
test case report e2e

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Added a new test suite for report functionalities, including creating
and deleting dashboards and reports.
- Introduced a new `IngestionPage` class for handling data ingestion
through an API.
- Enhanced `DashboardPage` with improved dashboard creation and deletion
processes.
- Updated `ReportsPage` to support report creation and verification with
new methods.

- **Bug Fixes**
- Improved element selection methods for better reliability in the login
process.

- **Documentation**
- Streamlined import statements and improved code organization for
better readability.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-06 13:58:23 +05:30
ktx-akshayandktx-vaidehi 0ca6524994 test: dashboard table transpose (#4925)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced test coverage for dashboard UI with new Playwright tests
focusing on the transpose feature and dynamic columns.
- Added `data-test` attributes to various components in the General
Settings for improved testability.

- **Bug Fixes**
- Improved consistency in the GitHub Actions workflow configuration for
UI tests.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: ktx-vaidehi <vaidehi.akhani@kiara.tech>
2024-11-04 16:58:13 +05:30
0ebaf21f33 feat: Pipeline integration v2 (#4732)
This PR implements the new design of **Pipeline** introduced by #4432 

---

**2 types of pipelines differentiates by the source** 

Type I: **Realtime**
- source is a stream (Logs, Metrics, & Traces)
- takes effect when the source stream is being ingested

Type II: **Scheduled** (aka DerivedSteram)
- source is a SQL query
- takes effect based on the given schedule

The new pipeline is represented as a graph consists of different types
of Nodes that are connected by edges.
**Pipeline Data Model**
```rs
pub struct Pipeline {
    pub id: String,
    pub version: i32,
    pub enabled: bool,
    pub org: String,
    pub name: String,
    pub description: String,
    pub source: PipelineSource,
    pub nodes: Vec<Node>,
    pub edges: Vec<Edge>,
}
```
**4 types of node**
I. StreamNode: either used for source node of realtime pipeline or for
destination nodes
II. QueryNode: used for source node of scheduled pipeline
III. FunctionNode: used for executing vrl functions
IV. ConditionNode: used for checking routing conditions

Rules applied to validating a pipeline when it's created:
1. non-empty nodes list
2. non-empty edges list
3. 1st node in nodes list is either StreamNode or QueryNode
4. non-empty `conditions` in all ConditionNode nodes in nodes list
5. all leaf nodes are of type StreamNode
6. In the same branch, unchecked `after_flattened` FunctionNode can't
follow checked
   `after_flattened` checked FunctionNode

Pipeline execution is implemented with the struct `ExecutablePipeline`,
a ready-execute pipeline object cached in memory based on the Pipeline
objects modified on the UI side.
`ExecutablePipeline` object
- builds the relationships among all the nodes based on the edges
- topologically sorts the nodes based on the level to determine which
node to process first
- registers all the vrl function node once

`ExecutablePipeline` object processes ingested records in batch.
Starting from the source node, each connecting edge has a channel
connecting the parent and child node, used for passing the records. This
approach enables batch processing in parallel.

---

**Deprecated Features**
1. previous implementation of pipeline
2. Function x Stream associations
 - Functions can still be added/edited/removed as before
- Needs to create a pipeline in order to apply chosen functions to the
desired stream

The new release when this pr is merged will automatically migrate **old
pipelines** and **Function x Stream associations** to new pipeline
format and can be found in `Stream Pipelines` tab with `Migrated-`
prefix names.
**_Note: Auto generated pipelines are paused by default. Please verify
the pipelines before enabling them_**


Co-authored-by: Taiming Liu <liutaiming3@gmail.com>
Co-authored-by: Bhargav <BJP232004@GMAIL.COM>
2024-10-30 21:53:28 -07:00
Neha PandSai Nikhil 5306ad899f test: clone alert (#4931)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced alert creation and cloning functionality with improved
validation checks.
- Added support for comprehensive search capabilities in the alert list.
- Introduced functionality to verify user interactions with search
history.

- **Bug Fixes**
	- Improved error handling and user feedback during alert cloning.
	- Enhanced validation for required fields in alert creation.

- **Tests**
- New test cases added for alert management and search history
functionalities.
- Updated existing tests to ensure better coverage and error handling,
including the addition of new scenarios for invalid inputs.

- **Chores**
- Cleaned up the test suite by removing unused code and improving
structure.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Sai Nikhil <nikhil@openobserve.ai>
2024-10-30 17:53:27 +05:30
Ashish Kolhe 59e9f73e16 feat: use stream stats for partitioning api (#4901) 2024-10-26 10:43:32 +08:00
Neha P f5412c7528 test: added multiple float queries in pytest under alert and logs (#4909)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Added end-to-end tests for creating alerts based on SQL and float
values.
- Introduced a page object model for unflattened logs to streamline UI
interactions.
	- Implemented a function to toggle quick mode in the test suite.

- **Bug Fixes**
	- Enhanced error handling and validation in alert tests.
- Improved reliability of tests by ensuring UI elements are visible
before interactions.

- **Refactor**
- Refactored Playwright tests to utilize the `UnflattenedPage` object
for better maintainability.
	- Consolidated parameters in fetch requests for clarity.

- **Chores**
- Removed redundant tests from the alert test suite to improve clarity
and maintainability.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-10-25 13:09:15 +05:30
Neha P 5bb3baad92 test: add unflattened testcase and POM (#4905)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced a new `UnflattenedPage` class for structured UI
interactions in tests.
	- Added functionality to toggle quick mode in the testing framework.

- **Bug Fixes**
- Improved error handling and visibility assertions in various test
cases.

- **Documentation**
- Enhanced comments and code formatting for better readability and
maintainability.

- **Refactor**
- Restructured test cases to utilize the `UnflattenedPage` object,
promoting a page object model for improved code organization.
	- Updated test configurations for better clarity and consistency.

- **Chores**
- Removed several outdated test files related to dashboard and logging
functionalities, streamlining the test suite.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-10-24 19:50:33 +05:30
ShyamOOAI 2ffb01d18d test:Updated logs (#4902)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Enhanced UI testing for time precision across multiple pages,
including Logs, Traces, Reports, Dashboards, Alerts, and Metrics.
- Added tests for both relative and absolute seconds to ensure accurate
time settings.

- **Bug Fixes**
- Updated existing tests to improve verification of time settings on the
Metrics and RUM pages.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-10-24 16:36:04 +05:30
ShyamOOAIandNeha P 711dd00978 fix: E2e seconds precision updated (#4770)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced new UI testing classes for various application pages,
including `AlertsPage`, `DashboardPage`, `LogsPage`, `ReportsPage`,
`TracesPage`, and `LoginPage`.
- Added a new test suite focusing on time-related features across
multiple pages.

- **Bug Fixes**
- Improved consistency in the GitHub Actions workflow for UI integration
tests.

- **Documentation**
- Enhanced organization of locators and methods for better usability in
UI testing.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Neha P <144308844+neha00290@users.noreply.github.com>
2024-10-21 18:55:38 +05:30
Bhargav 6714d26d30 fix: moved restore URL params before api calls (#4804)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Introduced a method to restore URL query parameters on component
mount.
	- Enhanced data loading responsiveness based on route changes.
- Improved handling of search history visibility based on query
parameters.

- **Bug Fixes**
- Added validation checks for executing queries to ensure only valid
queries are processed.

- **Style**
- Updated layout and scrollbar styles for a better user interface
experience.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-10-18 22:00:45 +05:30
b53766d76a fix: Dashboard chart UI issues (#4745)
#4256 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced new functions for enhanced chart rendering:
`getLargestLabel` for improved label sizing, `largestStackLabel` for
stacked charts, and `getPieChartRadius` for pie charts.

- **Improvements**
- Enhanced axis label handling for better visual representation in
horizontal bar and stacked charts.
- Updated text width calculation to be more flexible with an optional
font size parameter.
	- Improved clarity in variable naming for better understanding.
- Enhanced readability of the ViewPanel component template and improved
management of the loading state.
- Refined UI test interactions with more descriptive data-test
selectors, enhancing maintainability.
	- Improved handling of large datasets and complex SQL queries in tests.

- **Bug Fixes**
- Enhanced error handling in tests for invalid queries, improving
overall robustness of the application.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: ktx-akshay <akshay.patil@kiara.tech>
Co-authored-by: ktx-abhay <abhay.padamani@kiara.tech>
2024-10-16 16:59:00 +05:30
Neha P 05a84d3009 test: e2e logs search history (#4746)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced new test cases for the search history feature, enhancing
verification of navigation between the search history and logs pages.
- **Chores**
- Added new environment variables `ZO_FILE_PUSH_INTERVAL`,
`ZO_USAGE_BATCH_SIZE`, `ZO_USAGE_PUBLISH_INTERVAL`, and
`ZO_USAGE_REPORTING_ENABLED` to the Playwright workflow configuration.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-10-10 15:14:08 +05:30
Neha P b431942f1c test: vrl error message validation fix (#4736)
- Add a validation to test if error message is not displayed when valid
VRL function is added

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Bug Fixes**
- Improved reliability of UI tests by enhancing element visibility
checks and handling asynchronous operations.
- Added assertions to ensure warning elements are hidden after query
execution.

- **Tests**
	- Updated Playwright test suite for better structure and clarity.
- Included more explicit waits and checks for user interactions with the
UI.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-10-08 20:53:27 +05:30
Neha P 2b13a4ce7b test: unflattened testcases (#4704)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced a new suite of UI tests for a logging application,
enhancing testing coverage.
- Added functionality to automate user login and data ingestion
processes within the tests.
- Implemented a test case to toggle settings and verify UI interactions.

- **Bug Fixes**
- Expanded the test file list to include additional scenarios for more
comprehensive testing.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-10-04 09:00:35 +05:30
Sai Nikhil 9c0d49e0e8 feat: Search history introduced in the logs page (#4656)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced a new component for displaying search history, allowing
users to view their past searches.
	- Added a button in the search bar to easily access search history.
- Implemented a dedicated search history component with a table to
display and manage search entries, including options to copy SQL queries
and navigate to logs.

- **Bug Fixes**
- Improved navigation and visibility controls for the search history
section based on user interactions.

- **Documentation**
- Enhanced user experience with loading indicators and no-data states in
the search history component.
- Updated testing configurations for improved interaction with date-time
buttons.
- Introduced a dynamic testing configuration for the date-time button to
enhance flexibility.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-09-27 17:52:01 +05:30
John Vandenberg 16ee5fc680 chore: fix frontend typos (#4612) 2024-09-25 11:09:26 +08:00
Hengfei Yang d1ed457369 feat: new search engine (#4182) 2024-09-20 15:10:54 +08:00
ktx-vaidehiandktx-abhay 5c9f2940f9 feat: for view panel and visualization applied cancel query (#4569)
- #4572 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced functionality to cancel running queries within dashboard view
panels.
- Introduced loading state management for variables and panels,
improving user experience.
- Added support for managing visualization queries alongside standard
search queries in the search bar.
- Implemented default value handling for multi-select variables to
improve control flow.

- **Bug Fixes**
- Improved button rendering logic to accurately reflect the loading
state and available actions.
- Updated UI tests to ensure accuracy in interacting with the correct
refresh button for visualizations.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: ktx-abhay <abhay.padamani@kiara.tech>
2024-09-18 12:23:00 +05:30
01d0582213 feat: AND, OR, group condition for dashboard filter (#3957)
## Feature:
- #4339 

## Fixes:
- #4233 
- #4239 
- #4306
- #4307
- #4311
- `<blank>` was not visible properly in the dropdown when the value is
null converted it to `<blank>`

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Introduced support for version 5 of the Dashboard, enhancing the
dashboard's extensibility.
- Added a new component for managing filter options, improving user
interaction with dashboard queries.
- Implemented a new user interface for adding conditions to dashboard
panels.

- **Bug Fixes**
	- Improved error handling in SQL query generation to prevent crashes.

- **Documentation**
- Updated localization files to include new entries for adding groups
and conditions.

- **Refactor**
- Streamlined filter management by creating dedicated components,
enhancing code maintainability.

- **Tests**
- Enhanced UI tests for improved interaction with dropdowns and filters.

- **Chores**
- Removed obsolete event listeners and variables to simplify component
logic.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: ktx-abhay <abhay.padamani@kiara.tech>
Co-authored-by: ktx-akshay <akshay.patil@kiara.tech>
2024-09-03 14:15:15 +05:30
Omkar Kesarkhane 1a152f61e5 fix: saved views columns not getting restored (#4401)
fix #4396 
1. Saved view columns not getting restored
2. Removed labels from Reset Filters and Syntax Guide buttons
3. Reduced table row height to 20px
4. Table column value getting copied as JSON

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Summary by CodeRabbit

- **New Features**
- Added a "Reset Filters" option to enhance user interface
functionality.
- **User Interface Improvements**
- Updated the search bar to use localized titles for better
internationalization.
- Enhanced the syntax guide button's tooltip presentation and improved
readability through formatting adjustments.
- Modified button styles for consistency and layout improvements in the
syntax guide.
- **Styling Changes**
- Adjusted table cell padding and height for a more compact layout in
the logs table.
- **Testing Enhancements**
- Improved UI testing robustness by updating the method for locating the
"Reset Filters" button.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-29 17:40:07 -07:00
Omkar Kesarkhane 795bb28252 fix: logs table timestamp column visibility issue (#4361)
fix #4344 
1. Source appears in wrap by default
2. On switching from saved views source disppears

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Improved handling of log data and column order in various components,
enhancing performance and clarity.
- Added reactivity for column order updates in the TenstackTable
component.
	- Introduced a sidebar mode for the JSON preview, enhancing usability.

- **Bug Fixes**
- Enhanced robustness of state management in the SearchBar component to
prevent errors related to missing properties.

- **Style**
- Streamlined CSS for the IndexList component, improving readability
without altering visual behavior.

- **Refactor**
- Simplified logic in multiple components to improve maintainability and
efficiency by removing unnecessary checks and intermediate steps.
- Increased default column size for better visibility of displayed data.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-28 17:54:19 +05:30
Omkar KesarkhaneandSai Nikhil bafbd205d4 feat: logs tables performance optimization (#4097)
fix #3973 
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **New Features**
- Introduced a new dynamic table component for enhanced data display and
interaction.
- Added support for Tailwind CSS, improving styling capabilities across
the application.
- Implemented interactive controls for managing log entries in the data
table.

- **Improvements**
- Enhanced logging functionality with clearer error messaging, improved
content wrapping, and optimized selection of log fields based on user
input.
- Streamlined user interface in the JSON preview and search result
components for better usability and readability.
	- Improved performance and responsiveness of the search results table.
- Refined column visibility management in the search results, enhancing
user experience.

- **Bug Fixes**
- Updated column management logic in the search results for improved
robustness.
- Enhanced reliability of Playwright tests by refining timing and
interaction steps.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Sai Nikhil <nikhil@openobserve.ai>
2024-08-26 16:59:43 +05:30
Omkar Kesarkhane 7a8656dfc4 fix: Updated QueryEditor component to support languages (#3988)
fix #4292 
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced a new custom `QueryEditor` component for a more
customizable and consistent editing experience across various forms and
editors.
- Added support for a new programming language, VRL, including syntax
highlighting and theming.

- **Enhancements**
- Updated multiple components (`AddTemplate.vue`, `AddFunction.vue`,
`EditRole.vue`) to utilize the `QueryEditor` component, improving
editing functionality and user interface.
- Enhanced the `SearchBar.vue` component for better formatting and
language handling.

- **Bug Fixes**
- Adjusted the language attribute in the `SearchBar.vue` component from
"ruby" to "vrl" to ensure correct syntax highlighting.

- **Tests**
- Improved stability of the alerts test suite by adding a timeout after
user input actions.
- Added a timeout in the sanity test cases to enhance the reliability of
template submission.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-22 21:12:55 +05:30
Hengfei Yang 46761d3b10 feat: align the multiple search partition to avoid override with histogram (#4269) 2024-08-21 14:30:46 +08:00
Neha Pandomkark06 701e0b640a test: assert timestamp and all displayed in fields when uds enabled (#4208)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **Tests**
- Enhanced test coverage for schema functionalities, adding interactions
for log search and schema selection.
- Improved verification of `_timestamp` and `_all` fields to ensure
thorough validation of the schema selection process.
- Streamlined logging process by removing unnecessary console logging
during test execution.

- **Style**
- Improved formatting and readability in the `IndexList` component,
including adjustments to multiline expressions and conditional
renderings.
- Enhanced semantic clarity by restructuring template elements for
better organization and styling.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: omkark06 <omkar@zinclabs.io>
2024-08-14 18:19:32 +05:30
Bhargav 969c283eba fix: auto order by clause removed for sql mode (#4194)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **Bug Fixes**
- Adjusted search functionality to prevent issues with results sorting
when clicking on alert-generated URLs.

- **Improvements**
- Modified control flow to enhance the stability of the search results
display.
- Updated test cases to reflect changes in query visibility conditions,
allowing for broader match criteria.
- Simplified test queries by removing unnecessary ordering, improving
test flexibility.
- Shifted focus of sanity test from `_timestamp` to `job`, aligning with
changes in expected UI output.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-14 15:54:48 +05:30
54f1448b7c fix: Improved period (time range) functionality in pipelines derived stream (#4191)
Improved Period of derived stream to be same as frequency

Complete the `Frequency` task in the tracking issue #4170 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Summary by CodeRabbit

- **New Features**
- Introduced a new component for managing scheduled alerts with a tabbed
interface for custom alerts, SQL queries, and PromQL queries.
- Enhanced user experience with dynamic input fields, real-time
validation, and aggregation settings for alert conditions.
	- Added cron job configuration options for scheduling alerts.

- **Changes**
- Renamed the scheduled alert component to reflect the new
functionality, impacting how the application handles alert triggering
and scheduling.
- Adjusted timing and frequency parameters for triggering conditions in
the alert management system.

- **Improvements**
- Enhanced logging functionality for monitoring enrichment data saving,
providing insights into operations and parameters involved.
- Improved error handling and response validation processes for
ingestion tasks, ensuring more informative logging and error reporting.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Taiming Liu <liutaiming3@gmail.com>
Co-authored-by: oasisk <ashish.j.kolhe@gmail.com>
2024-08-13 17:15:10 +05:30
Abhay Padamani 6c99dc9d24 fix: use user defined schema for dashboard fieldList (#4153)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced dashboard functionality with user-defined schemas for better
data flexibility.
- Improved drag-and-drop capabilities for stream fields across various
dashboard components.
- Updated notifications and management of variable data in the add
panel.

- **Bug Fixes**
- Adjusted UI test case to reflect changes in visible text regarding
chart configuration updates.
  
- **Chores**
- Modified pagination settings in the Field List component for improved
performance.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-08 18:40:10 +05:30
cfdc09fcba feat: Logs Traces correlation (#3705)
fix: #2369 
      #3379 
      #4090 
      
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Summary by CodeRabbit

- **New Features**
- Introduced new UI components for managing organization settings with
validation.
  - Added "View Logs" button functionality in the trace sidebar.
- Enhanced span logs management with new selection and viewing features.
  - Added search capabilities for log stream selection in trace details.
- Added new routes for Trace Details and Organization Settings with
access control.

- **Improvements**
- Updated layout and styling for better user experience, including
full-width trace details.
  - Integrated services for fetching trace metadata and log streams.
- Enhanced user feedback mechanisms for actions like copying trace URLs.
- Improved interactivity and responsiveness in span-related components.
- Refined navigation and routing for trace details and organization
settings.
- Improved error handling and state management in log fetching
functionalities.

- **Bug Fixes**
- Adjusted CSS to correct layout issues in trace details and sidebar
views.
- Improved test reliability in UI interaction testing by extending wait
times.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Subhradeep Chakraborty <chakrabortysubhradeep556@gmail.com>
Co-authored-by: Bhargav <BJP232004@GMAIL.COM>
2024-08-07 20:07:40 +05:30
Hengfei Yang 564ac641a8 fix: should exit when backend init failed (#4138) 2024-08-07 14:47:50 +08:00
Bhargav 66226f01a3 fix: reduced default settings of total number of events per page (#4041)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **New Features**
- Adjusted the logs display settings to show fewer rows per page (from
250 to 100), enhancing navigation and making log entries more manageable
for users.

- **Bug Fixes**
- Updated test cases to reflect the change in pagination display,
ensuring consistency between the UI and the expected outcomes in tests.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-06 14:31:53 +05:30
df2488fa44 feat: optimize sql to plan execution (#4100)
Now we use sql to plan to execute the query. 

we split the PhysicalPlan to two stage:
1. Partial plan, it can be distributed will run on all the nodes.
2. Final plan, it can't be distributed will run on the leader querier
and merge the result.

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **New Features**
- Updated to version 0.10.9, introducing enhancements and new
dependencies for improved data processing functionalities.
- Added new Protocol Buffers schemas to define structures for cluster
management and data processing frameworks, enhancing integration
capabilities.

- **Bug Fixes**
  - Improved error handling in configuration to prevent runtime panics.
- Enhanced logic in caching mechanisms for more reliable query
responses.

- **Documentation**
- Added module declarations to improve organization and clarity within
the codebase.

- **Refactor**
- Streamlined execution plans and SQL processing for better performance
and maintainability.

- **Tests**
- Introduced new functions for log ingestion in test suites to enhance
reliability and coverage.

- **Style**
- Made formatting adjustments across various files to improve
readability and consistency.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Neha P <neha@openobserve.ai>
Co-authored-by: oasisk <ashish.j.kolhe@gmail.com>
2024-08-05 18:38:35 +08:00
ktx-akshay 355591cbef test: testcases for visualization functionality (#4061)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Expanded automated testing coverage by adding new UI test files for
dashboard management and logging visualization functionalities.
- Enhanced dashboard UI tests now cover creating, modifying,
duplicating, and applying filters to dashboards.
- Introduced tests for verifying user interactions with logging
visualizations, including error handling and data persistence.
- Added tests for Virtual Reference Language (VRL) features within the
dashboard, validating function applications and error handling.

- **Bug Fixes**
- Improved error handling in UI tests to ensure that invalid inputs
trigger appropriate error messages.

- **Tests**
- Comprehensive test cases implemented for various user interactions
across new features, ensuring functionality works as intended.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-05 14:26:57 +05:30
Bhargav a43abb7515 fix: default timestamp column on logs page (#3860)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **New Features**
  - Introduced a new boolean field to enhance log search functionality.

- **Improvements**
- Updated log search logic to include a timestamp column when
applicable.
- Enhanced UI elements for conditional rendering based on log search
criteria, improving clarity and relevance.

- **Tests**
- Updated UI testing scripts to reflect changes in focus from the
timestamp field to the job field, ensuring alignment with the updated
application interface.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-05 11:57:04 +05:30
BhargavandNeha P 979f4ea6b6 feat: Npm package upgrade (#3984)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **Bug Fixes**
- Updated error messaging in the Logs UI to provide clearer feedback to
users when search queries fail.

- **Chores**
- Improved element selection specificity in Playwright tests to ensure
interactions with the correct UI elements.
- Upgraded dependencies to the latest versions for improved performance,
security, and compatibility.
- Excluded unnecessary directories from TypeScript compilation to
enhance project specificity and efficiency.
- Refined time zone handling across components for better accuracy in
date and time displays.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Neha P <neha@openobserve.ai>
2024-07-22 13:54:34 +05:30
Bhargav 8f1af1a7b0 fix: Logs page histogram api duplicate call (#3998)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **Bug Fixes**
- Improved reliability of histogram data loading by refining conditional
logic.
- Ensured `loadLogsData()` only runs when necessary, enhancing
performance and preventing unnecessary calls.

- **New Features**
- Enhanced control flow to check for query result hits before proceeding
with certain operations.

- **Tests**
- Introduced a delay in the UI test to improve the reliability of
visibility checks for error messages after refresh actions.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-07-19 15:42:34 +05:30
Neha PandHengfei Yang d9af0e3126 test: e2e quick mode without timestamp (#4006)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Updated URL generation for copying HTTP traces content in
OpenTelemetry component to improve accuracy.

- **Tests**
- Added a new test case to verify the display of results without
timestamps in quick mode.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
2024-07-18 17:26:54 +05:30
Hengfei Yang 99970f7d0c feat: use cache for value API (#3997)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **Bug Fixes**
	- Improved caching behavior and response processing in search requests.
- Enhanced error handling and response generation for better user
experience.

- **Tests**
- Disabled specific UI interaction in Playwright tests to prevent test
failures.

- **Chores**
	- Updated configuration defaults to improve clarity and efficiency.
	- Made internal constants publicly accessible for broader usage.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-07-18 08:09:12 +05:30
25bb19d846 feat: visualization for logs page (#3529)
- Visualize the logs data
- Save these visualizations to the dashboard

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Introduced a new `SelectDashboardDropdown` component for selecting and
adding dashboards from a dropdown list.
- Added a `SelectTabDropdown` component for selecting and managing tabs
within a dashboard.

- **Enhancements**
- Added conditional rendering for folder selection in the `AddDashboard`
component.
- Improved handling and validation for `activeFolderId` and
`showFolderSelection` props.
- Enhanced `PanelSchemaRenderer` to handle null or undefined values more
gracefully.
- Updated various components to use dependency injection for
`dashboardPanelDataPageKey`.

- **Bug Fixes**
- Removed unnecessary `click()` actions in multiple UI test scripts to
streamline test flows.
- Fixed various selector and conditional rendering issues in UI
components for better stability and performance.

- **Refactor**
- Refactored `QueryEditor` to include a nullish check, improving
stability.
- Restructured `DashboardQueryEditor` for better maintainability and
clarity.
- Adjusted import statements and removed unused dependencies across
multiple components.

- **Style**
- Adjusted styles and button functionalities in `SearchBar` for a more
intuitive user experience.

- **Tests**
- Updated and streamlined Playwright tests to remove redundant actions
and improve efficiency.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: omkark06 <omkar@zinclabs.io>
Co-authored-by: ktx-vaidehi <vaidehi.akhani@kiara.tech>
Co-authored-by: Neha P <neha@openobserve.ai>
2024-07-15 10:57:45 +05:30
BhargavandTaiming Liu 72aea59198 fix: sql function change with syntax guide (#3643)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Enhanced text snippet suggestions in the Query Editor with updated
labels and insert text.
- Introduced new functions for advanced search and matching operations
in the Query Editor.
  
- **Improvements**
- Improved search instructions for 'error' values in the Syntax Guide,
including clarifications on case sensitivity.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Taiming Liu <liutaiming3@gmail.com>
2024-07-12 13:02:03 +05:30
Hengfei Yang 46a5af14fe feat: secondary index (#3870) 2024-07-10 15:08:07 +08:00
ktx-vaidehiandktx-abhay 754e6b6659 feat: dashboard folder UI changes (#3731)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced dashboard folder management with improved layout and
functionality for editing and deleting folders.
  - Added icons and labels for better user interaction.

- **Bug Fixes**
- Updated selectors in UI tests for more reliable dashboard folder
interactions.

- **Style**
- Improved visual consistency with updated CSS for folder items,
including better alignment and transitions.

- **Tests**
- Refined UI tests to ensure accurate folder interaction in the
dashboard.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: ktx-abhay <abhay.padamani@kiara.tech>
2024-07-05 15:54:42 +05:30
Bhargav 5cd322db45 fix: Added more meaningful error messages (#3903)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **Bug Fixes**
- Enhanced error messages for better clarity during SQL syntax errors
and data retrieval issues.

- **Tests**
- Updated UI test cases to reflect more descriptive error notifications
in the logs page.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-07-04 18:53:34 +05:30
Omkar KesarkhaneandBhargav a889569366 fix: logs time period in url was getting changed on refreshing page (#3885)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Improved search functionality with enhanced error handling and updated
date-based search parameters.

- **Style**
- Updated styles for `h5` and `h6` elements to refine font size, weight,
line height, letter spacing, and margins.

- **Tests**
- Enhanced UI tests to include additional timeouts and refined click
actions for improved test reliability.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Bhargav <BJP232004@GMAIL.COM>
2024-07-03 18:17:48 +05:30