fix#4292
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced a new custom `QueryEditor` component for a more
customizable and consistent editing experience across various forms and
editors.
- Added support for a new programming language, VRL, including syntax
highlighting and theming.
- **Enhancements**
- Updated multiple components (`AddTemplate.vue`, `AddFunction.vue`,
`EditRole.vue`) to utilize the `QueryEditor` component, improving
editing functionality and user interface.
- Enhanced the `SearchBar.vue` component for better formatting and
language handling.
- **Bug Fixes**
- Adjusted the language attribute in the `SearchBar.vue` component from
"ruby" to "vrl" to ensure correct syntax highlighting.
- **Tests**
- Improved stability of the alerts test suite by adding a timeout after
user input actions.
- Added a timeout in the sanity test cases to enhance the reliability of
template submission.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Tests**
- Enhanced test coverage for schema functionalities, adding interactions
for log search and schema selection.
- Improved verification of `_timestamp` and `_all` fields to ensure
thorough validation of the schema selection process.
- Streamlined logging process by removing unnecessary console logging
during test execution.
- **Style**
- Improved formatting and readability in the `IndexList` component,
including adjustments to multiline expressions and conditional
renderings.
- Enhanced semantic clarity by restructuring template elements for
better organization and styling.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: omkark06 <omkar@zinclabs.io>
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Bug Fixes**
- Adjusted search functionality to prevent issues with results sorting
when clicking on alert-generated URLs.
- **Improvements**
- Modified control flow to enhance the stability of the search results
display.
- Updated test cases to reflect changes in query visibility conditions,
allowing for broader match criteria.
- Simplified test queries by removing unnecessary ordering, improving
test flexibility.
- Shifted focus of sanity test from `_timestamp` to `job`, aligning with
changes in expected UI output.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
Improved Period of derived stream to be same as frequency
Complete the `Frequency` task in the tracking issue #4170
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Summary by CodeRabbit
- **New Features**
- Introduced a new component for managing scheduled alerts with a tabbed
interface for custom alerts, SQL queries, and PromQL queries.
- Enhanced user experience with dynamic input fields, real-time
validation, and aggregation settings for alert conditions.
- Added cron job configuration options for scheduling alerts.
- **Changes**
- Renamed the scheduled alert component to reflect the new
functionality, impacting how the application handles alert triggering
and scheduling.
- Adjusted timing and frequency parameters for triggering conditions in
the alert management system.
- **Improvements**
- Enhanced logging functionality for monitoring enrichment data saving,
providing insights into operations and parameters involved.
- Improved error handling and response validation processes for
ingestion tasks, ensuring more informative logging and error reporting.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Taiming Liu <liutaiming3@gmail.com>
Co-authored-by: oasisk <ashish.j.kolhe@gmail.com>
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced dashboard functionality with user-defined schemas for better
data flexibility.
- Improved drag-and-drop capabilities for stream fields across various
dashboard components.
- Updated notifications and management of variable data in the add
panel.
- **Bug Fixes**
- Adjusted UI test case to reflect changes in visible text regarding
chart configuration updates.
- **Chores**
- Modified pagination settings in the Field List component for improved
performance.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
fix: #2369#3379#4090
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Summary by CodeRabbit
- **New Features**
- Introduced new UI components for managing organization settings with
validation.
- Added "View Logs" button functionality in the trace sidebar.
- Enhanced span logs management with new selection and viewing features.
- Added search capabilities for log stream selection in trace details.
- Added new routes for Trace Details and Organization Settings with
access control.
- **Improvements**
- Updated layout and styling for better user experience, including
full-width trace details.
- Integrated services for fetching trace metadata and log streams.
- Enhanced user feedback mechanisms for actions like copying trace URLs.
- Improved interactivity and responsiveness in span-related components.
- Refined navigation and routing for trace details and organization
settings.
- Improved error handling and state management in log fetching
functionalities.
- **Bug Fixes**
- Adjusted CSS to correct layout issues in trace details and sidebar
views.
- Improved test reliability in UI interaction testing by extending wait
times.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Subhradeep Chakraborty <chakrabortysubhradeep556@gmail.com>
Co-authored-by: Bhargav <BJP232004@GMAIL.COM>
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Adjusted the logs display settings to show fewer rows per page (from
250 to 100), enhancing navigation and making log entries more manageable
for users.
- **Bug Fixes**
- Updated test cases to reflect the change in pagination display,
ensuring consistency between the UI and the expected outcomes in tests.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
Now we use sql to plan to execute the query.
we split the PhysicalPlan to two stage:
1. Partial plan, it can be distributed will run on all the nodes.
2. Final plan, it can't be distributed will run on the leader querier
and merge the result.
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Updated to version 0.10.9, introducing enhancements and new
dependencies for improved data processing functionalities.
- Added new Protocol Buffers schemas to define structures for cluster
management and data processing frameworks, enhancing integration
capabilities.
- **Bug Fixes**
- Improved error handling in configuration to prevent runtime panics.
- Enhanced logic in caching mechanisms for more reliable query
responses.
- **Documentation**
- Added module declarations to improve organization and clarity within
the codebase.
- **Refactor**
- Streamlined execution plans and SQL processing for better performance
and maintainability.
- **Tests**
- Introduced new functions for log ingestion in test suites to enhance
reliability and coverage.
- **Style**
- Made formatting adjustments across various files to improve
readability and consistency.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Neha P <neha@openobserve.ai>
Co-authored-by: oasisk <ashish.j.kolhe@gmail.com>
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Expanded automated testing coverage by adding new UI test files for
dashboard management and logging visualization functionalities.
- Enhanced dashboard UI tests now cover creating, modifying,
duplicating, and applying filters to dashboards.
- Introduced tests for verifying user interactions with logging
visualizations, including error handling and data persistence.
- Added tests for Virtual Reference Language (VRL) features within the
dashboard, validating function applications and error handling.
- **Bug Fixes**
- Improved error handling in UI tests to ensure that invalid inputs
trigger appropriate error messages.
- **Tests**
- Comprehensive test cases implemented for various user interactions
across new features, ensuring functionality works as intended.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced a new boolean field to enhance log search functionality.
- **Improvements**
- Updated log search logic to include a timestamp column when
applicable.
- Enhanced UI elements for conditional rendering based on log search
criteria, improving clarity and relevance.
- **Tests**
- Updated UI testing scripts to reflect changes in focus from the
timestamp field to the job field, ensuring alignment with the updated
application interface.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Bug Fixes**
- Updated error messaging in the Logs UI to provide clearer feedback to
users when search queries fail.
- **Chores**
- Improved element selection specificity in Playwright tests to ensure
interactions with the correct UI elements.
- Upgraded dependencies to the latest versions for improved performance,
security, and compatibility.
- Excluded unnecessary directories from TypeScript compilation to
enhance project specificity and efficiency.
- Refined time zone handling across components for better accuracy in
date and time displays.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Neha P <neha@openobserve.ai>
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Bug Fixes**
- Improved reliability of histogram data loading by refining conditional
logic.
- Ensured `loadLogsData()` only runs when necessary, enhancing
performance and preventing unnecessary calls.
- **New Features**
- Enhanced control flow to check for query result hits before proceeding
with certain operations.
- **Tests**
- Introduced a delay in the UI test to improve the reliability of
visibility checks for error messages after refresh actions.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Updated URL generation for copying HTTP traces content in
OpenTelemetry component to improve accuracy.
- **Tests**
- Added a new test case to verify the display of results without
timestamps in quick mode.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Bug Fixes**
- Improved caching behavior and response processing in search requests.
- Enhanced error handling and response generation for better user
experience.
- **Tests**
- Disabled specific UI interaction in Playwright tests to prevent test
failures.
- **Chores**
- Updated configuration defaults to improve clarity and efficiency.
- Made internal constants publicly accessible for broader usage.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- Visualize the logs data
- Save these visualizations to the dashboard
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced a new `SelectDashboardDropdown` component for selecting and
adding dashboards from a dropdown list.
- Added a `SelectTabDropdown` component for selecting and managing tabs
within a dashboard.
- **Enhancements**
- Added conditional rendering for folder selection in the `AddDashboard`
component.
- Improved handling and validation for `activeFolderId` and
`showFolderSelection` props.
- Enhanced `PanelSchemaRenderer` to handle null or undefined values more
gracefully.
- Updated various components to use dependency injection for
`dashboardPanelDataPageKey`.
- **Bug Fixes**
- Removed unnecessary `click()` actions in multiple UI test scripts to
streamline test flows.
- Fixed various selector and conditional rendering issues in UI
components for better stability and performance.
- **Refactor**
- Refactored `QueryEditor` to include a nullish check, improving
stability.
- Restructured `DashboardQueryEditor` for better maintainability and
clarity.
- Adjusted import statements and removed unused dependencies across
multiple components.
- **Style**
- Adjusted styles and button functionalities in `SearchBar` for a more
intuitive user experience.
- **Tests**
- Updated and streamlined Playwright tests to remove redundant actions
and improve efficiency.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: omkark06 <omkar@zinclabs.io>
Co-authored-by: ktx-vaidehi <vaidehi.akhani@kiara.tech>
Co-authored-by: Neha P <neha@openobserve.ai>
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced text snippet suggestions in the Query Editor with updated
labels and insert text.
- Introduced new functions for advanced search and matching operations
in the Query Editor.
- **Improvements**
- Improved search instructions for 'error' values in the Syntax Guide,
including clarifications on case sensitivity.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Taiming Liu <liutaiming3@gmail.com>
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced dashboard folder management with improved layout and
functionality for editing and deleting folders.
- Added icons and labels for better user interaction.
- **Bug Fixes**
- Updated selectors in UI tests for more reliable dashboard folder
interactions.
- **Style**
- Improved visual consistency with updated CSS for folder items,
including better alignment and transitions.
- **Tests**
- Refined UI tests to ensure accurate folder interaction in the
dashboard.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: ktx-abhay <abhay.padamani@kiara.tech>
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Bug Fixes**
- Enhanced error messages for better clarity during SQL syntax errors
and data retrieval issues.
- **Tests**
- Updated UI test cases to reflect more descriptive error notifications
in the logs page.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Improved search functionality with enhanced error handling and updated
date-based search parameters.
- **Style**
- Updated styles for `h5` and `h6` elements to refine font size, weight,
line height, letter spacing, and margins.
- **Tests**
- Enhanced UI tests to include additional timeouts and refined click
actions for improved test reliability.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Bhargav <BJP232004@GMAIL.COM>
Skipping 2 tests under sanity
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Tests**
- Skipped two test cases in the sanity test suite.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Tests**
- Introduced an end-to-end test for SQL query caching to improve
reliability.
- Modified a UI test description and marked it as skipped for future
refinement.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Bug Fixes**
- Updated logic in log details to ensure specific elements display
correctly based on stream selection.
- **Tests**
- Improved test reliability by checking element disabled status instead
of performing multiple click actions.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Neha P <neha@openobserve.ai>
- Added stream multiselect tests
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Tests**
- Enhanced UI tests for the login process and multistream selection
logic.
- Adjusted element interactions, timeouts, and added verification steps
in multistream selection tests.
- Included the multiselect stream test in the Playwright workflow
configuration.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Improvements**
- Enhanced the date/time handling in the log search feature for more
accurate start time calculations.
- **Tests**
- Improved reliability of UI tests by forcefully clicking elements in
specific scenarios.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: oasisk <ashish.j.kolhe@gmail.com>
- Fixed breaking schema testcase due to logs max query range changes
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Tests**
- Enhanced login function tests with additional timeouts and
interactions with date-time elements and log search buttons.
- Adjusted timeouts for waiting during login and dropdown selection
operations in sanity tests.
- **Chores**
- Updated environment variables configuration in Playwright workflow.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced multi-select stream functionality in UI, allowing users to
select and query multiple data streams simultaneously.
- Added new search functions to handle multiple streams of data and
provide aggregated search results.
- **Bug Fixes**
- Corrected UI test cases to improve selection and verification of
stream names.
- **Enhancements**
- Improved search functionalities and error handling within the logs
plugin interface.
- Enhanced stream handling and validation in the search feature.
- **Tests**
- Added new Playwright test cases for stream multi-select functionality.
- Updated existing test cases to adapt to new multi-select stream logic.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Neha P <neha@openobserve.ai>
Co-authored-by: Neha P <144308844+neha00290@users.noreply.github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
Co-authored-by: Subhradeep Chakraborty <chakrabortysubhradeep556@gmail.com>
Fix breaking schema testcase
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Tests**
- Improved the reliability of UI tests by updating the method used to
locate and click on elements based on text content in Playwright tests.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- issue while passing timestamp for table chart drilldown.
- use different unit type for large numbers.

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Added a "numbers" option in the ConfigPanel for dashboards.
- **Improvements**
- Enhanced column formatting to handle histogram fields more
effectively.
- Renamed `largeNumbers` to `numbers` for better clarity in unit
handling.
- **Bug Fixes**
- Improved `getUnitValue` function to check for `NaN` values and empty
strings before processing.
- **Localization**
- Added a new key-value pair `"numbers": "Numbers"` to the English
locale.
- **Tests**
- Removed unnecessary force option from a Playwright test click action
to improve test stability.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
Fixed function breaking testcase under logs
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Tests**
- Updated UI test selectors for the logs page to improve accuracy and
reliability.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Bug Fixes**
- Improved spacing in error handling to enhance code readability.
- **New Features**
- Enhanced search functionality with additional parameters for more
precise results.
- Dynamically added columns based on specific conditions to improve data
visualization.
- **Tests**
- Updated UI tests to ensure compatibility with the new search and
column addition features.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Neha P <neha@openobserve.ai>
- Verify if table type dashboard is created
- Verify if timezone selected as Asia/Calcuta and timestamp on UI is as
per selected timezone
- Verify if user is able to change timezone to Europe/Zurich
- Verify if the timezone is updated to changed timezone
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced timestamp comparison tests across different timezones on
dashboards.
- **Tests**
- Added new helper functions for test cases to streamline request
sending and timestamp formatting.
- Cleaned up and optimized existing test cases by removing unused and
commented-out code.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: ktx-abhay <abhay.padamani@kiara.tech>
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Refactor**
- Improved handling and parsing of SQL queries for better performance
and reliability.
- Simplified logic for timestamp handling and query parsing.
- **Bug Fixes**
- Fixed issues with error notifications related to SQL orderby and
timestamp requirements.
- **New Features**
- Added dynamic column addition to the result grid based on SQL mode and
selected fields.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Neha P <neha@openobserve.ai>
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Added new test cases for checking JSON responses with timestamps and
assertions for response statuses.
- **Bug Fixes**
- Updated query functions for stream exploration to improve accuracy.
- **Chores**
- Added a new environment variable `ZO_INGEST_ALLOWED_UPTO` with a value
of `5`.
- **Tests**
- Enhanced UI tests with new functions and assertions to improve test
coverage and reliability.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced SQL query manipulation and result processing in the logs
functionality.
- Improved handling of aggregation flags in the logs.
- **Bug Fixes**
- Adjusted logic for calculating total query results to ensure accurate
data representation.
- **Tests**
- Added UI tests for resetting filters, refreshing the page, and
interacting with elements in SQL mode.
- **Chores**
- Commented out `loadLogsData()` function call in the logs module to
optimize performance.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- Verify pagination displayed for schema
- Verify pagination displayed when histogram is off and user clicks on
log result and closes the result
- Verify if pagination is displayed when SQL is on and user clicks on
log result and closes the result
- Verify if results displayed when SQL+histogram is on and then stream
is selected
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced login process to improve user authentication flow.
- Added pagination functionality for better navigation through results
in various scenarios.
- Improved display of results when SQL and histogram features are used
together.
- Enhanced user interface for selecting streams and displaying
corresponding results.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- Verify if user is able to create and delete Once - type report
- Verify if user is able to create and delete Hourly - type report
- Verify if user is able to create and delete weekly- type report
- Verify if user is able to create and delete monthly - type report
- Verify if user is able to create a new dashboards for all the reports
and delete it
- Verify if user is able to delete all the reports after creating
Testcases for the following scenarios -
- Verify if user is able to create stream with empty name
- Verify if user navigates to logs and selects empty name stream and
then selects a stream with fields, all the data should load
- Verify if user is able to add field
- Verify if user is able to delete field
- Added match all and match all index query time taken comparison
- Added match all ignore cases and match_all_indexed_ignore_case time
take comparions
- Add settings page sanity
- Add refresh stats cases on page reload
- Added more cases under logs for sanity
**Testcases covered**
- Create an area type dashboard
- Take a screenshot of this dashboard
- Compare this image with an existing image
- Delete the panel
- Delete the dashboard
Automation for below scenarios-
- Verify if Add to defined schema fields is displayed on UI
- Verify if on clicking the checkbox for items, the button gets enabled
- Verify on adding on user defined schema the selected fields are
displayed.
- Verify after updating these settings user is able to navigate to
stream via stream explorer
- Verify if user is able to click on log search results after updating
schema settings
- Verify if the updated schema displayed under results as ALL post new
data ingestion
- Verify if user is able to remove the fields and update the settings
- Verify after removing, the fields do not display under all in UI
Tests for following scenarios
- Verify if user is able to view region tab
- Verify if user is able to click on region tab
- Verify if 2 options displayed under region tab
- Verify if 1 Region saved under saved view is displayed when the view
applied
- Verify if user is able to select stream explorer and click on saved
view only 1 selected option to be displayed
- Verify if saved view is deleted after adding only1 region should click
on region, change
Automation for bug - #3480
-Logs: Blank page displayed after user adds a function on logs page,
clicks on any log result and then selects search around