Commit Graph
165 Commits
Author SHA1 Message Date
Hengfei Yang b9435e5992 fix: max query range should be hour (#5333) 2024-12-11 19:15:26 +08:00
Hengfei Yang e65774403a ci: build node on windows (#5332) 2024-12-11 17:30:03 +08:00
Hengfei Yang 276595954d ci: build node on windows (#5331) 2024-12-11 17:10:11 +08:00
dependabot[bot] c9881c3c4e chore(deps): bump EmbarkStudios/cargo-deny-action from 2.0.2 to 2.0.4 (#5304) 2024-12-10 13:16:30 +08:00
ShyamOOAI 6f52dc444d test: Change Org (#5201)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Introduced comprehensive UI testing for the Home, Ingestion, Login,
Logs, Metrics, Traces, Pipelines, Rum, Dashboard, Alerts, Reports, Data,
IAM, and About pages.
- Added functionality to handle organization changes and validations
across multiple pages, including default organization selections.
- New test suite for validating organization change scenarios across
various pages.
	- Enhanced login functionality for internal users.
- Introduced new classes and methods for the Metrics, Streams, Rum, and
Alerts pages to support UI testing.
- Added new classes for the Data and IAM pages, expanding testing
capabilities.
	- Enhanced Management page with navigation and validation capabilities.
- New methods for validating page URLs and content across various pages.

- **Bug Fixes**
- Improved validation methods to ensure proper navigation and content
checks on various pages.

- **Documentation**
- Updated testing framework to include new test cases and improved
structure for organization change tests.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-12-04 11:01:16 +05:30
Taiming Liu d0de874cf4 fix: pipeline condition node incorrect evaluation (#5219)
fix #5218 

Backend:
- [x] allow condition node to evaluate `null` and `""`, empty, for both
`=` and `!=` conditions
- [x] stop ingestion when resolved dynamic stream name is empty

**How to Use(In ConditionNode):**
To evaluate field value is not empty:
`app_name != ""` 
To evaluate field value is not null:
`app_name != null`
2024-12-02 17:12:03 -08:00
ShyamOOAI 28319bdac3 test: Update coverage report (#5107)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced `LogsPage` with improved date and time selection, timezone
management, and clipboard operations.
- Introduced `ManagementPage` for UI testing, allowing logo updates and
management functionalities.
- Added new tests for time zone changes and streamlined test scenarios
on the logs page.
- Introduced a suite of tests for joining logs, validating various join
scenarios.

- **Bug Fixes**
- Updated confirm button interaction in `ReportsPage` to ensure
visibility before clicking.

- **Documentation**
- Improved clarity and purpose of test scenarios through restructuring
and simplification.

- **Chores**
- Added `logoManagement.spec.js` and `join.spec.js` to the Playwright UI
integration tests for expanded coverage.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-29 05:54:29 +05:30
dependabot[bot] db1867c317 chore(deps): bump thehanimo/pr-title-checker from 1.4.2 to 1.4.3 (#5147) 2024-11-26 11:21:52 +08:00
dependabot[bot] bbe05ca5ab chore(deps): bump EmbarkStudios/cargo-deny-action from 2.0.1 to 2.0.2 (#5148) 2024-11-26 11:21:30 +08:00
Hengfei Yang d6487eb9fe ci: update rust version (#5143) 2024-11-25 19:20:07 +08:00
ktx-akshayandktx-vaidehi c5b60c3aaf test: dashboard vrl testcases (#4130)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Enhanced Playwright test suite for dashboard functionalities,
including comprehensive tests for VRL functions, dashboard settings, and
data validation.
- Added new test cases for creating, deleting, and updating dashboards,
as well as applying dynamic filters.
- Introduced automation for the login process and improved the
validation of user inputs in dashboard tests.

- **Bug Fixes**
- Improved error handling and visibility checks in dashboard tests to
ensure user inputs are validated correctly.

- **Chores**
- Updated import statements across multiple test files to utilize a
local module for better fixture management.
- Added a new test file for VRL visualization tests to expand
integration coverage.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: ktx-vaidehi <vaidehi.akhani@kiara.tech>
2024-11-14 19:16:17 +05:30
Neha P be8a00f543 test: e2e-pipeline-testcases (#5017)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced a new `PipelinePage` class for enhanced UI testing of the
pipeline management interface.
- Added a comprehensive suite of Playwright tests to validate pipeline
creation, editing, and deletion functionalities.

- **Bug Fixes**
- Corrected the test filename in the workflow configuration to align
with naming conventions.

- **Chores**
- Removed the outdated `pipeline.spec.js` test file to streamline the
testing suite.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-13 17:35:21 +05:30
Omkar Kesarkhane cb21395382 fix: e2e test coverage setup (#4897)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Added support for code coverage reporting with the integration of
`vite-plugin-istanbul`.
	- Introduced a new configuration file for code coverage settings.

- **Improvements**
	- Updated project to use ECMAScript modules for better compatibility.
- Enhanced UI test coverage with additional test cases and improved
error handling.
- Refactored test suites to utilize a custom module for better
organization and maintainability.
- Improved the login process and dashboard loading in test cases for
better reliability.

- **Bug Fixes**
- Resolved issues related to import statements affecting test execution.

- **Documentation**
- Updated `.gitignore` to exclude coverage directories from version
control.

These updates enhance the functionality, maintainability, and
reliability of the application and its testing framework.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-13 15:13:36 +05:30
ktx-vaidehi 8456ae5ecf test: dashboard settings (#4990)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Introduced multiple new test files for dashboard functionalities,
including settings for variables, tabs, and general settings.
- Enhanced testing capabilities with new test cases covering various
scenarios for managing dashboard elements.

- **Improvements**
- Added `data-test` attributes to various UI components across multiple
files, improving testability for automated testing.

- **Bug Fixes**
- Updated import paths for JSON data files to ensure proper referencing
in tests, enhancing overall test reliability.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-13 10:44:13 +05:30
ShyamOOAI edbb812116 test: e2e test case for report (#4977)
test case report e2e

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Added a new test suite for report functionalities, including creating
and deleting dashboards and reports.
- Introduced a new `IngestionPage` class for handling data ingestion
through an API.
- Enhanced `DashboardPage` with improved dashboard creation and deletion
processes.
- Updated `ReportsPage` to support report creation and verification with
new methods.

- **Bug Fixes**
- Improved element selection methods for better reliability in the login
process.

- **Documentation**
- Streamlined import statements and improved code organization for
better readability.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-06 13:58:23 +05:30
ktx-akshayandktx-vaidehi 0ca6524994 test: dashboard table transpose (#4925)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced test coverage for dashboard UI with new Playwright tests
focusing on the transpose feature and dynamic columns.
- Added `data-test` attributes to various components in the General
Settings for improved testability.

- **Bug Fixes**
- Improved consistency in the GitHub Actions workflow configuration for
UI tests.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: ktx-vaidehi <vaidehi.akhani@kiara.tech>
2024-11-04 16:58:13 +05:30
ShyamOOAIandNeha P 711dd00978 fix: E2e seconds precision updated (#4770)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced new UI testing classes for various application pages,
including `AlertsPage`, `DashboardPage`, `LogsPage`, `ReportsPage`,
`TracesPage`, and `LoginPage`.
- Added a new test suite focusing on time-related features across
multiple pages.

- **Bug Fixes**
- Improved consistency in the GitHub Actions workflow for UI integration
tests.

- **Documentation**
- Enhanced organization of locators and methods for better usability in
UI testing.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Neha P <144308844+neha00290@users.noreply.github.com>
2024-10-21 18:55:38 +05:30
Neha P 05a84d3009 test: e2e logs search history (#4746)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced new test cases for the search history feature, enhancing
verification of navigation between the search history and logs pages.
- **Chores**
- Added new environment variables `ZO_FILE_PUSH_INTERVAL`,
`ZO_USAGE_BATCH_SIZE`, `ZO_USAGE_PUBLISH_INTERVAL`, and
`ZO_USAGE_REPORTING_ENABLED` to the Playwright workflow configuration.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-10-10 15:14:08 +05:30
Neha P 2b13a4ce7b test: unflattened testcases (#4704)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced a new suite of UI tests for a logging application,
enhancing testing coverage.
- Added functionality to automate user login and data ingestion
processes within the tests.
- Implemented a test case to toggle settings and verify UI interactions.

- **Bug Fixes**
- Expanded the test file list to include additional scenarios for more
comprehensive testing.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-10-04 09:00:35 +05:30
Hengfei Yang d1ed457369 feat: new search engine (#4182) 2024-09-20 15:10:54 +08:00
Yashodhan JoshiandYashodhan Joshi d5a628fc59 ci: fix cargo-deny config (#4444)
This fixes the `deny.toml` config file to work with the v2 of
cargo-deny. This does not change any deps, and adds any exceptions or
permissions in `deny.toml` to make the existing deps pass the action. We
can take a look and clean dependencies if needed in a separate PR.

This also updates the CI file to run on any changes in `deny.toml` and
CI yaml file itself as well.

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced GitHub Actions workflow to trigger on changes to relevant
configuration files, improving responsiveness to updates.
- Restructured license management strategy, allowing more flexibility
with specific licenses and exceptions for various dependencies.

- **Bug Fixes**
- Removed outdated settings related to vulnerabilities and unmaintained
packages, simplifying the advisories section.

- **Chores**
- Cleaned up the configuration file by removing unnecessary entries and
commenting out the disallowed licenses.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

Signed-off-by: Yashodhan Joshi <yjdoc2@gmail.com>
Co-authored-by: Yashodhan Joshi <yjdoc2@gmail.com>
2024-09-03 17:11:53 +05:30
dependabot[bot] cda7901f52 chore(deps): bump actions/github-script from 6 to 7 (#4438) 2024-09-03 09:57:14 +08:00
Prabhat Sharma ff2bedbf19 chore: Delete spam issue comments containing mediafire (#4349)
Delete spam comments containing "mediafire"

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Introduced an automated workflow to identify and delete spam comments
containing "Mediafire" in issue threads, enhancing the cleanliness of
discussions.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-27 05:30:34 -07:00
Omkar KesarkhaneandSai Nikhil bafbd205d4 feat: logs tables performance optimization (#4097)
fix #3973 
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **New Features**
- Introduced a new dynamic table component for enhanced data display and
interaction.
- Added support for Tailwind CSS, improving styling capabilities across
the application.
- Implemented interactive controls for managing log entries in the data
table.

- **Improvements**
- Enhanced logging functionality with clearer error messaging, improved
content wrapping, and optimized selection of log fields based on user
input.
- Streamlined user interface in the JSON preview and search result
components for better usability and readability.
	- Improved performance and responsiveness of the search results table.
- Refined column visibility management in the search results, enhancing
user experience.

- **Bug Fixes**
- Updated column management logic in the search results for improved
robustness.
- Enhanced reliability of Playwright tests by refining timing and
interaction steps.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Sai Nikhil <nikhil@openobserve.ai>
2024-08-26 16:59:43 +05:30
Hengfei Yang 564ac641a8 fix: should exit when backend init failed (#4138) 2024-08-07 14:47:50 +08:00
dependabot[bot] 050dc61179 chore(deps): bump EmbarkStudios/cargo-deny-action from 1.6.3 to 2.0.1 (#4119) 2024-08-05 23:26:04 +08:00
df2488fa44 feat: optimize sql to plan execution (#4100)
Now we use sql to plan to execute the query. 

we split the PhysicalPlan to two stage:
1. Partial plan, it can be distributed will run on all the nodes.
2. Final plan, it can't be distributed will run on the leader querier
and merge the result.

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **New Features**
- Updated to version 0.10.9, introducing enhancements and new
dependencies for improved data processing functionalities.
- Added new Protocol Buffers schemas to define structures for cluster
management and data processing frameworks, enhancing integration
capabilities.

- **Bug Fixes**
  - Improved error handling in configuration to prevent runtime panics.
- Enhanced logic in caching mechanisms for more reliable query
responses.

- **Documentation**
- Added module declarations to improve organization and clarity within
the codebase.

- **Refactor**
- Streamlined execution plans and SQL processing for better performance
and maintainability.

- **Tests**
- Introduced new functions for log ingestion in test suites to enhance
reliability and coverage.

- **Style**
- Made formatting adjustments across various files to improve
readability and consistency.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Neha P <neha@openobserve.ai>
Co-authored-by: oasisk <ashish.j.kolhe@gmail.com>
2024-08-05 18:38:35 +08:00
ktx-akshay 355591cbef test: testcases for visualization functionality (#4061)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Expanded automated testing coverage by adding new UI test files for
dashboard management and logging visualization functionalities.
- Enhanced dashboard UI tests now cover creating, modifying,
duplicating, and applying filters to dashboards.
- Introduced tests for verifying user interactions with logging
visualizations, including error handling and data persistence.
- Added tests for Virtual Reference Language (VRL) features within the
dashboard, validating function applications and error handling.

- **Bug Fixes**
- Improved error handling in UI tests to ensure that invalid inputs
trigger appropriate error messages.

- **Tests**
- Comprehensive test cases implemented for various user interactions
across new features, ensuring functionality works as intended.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-05 14:26:57 +05:30
Hengfei Yang 7b5524290e ci: run js license check (#4053) 2024-07-25 12:07:38 +08:00
Hengfei Yang 0291e39bd5 ci: remove mimalloc on windows (#3951) 2024-07-11 11:02:31 +08:00
Ankur Srivastava c890ceb932 feat: parallelize the tests (#3930)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **Chores**
  - Reorganized the workflow jobs for better structure and efficiency.
  - Renamed the `ui_integration_tests` job to `build_binary`.
- Added steps to upload and download artifacts with defined path and
retention settings.
- Included a step to clone the current repository using
actions/checkout.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-07-09 14:14:45 +02:00
dependabot[bot] 8e627cc1da chore(deps): bump eifinger/setup-rye from 3 to 4 (#3925) 2024-07-09 12:20:03 +08:00
Hengfei Yang 03f1b192c2 feat: ugprade rust to 2024-07-07 (#3922) 2024-07-08 20:56:56 +08:00
Huaijin 5572cb3e72 perf: disable repartition when sort by timestamp desc (#3918) 2024-07-08 19:05:34 +08:00
Taiming Liu 842dbdb647 fix: unnecessary null field during compaction (#3917) 2024-07-08 17:43:39 +08:00
Neha P 315d2c54c6 test: e2e-stream-multiselect (#3831)
- Added stream multiselect tests

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Tests**
- Enhanced UI tests for the login process and multistream selection
logic.
- Adjusted element interactions, timeouts, and added verification steps
in multistream selection tests.
- Included the multiselect stream test in the Playwright workflow
configuration.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-06-26 16:11:32 +05:30
Neha PandHengfei Yang 406ddb1384 test: e2e schema test fix (#3811)
- Fixed breaking schema testcase due to logs max query range changes

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **Tests**
- Enhanced login function tests with additional timeouts and
interactions with date-time elements and log search buttons.
- Adjusted timeouts for waiting during login and dropdown selection
operations in sanity tests.
- **Chores**
  - Updated environment variables configuration in Playwright workflow.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
2024-06-25 14:23:29 +05:30
dependabot[bot] c156e68a07 chore(deps): bump docker/build-push-action from 5 to 6 (#3753) 2024-06-18 23:17:47 +08:00
Hengfei Yang 611f2e1c29 perf: improve ingestion (#3678) 2024-06-12 22:01:03 +08:00
Neha P c15a4acc48 test: e2e-backfill-logdata (#3663)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Added new test cases for checking JSON responses with timestamps and
assertions for response statuses.

- **Bug Fixes**
  - Updated query functions for stream exploration to improve accuracy.

- **Chores**
- Added a new environment variable `ZO_INGEST_ALLOWED_UPTO` with a value
of `5`.

- **Tests**
- Enhanced UI tests with new functions and assertions to improve test
coverage and reliability.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-06-03 13:09:42 +05:30
Hengfei Yang 569bb121ce feat: add new node role flatten_compactor (#3589) 2024-05-30 18:34:41 +08:00
abe6206361 fix: logs page histogram optimisation (#3586)
Co-authored-by: Bhargav <BJP232004@GMAIL.COM>
Co-authored-by: omkark06 <omkar@zinclabs.io>
2024-05-25 18:57:48 +05:30
Neha P 4ccb02c081 test: e2e-reports-testcases (#3571)
- Verify if user is able to create and delete Once - type report
- Verify if user is able to create and delete Hourly - type report
- Verify if user is able to create and delete weekly- type report
- Verify if user is able to create and delete monthly - type report
- Verify if user is able to create a new dashboards for all the reports
and delete it
- Verify if user is able to delete all the reports after creating
2024-05-23 19:12:57 +05:30
dependabot[bot] af00810f00 chore(deps): bump eifinger/setup-rye from 2 to 3 (#3503) 2024-05-22 21:21:41 +08:00
Hengfei Yang d84726e5db refactor: merge parquet files interface (#3547)
Prepare for vertical partition compact, change the interface first.
2024-05-20 15:31:25 +08:00
Neha P e1380c7a5e test: add-dashboard-image-tests (#3510)
**Testcases covered** 
- Create an area type dashboard
- Take a screenshot of this dashboard
- Compare this image with an existing image 
- Delete the panel
- Delete the dashboard
2024-05-14 18:06:04 +05:30
Neha P 4d7cc602dc test: e2e-user-defined-schema (#3494)
Automation for below scenarios-

- Verify if Add to defined schema fields is displayed on UI
- Verify if on clicking the checkbox for items, the button gets enabled
- Verify on adding on user defined schema the selected fields are
displayed.
- Verify after updating these settings user is able to navigate to
stream via stream explorer
- Verify if user is able to click on log search results after updating
schema settings
- Verify if the updated schema displayed under results as ALL post new
data ingestion
- Verify if user is able to remove the fields and update the settings
- Verify after removing, the fields do not display under all in UI
2024-05-12 21:16:57 +05:30
Neha P 4f42c98253 test: e2e-region-testcases (#3490)
Tests for following scenarios
- Verify if user is able to view region tab
- Verify if user is able to click on region tab
- Verify if 2 options displayed under region tab
- Verify if 1 Region saved under saved view is displayed when the view
applied
- Verify if user is able to select stream explorer and click on saved
view only 1 selected option to be displayed
- Verify if saved view is deleted after adding only1 region should click
on region, change
2024-05-12 14:13:17 +05:30
Ankur Srivastava a8346c20ea ci: generate meaningful commit run-ids (#3474) 2024-05-10 19:31:58 +02:00
Neha P 2135fc1a3d test: e2e-pipeline-testcases (#3472)
- Function creation and deletion for pipeline changes (bug fix)
- Created a function for pipeline delete
#3464
2024-05-10 19:38:41 +05:30