Commit Graph
1259 Commits
Author SHA1 Message Date
Bhargav fc9565bf10 fix: org selection and change organization flow (#5140)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Enhanced organization selection and user authentication processes in
the login component.
- Improved session management with a new method for token refresh
timing.
- Conditional rendering for error messages and search results in the
logs component.

- **Bug Fixes**
- Robust error handling for user login, ensuring better feedback for
invalid credentials.
	- Improved error handling and user feedback in the logs component.

- **Refactor**
- Updated organization handling logic to support more complex data
structures and improve user context management during login.
- Enhanced logic flow and state management in the logs component for a
better user experience.

- **Documentation**
- Minor formatting changes for improved readability in the login
component template.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-26 10:22:09 +05:30
Bhargav d276115538 fix: Interesting field desection (#5129)
#5073 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Enhanced SQL query handling for interesting fields in the logs
component.
- Improved search bar functionality to generate tailored SQL queries for
multiple streams.

- **Bug Fixes**
- Adjusted logic for handling filters to ensure accuracy in generated
SQL queries.

- **Documentation**
- Updated method signatures to reflect changes in parameters and
functionality.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-25 13:34:47 +05:30
Bhargav 94006a0b96 fix: consider the org identifier from url (#5138)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced organization selection process, allowing for identification
via URL parameters.
  - Improved prompts for data ingestion initiation when necessary.

- **Bug Fixes**
- Refined logic for setting the selected organization based on local or
URL data.
- Strengthened verification of organization data ingestion before
navigation.

- **Style**
- Minor adjustments to template structure and styling for better user
experience.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-25 11:26:42 +05:30
Bhargav b05866e3aa fix: set organization details on organization change (#5135)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced organization selection process with improved state
management.
- Added a method to ensure the selected organization is accurately
reflected based on query parameters and local storage.

- **Bug Fixes**
- Added logic to verify associated streams for selected organizations,
ensuring accurate data ingestion status.

- **Style**
	- Minor styling adjustments to maintain layout consistency.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-25 09:40:53 +05:30
Taiming LiuandSai Nikhil b011d8a93d feat: allow dynamic stream name in pipeline destinations (#5007)
impl #4968 

## How to use
When using pipeline to configure/modify data ingestion, users can set
the destination `Stream` dynamically based on the records that are being
ingested now.

When configuring the destination stream in pipeline editor, instead of
selecting any existing streams from the dropdown or creating a new
stream, one can use `{}` to wrap _**flattened**_ `field_name`, the value
of such field will be the final destination stream.


Co-authored-by: Sai Nikhil <nikhil@openobserve.ai>
2024-11-22 06:19:00 -08:00
Bhargav 4f9c1dc359 fix: Interesting field selection join query (#5125)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced error handling for search queries, providing clearer feedback
to users.
	- Improved logic for resetting SQL query parameters in the search bar.
- Added new functions for filtering fields and constructing queries
based on selected streams.
	- Introduced a standardized SQL query format with `QUERY_TEMPLATE`.

- **Bug Fixes**
- Adjusted conditions for displaying error messages, ensuring
appropriate prompts for users.

- **Refactor**
- Streamlined control flow in data fetching and error handling methods
for better predictability.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-22 15:17:24 +05:30
Sai Nikhil 860e705504 fix: Pipeline minor improvements (#5120)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Enhanced user feedback during function deletions by displaying
associated pipelines or a message when none are linked.
- Improved pipeline management functionality, including state toggling
notifications and refined deletion processes.

- **Bug Fixes**
- Streamlined the fitting view logic for the VueFlow component, ensuring
proper rendering of nodes and edges.

- **Improvements**
- Simplified data filtering and expanded row logic for better user
experience in the pipeline list.
- Adjusted the deletion dialog to accurately reflect the current state
of associated pipelines.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-22 12:28:19 +05:30
3c37c272b5 fix: join & subquery related UI changes on logs page (#5055)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Enhanced SQL query handling for multiple streams in logging
functionality.
- Added visual feedback for the "Visualize" button based on selected
streams.
	- Introduced organization management improvements in the login process.
	- New utility function for array comparison added for improved logic.
	- Added a new action to the Vuex store for setting user information.

- **Bug Fixes**
- Improved error handling and display for SQL query construction and
organization data fetching.

- **Documentation**
- Updated comments and structure in various components for better
readability and maintainability.

- **Chores**
- Minor formatting and style adjustments across multiple files for
consistency.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Abhay Padamani <141122205+ktx-abhay@users.noreply.github.com>
Co-authored-by: ktx-abhay <abhay.padamani@kiara.tech>
Co-authored-by: hengfei yang <hengfei.yang@gmail.com>
Co-authored-by: Huaijin <haohuaijin@gmail.com>
2024-11-22 10:12:16 +05:30
Sai Nikhil b370371408 fix: pipeline custom edge fix (#5102)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
  - Introduced a new "promql" tab for metrics in scheduled pipelines.
  - Added a toggle for a VRL function editor.
  - Enhanced edge rendering with a new `CustomEdge` component.
- Compact table view for the pipeline list with a new `dense` attribute.

- **Improvements**
  - Improved validation and error handling for SQL and PromQL queries.
  - Enhanced logic for stream selection and filtering.
- Refined edge type handling and visual representation in the pipeline
editor.
  - Updated initial viewport settings for better user experience.
- Enhanced aggregation settings and dynamic updates to group-by columns.

- **Bug Fixes**
- Fixed row expansion behavior for real-time pipelines in the pipeline
list.

- **Style**
- Adjusted CSS styles for new layouts and functionalities across
components.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-21 18:01:46 +05:30
ktx-vaidehiandktx-abhay 806444f2c7 fix: dashboard css & stream select in add panel issue (#5091)
- #5089 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Introduced a new property, `streamResultsType`, to enhance data
handling in the dashboard panel.
- Dynamic button styling based on the application's theme in the Query
Type Selector component.

- **Bug Fixes**
- Improved error handling for field extraction to ensure correct fields
are loaded based on stream type.

- **Chores**
	- Updated CSS for button styling to support dynamic theming.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: ktx-abhay <abhay.padamani@kiara.tech>
2024-11-20 18:34:04 +05:30
ktx-vaidehi 98429ca0fa feat: allow limit in query to have dynamic variables (#5076)
- #5063 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
	- Enhanced dynamic handling of SQL queries for improved flexibility.
	- Improved error reporting for invalid SQL syntax.
- Added validation mechanism for SQL queries to ensure syntactical
correctness.
	- Introduced a function to extract unique variables from SQL queries.

- **Bug Fixes**
- Refined logic for updating custom query fields to ensure correct
population and validation.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-19 18:28:57 +05:30
Bhargav bbb8aa9b9b fix: refactoring organization handling (#5074)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced a reactive variable for organization data, improving state
management.
- Updated functionality to accept an object for organization data,
enhancing input validation and handling.

- **Bug Fixes**
- Enhanced error handling for better debugging without altering existing
functionality.

- **Refactor**
- Improved readability and maintainability of the layout component with
formatting adjustments and refined logic.
- Updated test cases to reflect changes in URL structure for
consistency.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-19 17:13:38 +05:30
ktx-vaidehi 1295daec69 feat: dashboard geojson map (#3023)
- #4825 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Introduced new `MapsRenderer` component for enhanced map
visualizations.
  - Added support for selecting map types in the configuration panel.
  - New dashboard components for managing map queries and data.
  - Added new fields for map configurations, including names and values.

- **Improvements**
  - Enhanced chart selection options, including new map-related types.
  - Updated localization for better support of map functionalities.
  - Improved handling of field aliases in the panel schema.
- Enhanced functionality for adding map names and values within the
dashboard.
  - Refined drag-and-drop functionality for map fields.
- Enhanced data validation and error handling in map-related components.

- **Bug Fixes**
- Improved error handling and data validation in map-related components.

- **Chores**
  - Updated component names and structure for consistency.
  - Enhanced internal methods for better data handling and processing.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-19 16:22:18 +05:30
Juan Calderon-Perez fcb864356a fix: Simplify recommended setup for Elastic Beats (#5083) 2024-11-18 11:12:36 +08:00
Prabhat Sharmaandomkark06 1ca280e648 feat: Add new CRDs (#5071)
Add scrapeconfigs nad probes CRDs

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced the Kubernetes configuration with dynamic command properties
for improved maintainability.
- Introduced a search input field in the Recommended component for
filtering displayed tabs in real-time.
- Implemented dynamic rendering of tabs based on user input, improving
usability and accessibility.

- **Bug Fixes**
	- Corrected command syntax for installing existing CRDs.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: omkark06 <omkar@zinclabs.io>
2024-11-15 12:05:36 +05:30
Sai Nikhil 36e0d2e479 fix: Search history disable when usage report disabled (#5048)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced conditional rendering for search history based on usage
settings.
- Added a user-friendly message and navigation button when search
history is not enabled.

- **Bug Fixes**
- Improved navigation by implementing a method to redirect users back to
the logs page.

- **Localization**
- Added a new message for navigating back to the logs page in the
English language support.

- **Style**
	- Minor formatting adjustments for better readability in the template.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-13 19:24:11 +05:30
Omkar Kesarkhane cb21395382 fix: e2e test coverage setup (#4897)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Added support for code coverage reporting with the integration of
`vite-plugin-istanbul`.
	- Introduced a new configuration file for code coverage settings.

- **Improvements**
	- Updated project to use ECMAScript modules for better compatibility.
- Enhanced UI test coverage with additional test cases and improved
error handling.
- Refactored test suites to utilize a custom module for better
organization and maintainability.
- Improved the login process and dashboard loading in test cases for
better reliability.

- **Bug Fixes**
- Resolved issues related to import statements affecting test execution.

- **Documentation**
- Updated `.gitignore` to exclude coverage directories from version
control.

These updates enhance the functionality, maintainability, and
reliability of the application and its testing framework.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-13 15:13:36 +05:30
ktx-vaidehi 8456ae5ecf test: dashboard settings (#4990)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Introduced multiple new test files for dashboard functionalities,
including settings for variables, tabs, and general settings.
- Enhanced testing capabilities with new test cases covering various
scenarios for managing dashboard elements.

- **Improvements**
- Added `data-test` attributes to various UI components across multiple
files, improving testability for automated testing.

- **Bug Fixes**
- Updated import paths for JSON data files to ensure proper referencing
in tests, enhancing overall test reliability.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-13 10:44:13 +05:30
ktx-vaidehi 0848db48d3 feat: dashboard folder UI changes (#5040)
- #5018 
- #5051 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
	- Enhanced dashboard and folder management functionalities.
- Introduced a new computed property for dynamically displaying folder
names.
	- Added a method to fetch folder data during dashboard loading.

- **Bug Fixes**
	- Improved error handling for dashboard panel operations.

- **Style**
- Updated CSS for active tab background color and folder name display
for better visual consistency, utilizing Tailwind CSS for improved
responsiveness.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-12 23:03:37 +05:30
ktx-vaidehi 6bf4f943bd feat: skip auto-refresh if api is pending (#5044)
- #5050 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Enhanced refresh functionality in dashboard components to prevent
actions during loading states.
	- Improved control flow for date selection and refresh operations.

- **Bug Fixes**
- Addressed issues with unnecessary refresh calls when panels are
loading.

- **Documentation**
	- Updated method signatures for clarity on new conditional checks.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-12 19:24:33 +05:30
Sai Nikhil d8a62bd908 fix: pipeline issues (#4993)
This PR solves the below fixes
SQL error to be displayed while creating query type source node.
 Function is overlapping when we get. error while creating function.
 All validations need to be fixed
Confirmation message to not display, if user edits but does not change
anything and clicks on back icon
 Pipeline Preview for every node we are getting extra white background
Function added in a pipeline should not be allowed to delete until user
deletes the pipeline
 when user cancels any node creation any selection will be reset


<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Enhanced user interaction and responsiveness in the pipeline editor
components, including improved handling of node selections and
validations.
- Introduced new tab for "streamPipelines" in the Functions view,
replacing the previous "enrichmentTables" tab.
- Added notifications for missing required fields during function
creation and condition saving.
- Implemented dynamic styling for function nodes based on user
interactions.
- Improved validation logic for cron expressions and SQL queries,
providing immediate feedback on input errors.
- Introduced user selection tracking and tooltips for various node types
to enhance clarity and usability.
- Updated data-test attributes across components for improved testing
capabilities.

- **Bug Fixes**
- Improved error handling and notifications for user inputs,
particularly regarding cron expressions and SQL query validations.
- Enhanced state management and error feedback for user selections
across various components.

- **Documentation**
- Updated internal logic descriptions for better clarity on component
behaviors and user interactions.

- **Style**
- Added tooltips for node types to enhance user experience and
visibility of node details.
- Introduced new styling for node handles to improve maintainability and
consistency.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-12 16:05:58 +05:30
Yashodhan Joshi 736fc1c768 fix: cheery-pick ingestion error logging (#4991) 2024-11-12 05:58:53 +08:00
Taiming LiuandSai Nikhil 7b6dfd5885 fix: delete related pipelines when deleting functions and streams (#4995)
Adds a new endpoint for `/functions` to find a list of associate
pipelines. This list is also used to warn user to remove associated pipelines
before deleting a function.
---------

Co-authored-by: Sai Nikhil <nikhil@openobserve.ai>
2024-11-11 09:34:21 -08:00
ktx-vaidehiandktx-abhay e133108831 feat: dashboard charts colors options (#4994)
- #5001 
- #5013 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
	- Enhanced color palette management for dynamic user selection.
	- Improved handling of missing values in chart data processing.

- **Bug Fixes**
- Refined logic for calculating minimum and maximum values in charts to
ensure accuracy.

- **Documentation**
- Updated method signatures and variable types for clarity and better
understanding of functionality.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: ktx-abhay <abhay.padamani@kiara.tech>
2024-11-11 17:25:03 +05:30
Omkar Kesarkhane 6b2864c9aa fix: Added AWS, GCP and Azure Data Sources to recommended tab (#5037)
#5038 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

## Release Notes

- **New Features**
- Introduced new tabs for AWS, GCP, and Azure configurations in the
ingestion section.
- Added a new component to display AWS configuration details with
service documentation links.
- Enhanced GCP configuration component with additional documentation
links.
  - Updated Azure configuration component layout and links.

- **Bug Fixes**
- Removed outdated ingestion options for Kinesis Firehose and GCP Logs
from the interface.

- **Refactor**
- Simplified route structure by removing obsolete components and adding
new ones for AWS, GCP, and Azure.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-11 13:29:37 +05:30
Abhay Padamani b067c7d681 fix: dashboard markdown renderer issue (#5035)
- #5036 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Enhanced styling for rendered HTML and Markdown content using Tailwind
CSS typography utilities.
- Integrated the `@tailwindcss/typography` plugin for improved text
styling capabilities.

- **Chores**
- Updated project dependencies to include `@tailwindcss/typography` in
development dependencies.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-11 12:06:21 +05:30
ktx-vaidehi 3e87c0fc26 fix: table chart override popup, if override has duplicate name then show error (#5026)
- #5025
2024-11-11 11:43:15 +05:30
Sai Nikhil 5ea9290d10 feat: Expand logs query editor with a button (#4961)
1.This feat includes an expand button along with if user looses focus or
press ESC button the query editor will be shrinked

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced a toggle button for expanding and collapsing the query
editor in the logs search interface.
- Dynamic icon and title updates for the toggle button based on editor
state.
	- Added keyboard shortcut (Escape key) to quickly collapse the editor.

- **Improvements**
- Enhanced user experience with conditional background color for the
focused editor.
	- Refined layout and styling for a consistent user interface.
	- Adjusted editor width based on toggle state and focus status.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-08 10:59:10 +05:30
Omkar Kesarkhane 0bdbced143 fix: fixed issue on aggregating field with non-existent alias and expand log detail (#5011)
#5010 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced new methods for enhanced log data handling, including
`quoteTableNameDirectly`, `getRegionInfo`, and `addTraceId`.
  
- **Improvements**
- Enhanced error handling and state management for better user
experience.
	- Refined query construction logic to optimize performance.
- Updated list presentations in configuration components for improved
styling.

- **Style**
- Improved formatting and readability in the `JsonPreview`,
`KubernetesConfig`, `LinuxConfig`, and `WindowsConfig` components,
enhancing code maintainability.
	- Added SCSS support for styling in `KubernetesConfig`. 

- **Localization**
	- Added a new label for the search functionality: "Original".
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-07 18:27:43 +05:30
dependabot[bot] adbf6eb8ac chore(deps): bump cookie, express and @bundled-es-modules/cookie in /web (#5005) 2024-11-07 18:00:44 +08:00
dependabot[bot] 1179109e2e chore(deps-dev): bump happy-dom from 14.12.3 to 15.10.2 in /web (#5006) 2024-11-07 16:44:39 +08:00
Omkar Kesarkhane 6a1a7e8e7e fix: fixed unit test cases (#4883)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

## Release Notes

- **New Features**
- Enhanced `SessionViewer` component for improved readability in method
calls.
- Additional fields in stream settings for better configuration
management.

- **Bug Fixes**
- Adjusted expected outputs in test cases for `LogStream` and `Schema`
components.

- **Refactor**
- Updated dependencies for testing tools, transitioning from Jest to
Vitest.
  - Improved structure and presentation in the `schema.vue` component.

- **Chores**
- Modified testing configuration paths and updated inline dependencies.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-05 14:07:35 +05:30
Omkar Kesarkhane 3775997ea8 feat: UI improvements in Query Management UI (#4930)
#4936 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Introduced a new component, **RunningQueries**, for managing and
displaying running queries with enhanced filtering options.
- Added a **RunningQueriesList** component for displaying query data
with pagination and action capabilities.

- **Improvements**
- Enhanced layout and styling of the **QueryList** component for better
user experience.
- Streamlined data handling in **RunningQueriesList** by utilizing props
and emitted events, improving flexibility.

- **Localization**
- Added new localization keys for query metrics, including "Number of
Queries," "Total Exec. Duration," "Total Query Range," and "Search
Type," to improve user interface clarity.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-11-05 13:02:52 +05:30
Subhra264andTaiming Liu 287185ac46 fix: pipeline rbac fixes (#4976)
Fixes #4982 

- Adds migration for pipelines for ofga tuple database.
- Fixes some rbac permission logic for pipelines.

Co-authored-by: Taiming Liu <liutaiming3@gmail.com>
2024-11-04 10:50:20 -08:00
ktx-akshayandktx-vaidehi 0ca6524994 test: dashboard table transpose (#4925)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced test coverage for dashboard UI with new Playwright tests
focusing on the transpose feature and dynamic columns.
- Added `data-test` attributes to various components in the General
Settings for improved testability.

- **Bug Fixes**
- Improved consistency in the GitHub Actions workflow configuration for
UI tests.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: ktx-vaidehi <vaidehi.akhani@kiara.tech>
2024-11-04 16:58:13 +05:30
Chaitanya Sistla 4603b26059 feat: fixing logstash url (#4970) 2024-11-01 23:22:48 +08:00
499f2bfbc7 feat: SearchEventContext for search usage reports (#4934)
impl #4914 

new parameters acceptable for search queries to add additional context
in usage report:
**Dashboard**
`dashboard_id` 
`dashboard_name` 
`dashboard_folder`
`dashboard_folder_id`
`dashboard_folder_name`

**Report**
`report_key`

**Alert**
`alert_key`

Co-authored-by: Sai Nikhil <nikhil@openobserve.ai>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
2024-10-31 05:16:00 -07:00
0ebaf21f33 feat: Pipeline integration v2 (#4732)
This PR implements the new design of **Pipeline** introduced by #4432 

---

**2 types of pipelines differentiates by the source** 

Type I: **Realtime**
- source is a stream (Logs, Metrics, & Traces)
- takes effect when the source stream is being ingested

Type II: **Scheduled** (aka DerivedSteram)
- source is a SQL query
- takes effect based on the given schedule

The new pipeline is represented as a graph consists of different types
of Nodes that are connected by edges.
**Pipeline Data Model**
```rs
pub struct Pipeline {
    pub id: String,
    pub version: i32,
    pub enabled: bool,
    pub org: String,
    pub name: String,
    pub description: String,
    pub source: PipelineSource,
    pub nodes: Vec<Node>,
    pub edges: Vec<Edge>,
}
```
**4 types of node**
I. StreamNode: either used for source node of realtime pipeline or for
destination nodes
II. QueryNode: used for source node of scheduled pipeline
III. FunctionNode: used for executing vrl functions
IV. ConditionNode: used for checking routing conditions

Rules applied to validating a pipeline when it's created:
1. non-empty nodes list
2. non-empty edges list
3. 1st node in nodes list is either StreamNode or QueryNode
4. non-empty `conditions` in all ConditionNode nodes in nodes list
5. all leaf nodes are of type StreamNode
6. In the same branch, unchecked `after_flattened` FunctionNode can't
follow checked
   `after_flattened` checked FunctionNode

Pipeline execution is implemented with the struct `ExecutablePipeline`,
a ready-execute pipeline object cached in memory based on the Pipeline
objects modified on the UI side.
`ExecutablePipeline` object
- builds the relationships among all the nodes based on the edges
- topologically sorts the nodes based on the level to determine which
node to process first
- registers all the vrl function node once

`ExecutablePipeline` object processes ingested records in batch.
Starting from the source node, each connecting edge has a channel
connecting the parent and child node, used for passing the records. This
approach enables batch processing in parallel.

---

**Deprecated Features**
1. previous implementation of pipeline
2. Function x Stream associations
 - Functions can still be added/edited/removed as before
- Needs to create a pipeline in order to apply chosen functions to the
desired stream

The new release when this pr is merged will automatically migrate **old
pipelines** and **Function x Stream associations** to new pipeline
format and can be found in `Stream Pipelines` tab with `Migrated-`
prefix names.
**_Note: Auto generated pipelines are paused by default. Please verify
the pipelines before enabling them_**


Co-authored-by: Taiming Liu <liutaiming3@gmail.com>
Co-authored-by: Bhargav <BJP232004@GMAIL.COM>
2024-10-30 21:53:28 -07:00
Sai Nikhil 61ce5a0bf5 fix: issue #4935 (#4940)
This PR fixes 
1.#4935 
2.This also tries to add wrap the stream name into double quotes so
whenever any field also contain the stream name it ignores that

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced error handling for search results, improving user feedback
based on various error states.
- Improved accuracy in SQL query modifications related to stream names,
preventing unintended replacements.
- More precise filtering of fields during removal, enhancing the field
management process.
- Adjusted histogram interval conditions for better data generation,
resulting in finer granularity.
- More descriptive error messages for improved user notifications during
search operations.

- **Bug Fixes**
- Refined query cancellation process to notify users effectively if a
search query is interrupted.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-10-31 09:48:05 +05:30
dependabot[bot] fe32354aa4 chore(deps): bump elliptic from 6.5.7 to 6.6.0 in /web (#4953) 2024-10-30 23:09:01 +08:00
Omkar Kesarkhane c4d164c230 feat: added Logstash data source in logs (#4957) 2024-10-30 22:13:36 +08:00
Neha PandSai Nikhil 5306ad899f test: clone alert (#4931)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced alert creation and cloning functionality with improved
validation checks.
- Added support for comprehensive search capabilities in the alert list.
- Introduced functionality to verify user interactions with search
history.

- **Bug Fixes**
	- Improved error handling and user feedback during alert cloning.
	- Enhanced validation for required fields in alert creation.

- **Tests**
- New test cases added for alert management and search history
functionalities.
- Updated existing tests to ensure better coverage and error handling,
including the addition of new scenarios for invalid inputs.

- **Chores**
- Cleaned up the test suite by removing unused code and improving
structure.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Sai Nikhil <nikhil@openobserve.ai>
2024-10-30 17:53:27 +05:30
Abhay Padamani 273330405c feat: color palette for dashboard chart (#4774)
- #4837 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Introduced a new color configuration option for dashboard panels,
allowing users to customize colors via a new dropdown component.
- Added a utility for managing color palettes and calculating color
values based on data metrics.

- **Enhancements**
- Improved SQL and PromQL data conversion processes to dynamically apply
color schemes and enhance tooltip formatting.
- Enhanced the configuration options for dashboard panels with
additional color settings.

- **Dependencies**
	- Added new dependencies for improved data visualization capabilities.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-10-30 15:25:00 +05:30
Abhay Padamani 8cf9680886 fix: dashboard compare against issue (#4943)
- #4944 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced loading process for panel data with improved error handling
and caching mechanisms.
- Updated time calculation functions to allow for more accurate
timestamp computations based on specified offsets.
- Streamlined naming process for series in chart rendering based on time
range gaps.

- **Bug Fixes**
- Improved handling of time range gaps in data conversion functions,
ensuring consistent and accurate data representation.

- **Documentation**
- Updated function signatures to reflect changes in parameters and
enhance clarity for developers.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-10-30 11:09:17 +05:30
cnn007 f5f1e87e1d fix:#4937 (#4941) 2024-10-30 08:36:10 +08:00
ktx-vaidehi 022e3779a4 feat: Stream name to be available as Dashboard variable (#4877)
- #4878

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced SQL query parsing and validation with improved error handling
for stream names.
	- Introduced a new helper function to validate dummy stream names.
- **Bug Fixes**
- Refined error handling for invalid stream names to improve robustness.
- **Documentation**
	- Updated comments for better clarity and consistency.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-10-29 14:24:05 +05:30
ktx-vaidehiandcoderabbitai[bot] 618a6f7690 feat: dashboard table override (#4798)
- #4829 
- #4215 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Introduced the `OverrideConfigPopup` component for managing dashboard
override configurations.
- Added the `OverrideConfig` component for enhanced configuration
options in table-type dashboards.
	- Enhanced `PanelConfig` to support override configurations.

- **Improvements**
- Expanded dashboard panel data structure to include `override_config`
for flexible configuration management.
	- Improved unit handling and date formatting in table data conversion.

These updates enhance customization and usability for dashboard
configurations.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2024-10-29 12:37:08 +05:30
ktx-vaidehi f6c0fc8940 feat: Dashboard Config Option (#4617)
- #4589 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Release Notes

- **New Features**
- Enhanced dashboard panel configuration with new options for line
thickness, label positioning, symbol visibility, and line interpolation.
- Introduced new icons for visual representation of chart options,
including Linear, NoSymbol, Smooth, StepBefore, StepAfter, and
StepMiddle.

- **Bug Fixes**
- Improved error handling and validation for dashboard panel
configurations.

- **Documentation**
- Added new localization entries for enhanced user interface labels
related to dashboard features.

These updates significantly improve the customization and usability of
dashboard panels, providing users with greater flexibility in
visualizing their data.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-10-29 10:54:33 +05:30
ktx-vaidehi eeecb3f130 feat: if print mode hide unnecessary empty space (#4869)
- #4870

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Enhanced table rendering for print mode, ensuring proper styling and
positioning.
- Introduced conditional rendering for dashboard panels specifically in
print scenarios, improving layout adaptability.

- **Bug Fixes**
- Improved responsiveness of the dashboard display based on the
application's print state.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-10-28 18:10:44 +05:30
ktx-vaidehi cb6ac0ab90 feat: added new options for histogram intervals (#4830)
- #4832
2024-10-28 12:27:10 +05:30