<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced SQL autocomplete with fuzzy matching suggestions.
- Updated syntax guide to include fuzzy matching instructions for SQL
queries.
- **Bug Fixes**
- Maintained existing logic for other completion items, ensuring
seamless integration of new features.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced error handling and logic improvements in SQL query parsing
for the `useLogs` composable.
- Improved functionality of the search bar component, including better
handling of SQL queries and user notifications.
- **Bug Fixes**
- Refined logic for managing selected streams and improved feedback for
download attempts in the search bar.
- **Style**
- Adjusted button classes and added scoped styles to improve the visual
layout of the search bar component.
- **Chores**
- Updated GitHub Actions workflow configuration for Playwright UI tests.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
This PR introduces the service accounts with tokens
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Release Notes
- **New Features**
- Introduced a new module for managing service accounts, including
functionalities for listing, creating, updating, and deleting service
accounts.
- Added a new tab for "Service Accounts" in the Identity Access
Management interface.
- Enhanced user management interfaces to support service account
operations, including the ability to add and edit service accounts.
- Implemented a new component for managing service accounts within
groups and roles.
- Added new API endpoints for service account management, including
token operations.
- Introduced a comprehensive Vue component for managing service accounts
with enhanced features, including filtering, searching, and token
management.
- Enhanced permission checks and error handling for service accounts
across various functions.
- Added support for external user permissions in service account
operations.
- Enhanced error handling for various components to prevent unnecessary
notifications on permission-related issues.
- Added localization support for service account functionalities,
providing necessary labels for user interface elements.
- **Bug Fixes**
- Improved error handling and validation across user management and
service account functionalities.
- **Documentation**
- Updated localization files to support new service account features and
labels.
- **Style**
- Adjusted styles in various components to enhance usability and
consistency.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: oasisk <ashish.j.kolhe@gmail.com>
Co-authored-by: Subhradeep Chakraborty <chakrabortysubhradeep556@gmail.com>
- #5297
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced query validation process, allowing queries with subqueries to
pass without error.
- **Bug Fixes**
- Adjusted height calculations for elements in the Add Panel component,
improving layout and user interface.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Release Notes
- **New Features**
- Introduced new routing for "destinations" and "templates" under the
settings section.
- Added a new `alertList` route, replacing the previous alerts route.
- **User Interface Changes**
- Removed tabbed navigation for alerts, destinations, and templates,
simplifying the layout to direct routing.
- Enhanced styling for icons in the header section for a more polished
appearance.
- Updated the icon for the "organization" tab.
- **Bug Fixes**
- Standardized notification messages during save operations for better
user feedback.
- Updated functionality of back navigation buttons to emit a cancel
event instead of navigating back.
These updates enhance navigation and improve user experience within the
application.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Release Notes
- **New Features**
- Enhanced SQL query handling for multiple streams in logging
functionality.
- Added visual feedback for the "Visualize" button based on selected
streams.
- Introduced organization management improvements in the login process.
- New utility function for array comparison added for improved logic.
- Added a new action to the Vuex store for setting user information.
- **Bug Fixes**
- Improved error handling and display for SQL query construction and
organization data fetching.
- **Documentation**
- Updated comments and structure in various components for better
readability and maintainability.
- **Chores**
- Minor formatting and style adjustments across multiple files for
consistency.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Abhay Padamani <141122205+ktx-abhay@users.noreply.github.com>
Co-authored-by: ktx-abhay <abhay.padamani@kiara.tech>
Co-authored-by: hengfei yang <hengfei.yang@gmail.com>
Co-authored-by: Huaijin <haohuaijin@gmail.com>
- #5089
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced a new property, `streamResultsType`, to enhance data
handling in the dashboard panel.
- Dynamic button styling based on the application's theme in the Query
Type Selector component.
- **Bug Fixes**
- Improved error handling for field extraction to ensure correct fields
are loaded based on stream type.
- **Chores**
- Updated CSS for button styling to support dynamic theming.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: ktx-abhay <abhay.padamani@kiara.tech>
- #5063
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced dynamic handling of SQL queries for improved flexibility.
- Improved error reporting for invalid SQL syntax.
- Added validation mechanism for SQL queries to ensure syntactical
correctness.
- Introduced a function to extract unique variables from SQL queries.
- **Bug Fixes**
- Refined logic for updating custom query fields to ensure correct
population and validation.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- #4825
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Release Notes
- **New Features**
- Introduced new `MapsRenderer` component for enhanced map
visualizations.
- Added support for selecting map types in the configuration panel.
- New dashboard components for managing map queries and data.
- Added new fields for map configurations, including names and values.
- **Improvements**
- Enhanced chart selection options, including new map-related types.
- Updated localization for better support of map functionalities.
- Improved handling of field aliases in the panel schema.
- Enhanced functionality for adding map names and values within the
dashboard.
- Refined drag-and-drop functionality for map fields.
- Enhanced data validation and error handling in map-related components.
- **Bug Fixes**
- Improved error handling and data validation in map-related components.
- **Chores**
- Updated component names and structure for consistency.
- Enhanced internal methods for better data handling and processing.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
#5038
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Release Notes
- **New Features**
- Introduced new tabs for AWS, GCP, and Azure configurations in the
ingestion section.
- Added a new component to display AWS configuration details with
service documentation links.
- Enhanced GCP configuration component with additional documentation
links.
- Updated Azure configuration component layout and links.
- **Bug Fixes**
- Removed outdated ingestion options for Kinesis Firehose and GCP Logs
from the interface.
- **Refactor**
- Simplified route structure by removing obsolete components and adding
new ones for AWS, GCP, and Azure.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
#5010
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced new methods for enhanced log data handling, including
`quoteTableNameDirectly`, `getRegionInfo`, and `addTraceId`.
- **Improvements**
- Enhanced error handling and state management for better user
experience.
- Refined query construction logic to optimize performance.
- Updated list presentations in configuration components for improved
styling.
- **Style**
- Improved formatting and readability in the `JsonPreview`,
`KubernetesConfig`, `LinuxConfig`, and `WindowsConfig` components,
enhancing code maintainability.
- Added SCSS support for styling in `KubernetesConfig`.
- **Localization**
- Added a new label for the search functionality: "Original".
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
#4936
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Release Notes
- **New Features**
- Introduced a new component, **RunningQueries**, for managing and
displaying running queries with enhanced filtering options.
- Added a **RunningQueriesList** component for displaying query data
with pagination and action capabilities.
- **Improvements**
- Enhanced layout and styling of the **QueryList** component for better
user experience.
- Streamlined data handling in **RunningQueriesList** by utilizing props
and emitted events, improving flexibility.
- **Localization**
- Added new localization keys for query metrics, including "Number of
Queries," "Total Exec. Duration," "Total Query Range," and "Search
Type," to improve user interface clarity.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
This PR implements the new design of **Pipeline** introduced by #4432
---
**2 types of pipelines differentiates by the source**
Type I: **Realtime**
- source is a stream (Logs, Metrics, & Traces)
- takes effect when the source stream is being ingested
Type II: **Scheduled** (aka DerivedSteram)
- source is a SQL query
- takes effect based on the given schedule
The new pipeline is represented as a graph consists of different types
of Nodes that are connected by edges.
**Pipeline Data Model**
```rs
pub struct Pipeline {
pub id: String,
pub version: i32,
pub enabled: bool,
pub org: String,
pub name: String,
pub description: String,
pub source: PipelineSource,
pub nodes: Vec<Node>,
pub edges: Vec<Edge>,
}
```
**4 types of node**
I. StreamNode: either used for source node of realtime pipeline or for
destination nodes
II. QueryNode: used for source node of scheduled pipeline
III. FunctionNode: used for executing vrl functions
IV. ConditionNode: used for checking routing conditions
Rules applied to validating a pipeline when it's created:
1. non-empty nodes list
2. non-empty edges list
3. 1st node in nodes list is either StreamNode or QueryNode
4. non-empty `conditions` in all ConditionNode nodes in nodes list
5. all leaf nodes are of type StreamNode
6. In the same branch, unchecked `after_flattened` FunctionNode can't
follow checked
`after_flattened` checked FunctionNode
Pipeline execution is implemented with the struct `ExecutablePipeline`,
a ready-execute pipeline object cached in memory based on the Pipeline
objects modified on the UI side.
`ExecutablePipeline` object
- builds the relationships among all the nodes based on the edges
- topologically sorts the nodes based on the level to determine which
node to process first
- registers all the vrl function node once
`ExecutablePipeline` object processes ingested records in batch.
Starting from the source node, each connecting edge has a channel
connecting the parent and child node, used for passing the records. This
approach enables batch processing in parallel.
---
**Deprecated Features**
1. previous implementation of pipeline
2. Function x Stream associations
- Functions can still be added/edited/removed as before
- Needs to create a pipeline in order to apply chosen functions to the
desired stream
The new release when this pr is merged will automatically migrate **old
pipelines** and **Function x Stream associations** to new pipeline
format and can be found in `Stream Pipelines` tab with `Migrated-`
prefix names.
**_Note: Auto generated pipelines are paused by default. Please verify
the pipelines before enabling them_**
Co-authored-by: Taiming Liu <liutaiming3@gmail.com>
Co-authored-by: Bhargav <BJP232004@GMAIL.COM>
This PR fixes
1.#4935
2.This also tries to add wrap the stream name into double quotes so
whenever any field also contain the stream name it ignores that
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced error handling for search results, improving user feedback
based on various error states.
- Improved accuracy in SQL query modifications related to stream names,
preventing unintended replacements.
- More precise filtering of fields during removal, enhancing the field
management process.
- Adjusted histogram interval conditions for better data generation,
resulting in finer granularity.
- More descriptive error messages for improved user notifications during
search operations.
- **Bug Fixes**
- Refined query cancellation process to notify users effectively if a
search query is interrupted.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- #4837
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Release Notes
- **New Features**
- Introduced a new color configuration option for dashboard panels,
allowing users to customize colors via a new dropdown component.
- Added a utility for managing color palettes and calculating color
values based on data metrics.
- **Enhancements**
- Improved SQL and PromQL data conversion processes to dynamically apply
color schemes and enhance tooltip formatting.
- Enhanced the configuration options for dashboard panels with
additional color settings.
- **Dependencies**
- Added new dependencies for improved data visualization capabilities.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- #4944
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced loading process for panel data with improved error handling
and caching mechanisms.
- Updated time calculation functions to allow for more accurate
timestamp computations based on specified offsets.
- Streamlined naming process for series in chart rendering based on time
range gaps.
- **Bug Fixes**
- Improved handling of time range gaps in data conversion functions,
ensuring consistent and accurate data representation.
- **Documentation**
- Updated function signatures to reflect changes in parameters and
enhance clarity for developers.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- #4878
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced SQL query parsing and validation with improved error handling
for stream names.
- Introduced a new helper function to validate dummy stream names.
- **Bug Fixes**
- Refined error handling for invalid stream names to improve robustness.
- **Documentation**
- Updated comments for better clarity and consistency.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- #4829
- #4215
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Release Notes
- **New Features**
- Introduced the `OverrideConfigPopup` component for managing dashboard
override configurations.
- Added the `OverrideConfig` component for enhanced configuration
options in table-type dashboards.
- Enhanced `PanelConfig` to support override configurations.
- **Improvements**
- Expanded dashboard panel data structure to include `override_config`
for flexible configuration management.
- Improved unit handling and date formatting in table data conversion.
These updates enhance customization and usability for dashboard
configurations.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
- #4589
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Release Notes
- **New Features**
- Enhanced dashboard panel configuration with new options for line
thickness, label positioning, symbol visibility, and line interpolation.
- Introduced new icons for visual representation of chart options,
including Linear, NoSymbol, Smooth, StepBefore, StepAfter, and
StepMiddle.
- **Bug Fixes**
- Improved error handling and validation for dashboard panel
configurations.
- **Documentation**
- Added new localization entries for enhanced user interface labels
related to dashboard features.
These updates significantly improve the customization and usability of
dashboard panels, providing users with greater flexibility in
visualizing their data.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Release Notes
- **New Features**
- Enhanced SQL query handling across multiple components by trimming
whitespace from user inputs, ensuring cleaner and more reliable query
execution.
- Added a `refreshTimezone` method to update grid columns and regenerate
histogram data in the search functionality.
- **Bug Fixes**
- Improved error handling and user feedback for session data retrieval
and search requests.
These updates enhance the overall robustness and user experience within
the application, particularly in handling search queries and alerts.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: ktx-vaidehi <vaidehi.akhani@kiara.tech>
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Release Notes
- **New Features**
- Introduced new utility functions for SQL query parsing and un-parsing.
- Added functionality for managing fields in SQL queries based on user
interactions in the log search interface.
- **Improvements**
- Enhanced log search interface with new event handlers and improved
user feedback.
- Streamlined error handling and data management for log queries.
- Refined conditional rendering and query construction logic in the
search interface.
- Updated SQL query manipulation logic for better accuracy and error
handling.
- Improved the clarity and efficiency of SQL query handling and saved
views.
- Enhanced control flow and data structure management within SQL query
handling.
- Added optional chaining to improve robustness in dashboard panel data
handling.
- Adjusted handling of SQL queries for improved performance and
responsiveness.
- **Bug Fixes**
- Removed redundant code to improve performance and clarity.
- **Chores**
- Updated dependencies to enhance SQL parsing capabilities.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: ktx-abhay <abhay.padamani@kiara.tech>
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Release Notes
- **New Features**
- Enhanced filtering capabilities for logs with new methods for
constructing filter expressions based on field types and values.
- **Improvements**
- Updated search term handling across various components to accept more
detailed parameters, allowing for more structured filtering.
- Improved pagination logic to ensure better user experience when
navigating search results.
- **Bug Fixes**
- Enhanced error handling in search term addition to notify users of any
issues with filter expression generation.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
This PR fixes#4863
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced log querying with support for time periods specified in
seconds (e.g., "30s").
- Improved restoration of URL query parameters to accommodate new time
format.
- **Bug Fixes**
- Refined logic for managing query parameters to ensure accurate updates
and initialization.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced error handling for data fetching and processing, providing
clearer feedback to users.
- Improved dynamic rendering of error messages and search results in the
user interface.
- **Bug Fixes**
- Resolved issues with undefined properties, ensuring robust error
message display and a smoother user experience.
- **Refactor**
- Streamlined logic for managing field visibility and refined data
processing methods for better performance and clarity.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Bhargav <BJP232004@GMAIL.COM>
this PR fixes#4752
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Improved date-time handling in the Search History component for more
accurate log searches.
- Added utility function to extract timestamps based on specified
periods.
- Enhanced functionality for managing query parameters and stream data.
- **Bug Fixes**
- Enhanced error handling for clearer notifications and traceability.
- **Refactor**
- Code refactoring for better clarity and maintainability in query
management.
- **Chores**
- Minor template adjustments for improved testing support.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
…ill help to provide more insight in case of no record found with
function error.
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced a button to toggle error details based on error messages.
- Added a new key for error button label in the localization file to
enhance user interface.
- **Bug Fixes**
- Improved error handling logic to provide comprehensive feedback on
errors encountered during log searches.
- **User Experience Enhancements**
- Refined user interaction for better understanding and management of
error information on the logs page.
- Enhanced clarity of error reporting with improved rendering of error
messages.
- Users can now access detailed error information more easily during log
searches.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
#4806
Issue replication steps:
Go to logs, turn off histogram, select stream and click run-query after
getting results, turn on histogram.
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced functionality for refreshing data based on user settings.
- Added dynamic SQL query management capabilities.
- Added a method for generating histogram data skeletons.
- Updated the region data fetching process for improved structure.
- **Improvements**
- Enhanced error handling with detailed messages and better trace ID
management.
- Improved pagination management and histogram data handling.
- Updated component structure for better search query handling and
visualizations.
- Enhanced clarity and maintainability of data filtering logic in the
permission table.
- **Minor Adjustments**
- Various code adjustments for clarity and efficiency.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
1. Removed basic and advanced filter modes. Added advanced as default
mode
2. In trace details, removed inline span expand option option
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Release Notes
- **New Features**
- Added a "Links" tab in the Trace Details Sidebar for better navigation
between span links.
- Introduced a new utility function for converting time from nanoseconds
to milliseconds.
- **Improvements**
- Simplified the trace filtering process by removing unnecessary filter
type selections and logic.
- Enhanced error message rendering for improved clarity, particularly
when no stream or trace data is found.
- Improved the layout and styling of the Trace Details Sidebar for
better user experience.
- Enhanced the display of span details, including dynamic visibility of
span operation names and additional computed properties.
- Streamlined the rendering logic in various components for better
readability and user interaction.
- Updated the handling of URL query parameters for improved state
management.
- **Bug Fixes**
- Enhanced error handling when no trace details are returned.
These updates streamline the user interface and improve functionality,
making the application more intuitive and user-friendly.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Improvements**
- Enhanced error handling for loading stream fields and displaying error
messages, providing clearer feedback to users.
- Streamlined query data handling for more efficient SQL query
construction, improving performance.
- Improved processing and display of histogram data results, ensuring
accurate and timely visualizations.
These changes aim to provide a smoother user experience and ensure more
reliable functionality within the logging features.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- #4682
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced error handling for search result responses to ensure valid
data formats.
- Improved logic for managing loading states and caching behavior based
on query presence.
- **Bug Fixes**
- Adjustments made to prevent runtime errors from unexpected data
structures.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- #4675
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Summary by CodeRabbit
- **New Features**
- Introduced data ordering functionality for API results, allowing users
to view data in either ascending or descending order based on their
preference.
- **Bug Fixes**
- Improved handling of API responses, including enhanced error
processing and state management for a more reliable user experience.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
feat #1401
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced a tabbed interface for selecting "Web Hook" and "Email"
destination types in the Add Destination section.
- Added a new tabbed interface for template types in the Add Template
section, with conditional input fields based on selection.
- Implemented a method to navigate to the email template creation page.
- **Improvements**
- Enhanced user experience with dynamic input fields for email addresses
and validation in the Add Destination section.
- Updated the save functionality to handle new properties for templates
and destinations.
- Improved email notification logic to use template titles for email
subjects, ensuring better customization.
- Added validation to ensure destination emails are associated with the
correct organization.
- Expanded data structure to include a new title property for templates.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Subhradeep Chakraborty <chakrabortysubhradeep556@gmail.com>
This PR fixes the issues in #4663
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced search history functionality with improved state management
and visibility controls.
- Introduced a new prop `isClicked` in the search history component to
trigger fetching of search history.
- **Bug Fixes**
- Adjusted query parameter handling to prevent retention of unnecessary
properties during search history operations.
- **Refactor**
- Streamlined the logic for fetching and managing search history data,
improving clarity and efficiency.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- #4651
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Release Notes
- **New Features**
- Introduced a custom date-time picker for selecting relative time
periods in dashboard queries.
- Added functionality for managing time shifts, allowing users to
compare data points over selected time ranges.
- **Enhancements**
- Improved handling of query metadata warnings to display only the first
warning.
- Enhanced dashboard panel data management with support for time shifts
in data visualization.
- Updated SQL data conversion methods for improved processing of
multiple queries.
- **Utilities**
- Added functions for converting time offsets to seconds and vice versa.
- **Bug Fixes**
- Refined error handling in query execution and data loading processes.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: ktx-abhay <abhay.padamani@kiara.tech>
Co-authored-by: Sai Nikhil <nikhil@openobserve.ai>
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Chores**
- Streamlined import statements for improved clarity.
- Reformatted code for better readability, especially in variable
processing.
- Enhanced logging statements for consistency and style.
- Simplified handling of variable values in the data loader, improving
code clarity without altering functionality.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- #4593
- #4629
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced new configuration options for dashboard table panels:
`Transpose` and `Allow Dynamic Columns`.
- Added toggle components in the configuration panel for the new table
settings.
- Enhanced data handling for dynamic column generation and table
transposition.
- **Localization**
- Added new entries for table-related functionalities in the
localization files.
- **Bug Fixes**
- Updated initialization logic to ensure default values for new
configuration properties.
- Improved error handling for variable assignments in the dashboard
components.
- **Enhancements**
- Adjusted the functionality of the data loader to improve visibility
tracking for dashboard components.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: ktx-abhay <abhay.padamani@kiara.tech>
- #4603
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced a new sorting operation for improved data presentation in
the dashboard.
- Partitions are now displayed in descending order based on their first
element for enhanced clarity.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Bug Fixes**
- Improved the logic for processing partition details based on timestamp
order, ensuring accurate evaluation of time values.
- Enhanced handling of partition arrays to accommodate ascending
timestamp conditions.
These changes will lead to more reliable data representation in the
application.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
1. cancel query improved
2. error details font reduced
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Improved handling of cancelled search queries with user notifications.
- **Bug Fixes**
- Enhanced presentation of error messages for better readability across
various components.
- **Style**
- Adjusted inline styling for error details to ensure consistency and
improved visual distinction.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Bug Fixes**
- Improved data handling by excluding specific keys (`_o2_id`,
`_original`) from processing in logs.
- Enhanced filtering logic in stream data to streamline the removal of
unnecessary fields.
- **Refactor**
- Improved code readability and structure in the `removeSchemaFields`
function without changing its functionality.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
This PR fixes the issues in #4565
1. Removed _o2_id from the schema list.
2. Added ErrorDetail in the logs page when error occurs details errors
can be shown.
3. Histogram rendering blank bars at the starting , this PR fixes that
rendering blank bars at the starting.
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced error reporting with detailed error messages and additional
context.
- Improved histogram data accuracy through refined timestamp handling.
- **Bug Fixes**
- Streamlined error message rendering across various components for
better user experience.
- **Refactor**
- Simplified logic for filtering schema fields in the stream data.
These updates collectively enhance the reliability and clarity of
logging and error handling within the application.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- #4486
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Improved handling of data integrity for panel data loading.
- Enhanced logging capabilities for better cache management and
debugging.
- **Bug Fixes**
- Addressed potential issues with stale data by ensuring fresh copies of
combined data are used.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
Co-authored-by: Kirtan Thakkar <kirtan@kiara.tech>
#4477
1. Removed keep alive from TraceDetails component
2. Fixed calculation of span block left position
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Improved responsiveness of the SpanBlock component to prop changes.
- Introduced a new watcher for base trace position updates.
- **Bug Fixes**
- Adjusted route configuration for traceDetails to improve state
management when navigating away.
- **Chores**
- Temporarily disabled automatic handling of trace details in the
TraceDetails component for debugging purposes.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
impl #4317
OpenObserve flattens ingested record by concatenating field names at
each level by a `_`. This PR attempts to restore the original record's
layered structure by enable a stream-specific setting to store original
unflatten data.
---
**A new option in StreamSettings: `store_original_data`**
A **stream-wide** setting to force two additional fields, `_o2_id` and
`_original`, to be added to the ingested JSON record, both of which will
then be used to retrieve the JSON record in its original form.
**_pros:_**
Does adhere the original JSON record's structure.
**_cons:_**
Notable impact on ingestion throughput as each record needs to be copied
and added
Additional storage cost due to the two new fields
Additional API call to to get the original JSON record.
**To get the _original record, frontend should make another request with
query such as below**
```
SELECT _original FROM {stream_name} WHERE _o2_id = xxxxxx and _timestamp = xxxxxx
```
**_note:_**
- On UI, field `_original` is not be displayed on StreamSetting page nor
the `fields` side bar on log search page. It's for internal use only.
- `_original` field will not be queried and returned with sql query such
as `SELECT * FROM {stream_name}` to combat query speed impact.
---
## How to use
Toggle `Store original data` to turn on for the desired stream(s) on
StreamSetting. In log search page, a new window will appear to show
original data when clicked.
---
## TODO
- [ ] UI update
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced a toggle for "Store Original Data" in the UI for enhanced
data retention settings.
- Added a tabbed interface in the JSON Preview component for better data
visualization, allowing users to switch between "flattened" and
"unflattened" views.
- Implemented a new function to filter out unwanted schema fields before
data storage.
- Enhanced SQL query handling to dynamically include specific columns
based on stream settings.
- Added a new field for managing original data storage in stream
settings.
- Improved data ingestion process to handle original data more
effectively.
- **Bug Fixes**
- Corrected an error message for improved clarity in the Snowflake ID
Bucket implementation.
- **Documentation**
- Updated localization files to include new keys for enhanced user
experience.
- **Style**
- Minor formatting adjustments across various components for improved
readability.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Sai Nikhil <nikhil@openobserve.ai>
Co-authored-by: Bhargav <BJP232004@GMAIL.COM>
Co-authored-by: hengfei yang <hengfei.yang@gmail.com>
1. Some times the pagination partition bug occurred so this PR fixes
that part
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Improved calculation of totals for partition details, enhancing
accuracy and performance.
- Streamlined logic for processing query results, making it clearer and
more efficient.
- **Bug Fixes**
- Resolved issues related to total calculations by directly linking them
to query results.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
Bhargav
ktx-vaidehi
Omkar Kesarkhane
Prabhat SharmaandTaiming Liu
John Vandenberg
