<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Improved user redirection handling based on the presence of a
`redirect_url` or `short_url` query parameter.
- Enhanced support for short URLs redirecting to backend API endpoints.
- **Bug Fixes**
- Updated default redirect URI to ensure consistent behavior with
trailing slashes.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- #4742
- allow user to set `display text`, `color` based on value or range of
value.
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced a new optional field for value mappings in dashboard
panels.
- Added a `ValueMapping` component for managing value mappings in table
panels.
- Enhanced `TableRenderer` to support dynamic value mapping and improved
error handling.
- Launched `ValueMappingPopUp` for editing and managing mappings with a
draggable interface.
- Added support for dynamic styling of table cells based on value
mappings.
- Introduced a new prop `value-mapping` in `TableRenderer` for dynamic
value mapping.
- **Bug Fixes**
- Improved logic for displaying error messages and "No Data" states in
dashboard panels.
- **Documentation**
- Updated documentation to reflect new components and features.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: ktx-vaidehi <vaidehi.akhani@kiara.tech>
- #4723
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced the Search Bar with the ability to generate and share
shortened URLs.
- Improved management of saved views with notifications for
adding/removing favorites.
- Reset functionality for filters now accurately reflects selected
streams and fields.
- Updated share link functionality to include a loading state for better
user feedback.
- **Bug Fixes**
- Added error handling for URL shortening and clipboard copying
processes, providing user feedback.
- **Chores**
- Updated router logic to store the current URL for redirect handling
during authentication.
- Improved redirection logic in the Login component for better handling
of external URLs.
- Enhanced redirection handling in utility functions to differentiate
between external and internal URLs.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: ktx-abhay <abhay.padamani@kiara.tech>
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced user redirection after login to utilize the intended
`redirectURI` for improved navigation.
- Improved dynamic handling of organization options during the login
process.
- **Bug Fixes**
- Corrected redirection logic to ensure users are sent to the correct
URI instead of a default path.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- #4725
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced dashboard management with new methods for adding, editing,
and deleting tabs.
- Introduced functionality to move panels between tabs for improved
layout flexibility.
- Improved error handling for dashboard retrieval processes.
- **Bug Fixes**
- Ensured consistent state management when deleting dashboards.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Improvements**
- Enhanced error handling for loading stream fields and displaying error
messages, providing clearer feedback to users.
- Streamlined query data handling for more efficient SQL query
construction, improving performance.
- Improved processing and display of histogram data results, ensuring
accurate and timely visualizations.
These changes aim to provide a smoother user experience and ensure more
reliable functionality within the logging features.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
Addresses #4619
- [x] Multi timerange alerts
- [x] Add `is_partial` field to the `triggers` usage stream.
### Note: Only available in SQL alerts
<img width="1248" alt="Screenshot 2024-10-07 at 12 39 36 PM"
src="https://github.com/user-attachments/assets/57c99b29-6d59-496d-bb91-f958b6f2e0bd">
- Historical timeranges can be selected through the `Multi Window
Selection` field.
- When multi-window timeranges are selected, the vrl of the alert is
applied only after fetching all the timerange data and is applied to the
combined multi-timerange records.
- If `ResultArray` is specified in the vrl function, the input to the
vrl function will be multi-dimensional i.e. if two timeranges are
selected, then the input to the vrl function will be a two-dimensional
array containing a total of three arrays. Each array represents the data
of each timerange.
- If `ResultArray` is not specified, the input of vrl function is an
one-dimensional array containing records of all the timeranges in a
sorted order (from most recent to oldest).
- After applying the vrl function, the output array (irrespective of
multi/single dimension array) is first converted into a one-dimensional
array and then only the `threshold` rule is applied to the output of vrl
function. If the `threshold` satisfies then the alert triggers otherwise
not.
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Release Notes
- **New Features**
- Introduced support for multiple time ranges in alert configurations.
- Added a new `search_multi` function for handling multiple search
queries in a single request.
- Enhanced alert creation with new properties and methods for managing
multiple time ranges.
- New `is_partial` field added to `TriggerData` for tracking partial
evaluations.
- **Bug Fixes**
- Improved error handling for partial alert evaluations.
- **Documentation**
- Updated comments and documentation for better clarity on new features
and changes.
- **Refactor**
- Streamlined the logic for SQL query handling and alert evaluation
processes.
- **Style**
- Minor formatting adjustments across various components for improved
readability.
- **Tests**
- Enhanced validation checks and filtering logic in alert management
components.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Sai Nikhil <nikhil@openobserve.ai>
#4698
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced a new "Seconds" option in the date-time picker for more
precise time selection.
- Updated time formats to include seconds in the start and end time
fields.
- Enhanced the component's ability to manage relative time selections
with the addition of seconds.
- Improved handling of duration strings to recognize seconds.
- Adjusted dashboard interactions to handle date-time values more
effectively during zoom events.
- **Bug Fixes**
- Improved validation and logic for handling new time formats and
relative periods.
- Enhanced clarity and efficiency in query duration handling for search
functionality.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: ktx-abhay <abhay.padamani@kiara.tech>
Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
- Add `function`, `event`, `_timestamp` and `unit` to
`SearchHistoryHitResponse`.
- Only include `Search` events for search history
- Revert the change made in #4694 i.e. reuse `SearchHIstoryHitResponse`
for search history.
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Release Notes
- **New Features**
- Enhanced search history functionality with additional metadata fields
for more detailed responses.
- Improved error handling and logging for search history operations.
- Updated data processing logic in the Search History component for
accurate representation of timestamps and durations.
- **Bug Fixes**
- Streamlined data processing and presentation in the Search History
component, ensuring accurate display of search history data.
- **Documentation**
- Updated component and method signatures to reflect changes in data
handling and structure.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Sai Nikhil <nikhil@openobserve.ai>
1.New Fields --> executed at introduced --> this helps in user to know
when this search got executed.
2. when expands Function defination got introduced if user searched with
function then it will be displayed.
3. Pagination got introduced to show all the results by default per page
user can able to see 100 rows.
4.
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Release Notes
- **New Features**
- Enhanced search history component with pagination and improved data
handling.
- Added new fields in usage tracking to capture function-specific data.
- New method for dynamic pagination control in the search history
component.
- **Improvements**
- Streamlined search result processing by removing unnecessary
filtering.
- Improved timestamp handling in usage reporting.
- Flexible handling of the size parameter in search history retrieval.
- Refined partitioning logic and filtering capabilities in search
functionality.
- Enhanced user interface responsiveness in the search history
component.
- **Bug Fixes**
- Adjusted sorting functionality and pagination logic in the search
history component.
These updates enhance the user experience and improve data accuracy
throughout the application.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Subhradeep Chakraborty <chakrabortysubhradeep556@gmail.com>
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced sorting functionality for the search history table,
allowing users to sort by various columns.
- Enhanced data handling in the search history component for improved
clarity and usability.
- **Bug Fixes**
- Updated methods to better process and display search history data.
- **Chores**
- Added a default result size parameter to the search history query for
improved performance.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
#4677
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced user guidance in the Kubernetes configuration with clearer
URL format instructions.
- Improved readability and styling of SQL syntax guides across various
components.
- Updated the Scheduled Dashboards interface for better report filtering
and display.
- **Bug Fixes**
- Adjusted the handling of scheduled dashboards to ensure accurate
report filtering.
- **Style**
- Added hover effects and improved visual presentation of links and text
across multiple components.
- Reformatted content in the About section for better readability.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- #4682
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced error handling for search result responses to ensure valid
data formats.
- Improved logic for managing loading states and caching behavior based
on query presence.
- **Bug Fixes**
- Adjustments made to prevent runtime errors from unexpected data
structures.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced search history functionality with organization-specific
filtering.
- Added a warning message for potential delays in search history
retrieval.
- Introduced new configuration fields for usage tracking in the health
status response.
- **Bug Fixes**
- Improved error handling for search functions, enhancing traceability.
- **Chores**
- Updated the configuration management and health monitoring
capabilities for better system oversight.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Sai Nikhil <nikhil@openobserve.ai>
- #4675
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Summary by CodeRabbit
- **New Features**
- Introduced data ordering functionality for API results, allowing users
to view data in either ascending or descending order based on their
preference.
- **Bug Fixes**
- Improved handling of API responses, including enhanced error
processing and state management for a more reliable user experience.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
feat #1401
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced a tabbed interface for selecting "Web Hook" and "Email"
destination types in the Add Destination section.
- Added a new tabbed interface for template types in the Add Template
section, with conditional input fields based on selection.
- Implemented a method to navigate to the email template creation page.
- **Improvements**
- Enhanced user experience with dynamic input fields for email addresses
and validation in the Add Destination section.
- Updated the save functionality to handle new properties for templates
and destinations.
- Improved email notification logic to use template titles for email
subjects, ensuring better customization.
- Added validation to ensure destination emails are associated with the
correct organization.
- Expanded data structure to include a new title property for templates.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Subhradeep Chakraborty <chakrabortysubhradeep556@gmail.com>
This PR fixes the unlimited calling when going back and forth from the
search_history now only one call will be made until it get succeeded
search_history wont make new calls
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced search history functionality with improved data fetching and
display logic.
- Added error handling and loading state management for better user
experience.
- Improved navigation to the logs page with clearer parameter
construction.
- **Bug Fixes**
- Resolved issues with multiple fetch calls during loading states.
- Optimized row expansion to allow only one row to be expanded at a
time.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- #4552
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced drilldown functionality to utilize metadata queries for
improved flexibility.
- **Bug Fixes**
- Refined error handling logic to ensure appropriate default data is
displayed during errors based on configurations.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
This PR fixes the issues in #4663
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced search history functionality with improved state management
and visibility controls.
- Introduced a new prop `isClicked` in the search history component to
trigger fetching of search history.
- **Bug Fixes**
- Adjusted query parameter handling to prevent retention of unnecessary
properties during search history operations.
- **Refactor**
- Streamlined the logic for fetching and managing search history data,
improving clarity and efficiency.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- #4651
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Release Notes
- **New Features**
- Introduced a custom date-time picker for selecting relative time
periods in dashboard queries.
- Added functionality for managing time shifts, allowing users to
compare data points over selected time ranges.
- **Enhancements**
- Improved handling of query metadata warnings to display only the first
warning.
- Enhanced dashboard panel data management with support for time shifts
in data visualization.
- Updated SQL data conversion methods for improved processing of
multiple queries.
- **Utilities**
- Added functions for converting time offsets to seconds and vice versa.
- **Bug Fixes**
- Refined error handling in query execution and data loading processes.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: ktx-abhay <abhay.padamani@kiara.tech>
Co-authored-by: Sai Nikhil <nikhil@openobserve.ai>
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced a new component for displaying search history, allowing
users to view their past searches.
- Added a button in the search bar to easily access search history.
- Implemented a dedicated search history component with a table to
display and manage search entries, including options to copy SQL queries
and navigate to logs.
- **Bug Fixes**
- Improved navigation and visibility controls for the search history
section based on user interactions.
- **Documentation**
- Enhanced user experience with loading indicators and no-data states in
the search history component.
- Updated testing configurations for improved interaction with date-time
buttons.
- Introduced a dynamic testing configuration for the date-time button to
enhance flexibility.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Chores**
- Streamlined import statements for improved clarity.
- Reformatted code for better readability, especially in variable
processing.
- Enhanced logging statements for consistency and style.
- Simplified handling of variable values in the data loader, improving
code clarity without altering functionality.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
…oc_num to Records
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced a new button in the Enrichment Table List for exploring
enrichment tables, enhancing user navigation to detailed views.
- **Bug Fixes**
- Updated the user interface terminology by changing "Doc Num" to
"Records" for clearer data presentation.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
#4630
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced a form submission mechanism in the Panel Layout Settings,
enhancing functionality for saving panel layouts.
- Added form validation capabilities with the new `<q-form>` component.
- Enhanced validation messages with a new entry for "Value must be
greater than zero."
- **Bug Fixes**
- Updated the save button to function correctly as a form submission
button.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
#4630
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Bug Fixes**
- Improved the calculation of the row count in the dashboard panel
layout settings for better accuracy.
- **Refactor**
- Simplified the logic for determining the row count by adjusting the
height calculations.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- #4593
- #4629
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced new configuration options for dashboard table panels:
`Transpose` and `Allow Dynamic Columns`.
- Added toggle components in the configuration panel for the new table
settings.
- Enhanced data handling for dynamic column generation and table
transposition.
- **Localization**
- Added new entries for table-related functionalities in the
localization files.
- **Bug Fixes**
- Updated initialization logic to ensure default values for new
configuration properties.
- Improved error handling for variable assignments in the dashboard
components.
- **Enhancements**
- Adjusted the functionality of the data loader to improve visibility
tracking for dashboard components.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: ktx-abhay <abhay.padamani@kiara.tech>
#4630
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Added a new validation message for required fields in forms: "Value is
required."
- Enhanced the calculation for item count in the Panel Layout Settings,
improving display accuracy based on layout height.
- **Bug Fixes**
- Adjusted validation rules for number input fields to check for null,
undefined, or empty values, ensuring proper error messaging.
- Corrected the formula for pagination height to ensure accurate item
count display.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
#4630
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Release Notes
- **New Features**
- Introduced an "Edit Layout" option for interactive panel
modifications.
- Added a new component for managing panel layout settings, including
height adjustments and validation.
- Enhanced dashboard interactivity with new layout editing capabilities.
- **Localization**
- Added support for "Panel Height" in the user interface.
- **Bug Fixes**
- Improved event handling for layout updates and panel configurations.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- #4603
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced a new sorting operation for improved data presentation in
the dashboard.
- Partitions are now displayed in descending order based on their first
element for enhanced clarity.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Bug Fixes**
- Improved the logic for processing partition details based on timestamp
order, ensuring accurate evaluation of time values.
- Enhanced handling of partition arrays to accommodate ascending
timestamp conditions.
These changes will lead to more reliable data representation in the
application.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Bug Fixes**
- Adjusted the stacking order of the collapse button, which may impact
visibility and interaction.
- Modified the z-index of the table header to enhance accessibility
during user interactions.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- #4587
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced display of selected values in the Variable Custom Value
Selector to show user-friendly labels instead of raw values.
- Improved clarity when multiple options are selected by displaying the
first two labels and a count of remaining selections.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
1. cancel query improved
2. error details font reduced
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Improved handling of cancelled search queries with user notifications.
- **Bug Fixes**
- Enhanced presentation of error messages for better readability across
various components.
- **Style**
- Adjusted inline styling for error details to ensure consistency and
improved visual distinction.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- #4572
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced functionality to cancel running queries within dashboard view
panels.
- Introduced loading state management for variables and panels,
improving user experience.
- Added support for managing visualization queries alongside standard
search queries in the search bar.
- Implemented default value handling for multi-select variables to
improve control flow.
- **Bug Fixes**
- Improved button rendering logic to accurately reflect the loading
state and available actions.
- Updated UI tests to ensure accuracy in interacting with the correct
refresh button for visualizations.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: ktx-abhay <abhay.padamani@kiara.tech>
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Bug Fixes**
- Improved data handling by excluding specific keys (`_o2_id`,
`_original`) from processing in logs.
- Enhanced filtering logic in stream data to streamline the removal of
unnecessary fields.
- **Refactor**
- Improved code readability and structure in the `removeSchemaFields`
function without changing its functionality.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
This PR fixes the issues in #4565
1. Removed _o2_id from the schema list.
2. Added ErrorDetail in the logs page when error occurs details errors
can be shown.
3. Histogram rendering blank bars at the starting , this PR fixes that
rendering blank bars at the starting.
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced error reporting with detailed error messages and additional
context.
- Improved histogram data accuracy through refined timestamp handling.
- **Bug Fixes**
- Streamlined error message rendering across various components for
better user experience.
- **Refactor**
- Simplified logic for filtering schema fields in the stream data.
These updates collectively enhance the reliability and clarity of
logging and error handling within the application.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
#4564
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced report creation by capturing and storing timezone information
alongside scheduled times.
- Improved accuracy in scheduling and reporting for applications
operating across different time zones.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- #4486
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Improved handling of data integrity for panel data loading.
- Enhanced logging capabilities for better cache management and
debugging.
- **Bug Fixes**
- Addressed potential issues with stale data by ensuring fresh copies of
combined data are used.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
Co-authored-by: Kirtan Thakkar <kirtan@kiara.tech>
#4477
1. Removed keep alive from TraceDetails component
2. Fixed calculation of span block left position
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Improved responsiveness of the SpanBlock component to prop changes.
- Introduced a new watcher for base trace position updates.
- **Bug Fixes**
- Adjusted route configuration for traceDetails to improve state
management when navigating away.
- **Chores**
- Temporarily disabled automatic handling of trace details in the
TraceDetails component for debugging purposes.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
impl #4317
OpenObserve flattens ingested record by concatenating field names at
each level by a `_`. This PR attempts to restore the original record's
layered structure by enable a stream-specific setting to store original
unflatten data.
---
**A new option in StreamSettings: `store_original_data`**
A **stream-wide** setting to force two additional fields, `_o2_id` and
`_original`, to be added to the ingested JSON record, both of which will
then be used to retrieve the JSON record in its original form.
**_pros:_**
Does adhere the original JSON record's structure.
**_cons:_**
Notable impact on ingestion throughput as each record needs to be copied
and added
Additional storage cost due to the two new fields
Additional API call to to get the original JSON record.
**To get the _original record, frontend should make another request with
query such as below**
```
SELECT _original FROM {stream_name} WHERE _o2_id = xxxxxx and _timestamp = xxxxxx
```
**_note:_**
- On UI, field `_original` is not be displayed on StreamSetting page nor
the `fields` side bar on log search page. It's for internal use only.
- `_original` field will not be queried and returned with sql query such
as `SELECT * FROM {stream_name}` to combat query speed impact.
---
## How to use
Toggle `Store original data` to turn on for the desired stream(s) on
StreamSetting. In log search page, a new window will appear to show
original data when clicked.
---
## TODO
- [ ] UI update
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced a toggle for "Store Original Data" in the UI for enhanced
data retention settings.
- Added a tabbed interface in the JSON Preview component for better data
visualization, allowing users to switch between "flattened" and
"unflattened" views.
- Implemented a new function to filter out unwanted schema fields before
data storage.
- Enhanced SQL query handling to dynamically include specific columns
based on stream settings.
- Added a new field for managing original data storage in stream
settings.
- Improved data ingestion process to handle original data more
effectively.
- **Bug Fixes**
- Corrected an error message for improved clarity in the Snowflake ID
Bucket implementation.
- **Documentation**
- Updated localization files to include new keys for enhanced user
experience.
- **Style**
- Minor formatting adjustments across various components for improved
readability.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Sai Nikhil <nikhil@openobserve.ai>
Co-authored-by: Bhargav <BJP232004@GMAIL.COM>
Co-authored-by: hengfei yang <hengfei.yang@gmail.com>
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced time value determination for enrichment tables by sourcing
from statistics instead of user input.
- Expanded the `AddSettingVariable` component to support an additional
stream type: "enrichment_tables."
- **Bug Fixes**
- Improved control flow to ensure correct application behavior based on
stream type.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: ktx-abhay <abhay.padamani@kiara.tech>
- #4557
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced the DateTimePicker component with a dynamic `auto-apply`
feature for improved user experience.
- Introduced automatic application of dashboard settings in the General
Settings component.
- **Bug Fixes**
- Minor formatting adjustments made for improved code consistency.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
Subhra264
Bhargav
garlic-hub
Abhay Padamaniandktx-vaidehi
dependabot[bot]
John Vandenberg
Func
