Commit Graph
2326 Commits
Author SHA1 Message Date
Bhargav 337e973a70 fix: issue#4144 corrected type (#4146)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Enhanced stream retrieval functionality by adapting the filtering
mechanism to use stream types instead of selected streams, improving the
accessibility of streams in the application.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-07 19:44:05 +05:30
Sai Nikhil 6ec7dbba42 fix: #4142 Histogram chart display in saved view (#4145)
#4142  got solved by this PR

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **New Features**
- Enhanced the search functionality to refresh histogram data
automatically upon initiating a search, ensuring users see the most
current results.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-07 19:21:46 +05:30
Bhargav ebbd241142 fix: duplicate call on page refresh (#4139)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Improved user experience with enhanced loading state management during
log data retrieval.
- **Bug Fixes**
- Streamlined error handling to ensure loading states accurately reflect
data retrieval processes.
- **Refactor**
- Enhanced code readability and maintainability by simplifying logic and
improving variable formatting.
- **Chores**
	- Removed unnecessary commented-out code to clean up the codebase.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-07 18:53:18 +05:30
Hengfei Yang 1afd08c55e chore: add debug logs for router (#4143) 2024-08-07 21:00:03 +08:00
Sai Nikhil 6a289a75ad fix: #4098 loading icon stops when error in values api (#4128)
This PR fixes #4098 so when there is an error in values api then the
spinner / loading icon will be stopped and as well as it shows no value
found

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **Bug Fixes**
- Enhanced error handling in the IndexList component to ensure accurate
loading states during asynchronous operations, preventing indefinite
loading indicators and improving overall user experience.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-07 18:11:47 +05:30
Subhra264andomkark06 89a912e7dd fix: do not allow * in first column of alert and report cron expression and introduce vrl in alerts (#4126)
- Replace first column `*` with the current second in cron expression
while saving report and alerts
- Introduce vrl functions in alerts. The new field `vrl_function` in
alert payload stores the vrl function in the alert in base64 encoded
format.

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

## Summary by CodeRabbit

- **New Features**
- Introduced an optional field for alerts to allow the association of
VRL functions.
- Enhanced scheduling for alerts and reports by dynamically modifying
cron expressions to include the current second.
- Added a VRL function editor in the Scheduled Alert component for
improved query editing, with toggles for enhanced user interactivity.
- Improved query construction with optional parameters and enhanced
error handling for timestamp handling.

- **Bug Fixes**
- Improved robustness of the alert and report scheduling systems with
better handling of cron expressions.
- Enhanced error handling for decoding failures related to VRL functions
in alerts.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: omkark06 <omkar@zinclabs.io>
2024-08-07 17:40:45 +05:30
Hengfei Yang 5eb1ab91fe fix: some small issues of alert (#4140) 2024-08-07 18:11:00 +08:00
Shashi Kant a7e29e5991 fix: top-level parenthesized sub-expressions (#4093) 2024-08-07 15:06:52 +08:00
Hengfei Yang 564ac641a8 fix: should exit when backend init failed (#4138) 2024-08-07 14:47:50 +08:00
Hengfei Yang b9dac884b0 fix: search pagination error (#4135) 2024-08-06 23:42:57 +08:00
Hengfei Yang 0e9df3dcbc fix: value api for number values (#4134) 2024-08-06 21:37:21 +08:00
Sai Nikhil 3a2655bc0d fix: #4114 error message when entering incorrect old password (#4132) 2024-08-06 20:57:28 +08:00
Hengfei Yang 78e3389781 fix: rum token deadlock (#4131) 2024-08-06 20:38:44 +08:00
Bhargav 66226f01a3 fix: reduced default settings of total number of events per page (#4041)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **New Features**
- Adjusted the logs display settings to show fewer rows per page (from
250 to 100), enhancing navigation and making log entries more manageable
for users.

- **Bug Fixes**
- Updated test cases to reflect the change in pagination display,
ensuring consistency between the UI and the expected outcomes in tests.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-06 14:31:53 +05:30
Sai NikhilandBhargav 94708e5a75 fix: restricting users to use select all (*) while creating alerts in SQL mode (#4083)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **New Features**
- Enhanced the alert submission process with strict validation for SQL
queries to prevent selection of all columns.

- **Bug Fixes**
- Improved control flow in the alert form, ensuring form submission only
occurs with valid SQL queries.

- **Style**
	- Minor formatting adjustments made for improved readability.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Bhargav <BJP232004@GMAIL.COM>
2024-08-06 11:43:43 +05:30
Hengfei Yang 4181ca3b0b fix: rum token invalid when user update (#4122)
When user update we `clean` the `USER_RUM_TOKEN` and in the next we
never set `{DEFAULT_ORG}/{token}` back to `USER_RUM_TOKEN`, so the RUM
ingestion report token not found for root user.

The solution is we don't `clean` the tokens, just `remove` the token
which already invalid. also will add `{DEFAULT_ORG}/{token}` if it is
root user when we fetch data from db.
2024-08-05 22:23:17 -07:00
udevandHengfei Yang f3a6fd4faa fix: add check to avoid root user role change (#4120)
fixes #4115 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Enhanced security for user role management by preventing changes to
the role of users with the 'Root' designation during updates.
  
- **Bug Fixes**
- Resolved potential privilege escalation by ensuring only non-'Root'
user roles can be modified.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->

Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
2024-08-06 10:00:15 +05:30
Prabhat Sharma 8fb65acf80 chore: modify roadmap and cost (#4121)
Modified ability to influence OpenObserve roadmap and cost details.
2024-08-05 13:41:15 -07:00
dependabot[bot] 050dc61179 chore(deps): bump EmbarkStudios/cargo-deny-action from 1.6.3 to 2.0.1 (#4119) 2024-08-05 23:26:04 +08:00
Hengfei Yang 46c7e067f8 fix: parse index error when using field is null (#4118)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Bug Fixes**
- Enhanced data handling to prevent processing of empty values, ensuring
more robust performance.
- Improved control flow to skip unnecessary actions for iterations with
empty results.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-05 18:54:49 +05:30
Sai Nikhil 5724ba1bb9 fix: pagination part fix (#4096)
1. Logs count fix when moving back and forth (this was the issue that
came up when I have fixed the different logs count showing at first )
2. Fixed another issue that onMount in histogram mode when we move to
any other page and comeback to first page it shows 0 total count.

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **New Features**
- Enhanced handling of query results for improved accuracy in data
representation.
- Introduced dynamic time parameters for queries based on pagination,
optimizing data retrieval.

- **Bug Fixes**
- Addressed potential discrepancies in the total count of query results.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-05 17:55:18 +05:30
Sai Nikhil 4bc119342a fix: #4003 batch deletion feature introduced (#4071)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **New Features**
- Introduced batch deletion functionality for log streams, allowing
users to delete multiple streams at once.
	- Added a confirmation dialog to confirm batch deletion actions.
	- New button for initiating batch deletion based on selection state.

- **UI Enhancements**
- Updated user interface to better support batch operations and improve
user feedback.
	- Minor styling adjustments for seamless integration of new features.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-05 17:31:42 +05:30
df2488fa44 feat: optimize sql to plan execution (#4100)
Now we use sql to plan to execute the query. 

we split the PhysicalPlan to two stage:
1. Partial plan, it can be distributed will run on all the nodes.
2. Final plan, it can't be distributed will run on the leader querier
and merge the result.

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **New Features**
- Updated to version 0.10.9, introducing enhancements and new
dependencies for improved data processing functionalities.
- Added new Protocol Buffers schemas to define structures for cluster
management and data processing frameworks, enhancing integration
capabilities.

- **Bug Fixes**
  - Improved error handling in configuration to prevent runtime panics.
- Enhanced logic in caching mechanisms for more reliable query
responses.

- **Documentation**
- Added module declarations to improve organization and clarity within
the codebase.

- **Refactor**
- Streamlined execution plans and SQL processing for better performance
and maintainability.

- **Tests**
- Introduced new functions for log ingestion in test suites to enhance
reliability and coverage.

- **Style**
- Made formatting adjustments across various files to improve
readability and consistency.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Neha P <neha@openobserve.ai>
Co-authored-by: oasisk <ashish.j.kolhe@gmail.com>
2024-08-05 18:38:35 +08:00
ktx-akshay 355591cbef test: testcases for visualization functionality (#4061)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Expanded automated testing coverage by adding new UI test files for
dashboard management and logging visualization functionalities.
- Enhanced dashboard UI tests now cover creating, modifying,
duplicating, and applying filters to dashboards.
- Introduced tests for verifying user interactions with logging
visualizations, including error handling and data persistence.
- Added tests for Virtual Reference Language (VRL) features within the
dashboard, validating function applications and error handling.

- **Bug Fixes**
- Improved error handling in UI tests to ensure that invalid inputs
trigger appropriate error messages.

- **Tests**
- Comprehensive test cases implemented for various user interactions
across new features, ensuring functionality works as intended.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-05 14:26:57 +05:30
Bhargav a43abb7515 fix: default timestamp column on logs page (#3860)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **New Features**
  - Introduced a new boolean field to enhance log search functionality.

- **Improvements**
- Updated log search logic to include a timestamp column when
applicable.
- Enhanced UI elements for conditional rendering based on log search
criteria, improving clarity and relevance.

- **Tests**
- Updated UI testing scripts to reflect changes in focus from the
timestamp field to the job field, ensuring alignment with the updated
application interface.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-05 11:57:04 +05:30
Ashish Kolhe 8ec1be9eaa chore: upgrade vrl version (#4105)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **New Features**
	- Updated critical dependencies to enhance software capabilities.
- Improved data structure management in StreamTable and Geoip
implementations for better performance and clarity.

- **Bug Fixes**
	- Enhanced efficiency of entry removal in the data persistence process.

- **Chores**
- Routine updates to external package versions for improved
functionality and security.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-05 09:29:01 +05:30
udevandHengfei Yang 4e8bace735 fix: allow IPv6 addresses in RUM headers (#4111)
fixes #4080

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Improved IP address parsing logic to handle both `IpAddr` and
`SocketAddr`, enhancing versatility with input formats.
- Added a fallback mechanism to default to the loopback address in case
of parsing failure.

- **Bug Fixes**
- Enhanced error handling in IP address parsing to ensure functionality
with invalid input.

- **Tests**
- Introduced a new test function to validate the updated IP
parsing logic against various formats.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
2024-08-04 11:15:48 +05:30
Taiming Liu 0a6a7914a5 fix: add req_node_group back to node selection in search (#4113)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Enhanced the search functionality to target specific node groups,
potentially improving retrieval speed and relevance of results.
  
- **Bug Fixes**
- Maintained existing error handling for online querier nodes, ensuring
consistent performance during node retrieval.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-02 21:44:56 +05:30
Bhargav 4db3afd6d6 fix: histogram will be updated when run query button will be pressed … (#4112)
…or page refresh will be done

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Introduced a new `refreshHistogram` property to improve histogram
management within the logs component.
- Enhanced the logs visualization to refresh the histogram in real-time
when toggling log views.

- **Bug Fixes**
- Corrected conditions for refreshing the histogram to ensure data
accuracy based on user interactions.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-02 17:23:53 +05:30
Bhargav 20ac789c98 Logs page histogram partition (#4102)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **New Features**
- Enhanced error handling for clearer and more consistent messaging in
the application.
- Improved logic for histogram data processing, including new checks for
multi-stream searches.
- Introduced a method to directly access and redraw chart data in the
SearchResult component, boosting chart interactivity.

- **Improvements**
- Standardized handling of time intervals for generating consistent
histogram results.
- Reactivity enhancements allow charts to update accurately with changes
in underlying data.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-08-02 16:04:06 +05:30
Hengfei Yang 233b875ddb feat: add some logs for alert (#4109) 2024-08-02 16:10:10 +08:00
Juan Calderon-Perez 3f6e48c199 chore: Bump PR debian image (#4108) 2024-08-02 15:23:48 +08:00
Juan Calderon-Perez 29b7ca1347 chore: Bump Node.js to v18.20.4 (#4107) 2024-08-02 15:23:14 +08:00
Huaijin caed2c8c75 fix: use config timestamp and error message improve (#4104) 2024-08-01 20:44:35 +08:00
Hengfei Yang d2bfb960dd fix: multi stream search panic (#4101) 2024-08-01 18:14:16 +08:00
Abhay Padamani db1ca05b2a fix: logs page histogram resize issue while toggle from visualize to logs (#4095)
- #4094 

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Improved chart responsiveness by dispatching resize events when the
visualization toggle state changes.
- **Bug Fixes**
- Enhanced event listener management to prevent multiple registrations,
improving performance and preventing memory leaks.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-07-31 17:43:30 +05:30
Sai Nikhil 81399517ff fix: no preview message for SQL mode (#4070)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Added a conditional message in the Preview Alert to inform users when
a preview is not available in SQL mode, enhancing user feedback.

- **Style**
- Introduced new styling for the SQL preview message to improve visual
presentation and readability.

- **Chores**
- Minor formatting adjustment in the Add Alert component for improved
code readability without affecting functionality.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-07-31 14:31:34 +05:30
Sai Nikhil 56bf447c19 fix: #3630 solved cmd + enter issue (#4023)
Removed Monoco-single-line dependency
When user clicks on Ctrl + enter (windows) or Cmd + enter (max) in query
mode or vrl function editor
run query runs


<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced a keyboard shortcut (Ctrl + Enter) in the Search Bar for
executing queries, enhancing user experience and interactivity.

- **Dependency Updates**
- Updated the dependency from `vue-monaco-singleline` to
`monaco-editor-vue`, which may introduce new features and optimizations
for the Monaco Editor integration.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-07-31 11:28:05 +05:30
Sai Nikhil 69f352f569 fix: #3975 fixed incorrect logs count showing on query search at first (#4040)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **Improvements**
- Enhanced handling of query results and total count for improved data
accuracy.
- Adjusted logic for calculating total count during pagination to
increase reliability.
- Refined histogram data generation, potentially impacting presentation
clarity.

- **Style**
	- Minor formatting updates for improved code readability.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-07-31 10:41:55 +05:30
Sai Nikhil 3943c8ca19 fix: Reduced vertical spacing between and in the folders of the dashboard (#4039)
In the dashboards page folders vertical space in the folders and between
the folders made reduced

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **New Features**
- Enhanced the layout and styling of the dashboard interface for
improved visual clarity.
    - Introduced a separator between tabs for better distinction.

- **Style**
- Added a new CSS class to improve tab styling, including adjustments to
spacing and visual hierarchy.
- Minor style corrections to ensure consistency across the dashboard
component.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-07-31 10:03:12 +05:30
Hengfei Yang 8a0dbe2cf4 feat: remove sql_mode, query_context and aggs from search API (#4089) 2024-07-31 11:23:11 +08:00
Hengfei Yang 3802004889 feat: add median support for aggregation (#4088) 2024-07-31 09:48:50 +08:00
ktx-abhay 42359ddc5b feat: predefined function support for dashboard (#4082)
- Toggle button to use VRL function editor.
- Use predefined/saved function.

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **New Features**
- Introduced a toggle feature for a VRL function editor in the
dashboard, allowing users to show or hide the editor.
- Added a dropdown menu for selecting saved VRL functions, enhancing
query management.
- Implemented a new method to update and manage virtual function fields
dynamically based on user interactions.

- **Bug Fixes**
- Simplified visibility logic in components to enhance the user
interface responsiveness.

- **Chores**
- Adjusted layouts and improved code formatting for better clarity and
consistency.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
v0.10.9-rc3
2024-07-29 17:02:54 +05:30
Hengfei Yang 03567a33a2 fix: return single partition if this is an aggregation query (#4081)
fixed #4077 
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Enhanced the search functionality to support aggregate queries,
allowing for more efficient data handling in search results.
  
- **Bug Fixes**
- Improved response structure for aggregate queries to simplify user
experience.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-07-29 09:15:40 +05:30
Hengfei Yang 742c259bf7 fix: remove ZO_BLOOM_FILTER_ON_ALL_FIELDS (#4078)
`ZO_BLOOM_FILTER_ON_ALL_FIELDS` will huge increase parquet file size and
memory usage when the fields num over 1000 in a stream.

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Simplified configuration for bloom filters by removing the
`bloom_filter_on_all_fields` option.
  
- **Bug Fixes**
- Streamlined logic in the bloom filter configuration handling, ensuring
consistent field processing.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-07-27 12:28:14 -07:00
Hengfei Yang 4eb9fcfa26 fix: added wrong _timestamp with distinct (#4076)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Enhanced query handling to recognize aggregate queries that utilize
the `DISTINCT` keyword, improving correctness and efficiency in query
processing.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-07-26 23:57:09 +05:30
Hengfei Yang 2dcd4844f2 fix: panic when the ip_address is invalid (#4068) 2024-07-27 01:21:47 +08:00
Bhargav 9d7ce8e259 fix: added workgroup column in query management table (#4075)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Introduced a new column for "Work Group" in the Running Queries list,
enhancing data visibility and sorting capabilities.
- Updated filtering logic to include "Work Group," allowing users to
refine their query results more effectively.
- Added localization support for the new query type label in the English
language strings.

These improvements collectively enhance user interaction and data
representation within the application.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-07-26 20:20:57 +05:30
Ashish Kolhe 21f3166d12 fix:clean in memory cache references (#4074)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **New Features**
- Improved disk cache management with targeted removal of specific
result files during the garbage collection process, enhancing memory
usage and overall application performance.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-07-26 19:00:16 +05:30
ktx-abhay 0485f0d392 fix: visualization query parse issue (#4073)
-  Error while parsing `histogram` query.

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **New Features**
- Enhanced data handling for aggregation functions to support more
complex input structures, improving overall query accuracy.

- **Bug Fixes**
- Resolved issues with aggregation function assignment by adapting to
new data structure conventions, ensuring consistent behavior.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-07-26 17:59:13 +05:30