<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced query handling with restrictions based on stream settings.
- Improved response messaging to indicate partial data availability.
- **Bug Fixes**
- Adjusted query start time when exceeding maximum duration limits,
ensuring compliance with stream settings.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
Now we use sql to plan to execute the query.
we split the PhysicalPlan to two stage:
1. Partial plan, it can be distributed will run on all the nodes.
2. Final plan, it can't be distributed will run on the leader querier
and merge the result.
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Updated to version 0.10.9, introducing enhancements and new
dependencies for improved data processing functionalities.
- Added new Protocol Buffers schemas to define structures for cluster
management and data processing frameworks, enhancing integration
capabilities.
- **Bug Fixes**
- Improved error handling in configuration to prevent runtime panics.
- Enhanced logic in caching mechanisms for more reliable query
responses.
- **Documentation**
- Added module declarations to improve organization and clarity within
the codebase.
- **Refactor**
- Streamlined execution plans and SQL processing for better performance
and maintainability.
- **Tests**
- Introduced new functions for log ingestion in test suites to enhance
reliability and coverage.
- **Style**
- Made formatting adjustments across various files to improve
readability and consistency.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Neha P <neha@openobserve.ai>
Co-authored-by: oasisk <ashish.j.kolhe@gmail.com>
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Updated critical dependencies to enhance software capabilities.
- Improved data structure management in StreamTable and Geoip
implementations for better performance and clarity.
- **Bug Fixes**
- Enhanced efficiency of entry removal in the data persistence process.
- **Chores**
- Routine updates to external package versions for improved
functionality and security.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Bug Fixes**
- Improved caching behavior and response processing in search requests.
- Enhanced error handling and response generation for better user
experience.
- **Tests**
- Disabled specific UI interaction in Playwright tests to prevent test
failures.
- **Chores**
- Updated configuration defaults to improve clarity and efficiency.
- Made internal constants publicly accessible for broader usage.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Added new fields `is_descending` and `limit` to query responses for
enhanced sorting and pagination.
- **Improvements**
- Enhanced logging and tracing for better query time tracking and
debugging.
- Streamlined span handling for more efficient tracing and
instrumentation.
- **Bug Fixes**
- Fixed validation for `result_cache_enabled` configuration to prevent
cache-related errors.
- Improved accuracy in cache limit handling in query responses.
- **Chores**
- Updated Rust toolchain version for improved compatibility and
performance.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Enhanced schema handling logic to ensure correct processing based on
metadata.
- Added bloom filter settings for specific fields in schema creation and
updates.
- **Bug Fixes**
- Improved error handling in schema index generation to manage missing
schemas effectively.
- **Chores**
- Updated version from "0.10.7" to "0.10.8".
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
The new endpoint `/config/reload` will refresh the
environment variables.
There are a bunch of env-vars which will not be reloaded
for e.g. HTTP_PORT etc. these will need a restart.
---------
Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
There are three cases to consider:
if ZO_ENABLE_EMBEDDED_REPORT_SERVER=true
If running a binary, alertmanager node will spawn an embedded server
running at localhost:5082.
All the requests from alert-manager will go to localhost:5082 for pdf
generation related tasks.
For single node k8s deployment, as this is running in a container there
is no chromium installed, so even if you set the variable to true, the
report server will panic due to missing dependencies. For this situation
helm chart will spawn a report-server instance which can be used.
Same for cluster deployment.
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Introduced a new report server for generating and sending reports.
- Added health check and report sending endpoints.
- **Improvements**
- Enhanced logging for report server operations.
- Configurable option to skip TLS verification for report server
connections.
- **Bug Fixes**
- Fixed formatting issue in HTTP status request handler.
- **Chores**
- Updated dependencies and configurations for the new report server
module.
- **Documentation**
- Added new structures and functions for email configuration, report
generation, and server operations.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
- [x] invalid peer certificate: UnknownIssuer
- [x] SSO user - infinite loop when accessing query cancelation UI
- [x] Clusters API should be accessible with SSO user
- [x] Handle _timestamp for _all fields
impl #3241
```
ZO_COMPACT_DATA_RETENTION_HISTORY = true
```
Enable this option will move the `file_list` into `file_list_history`
and don't delete files from storage.