it starts report this error after we upgrade to Datafusion 39, so this
PR made some changes about inverted index:
- Removed Datafusion operation and directly using RecordBatch operation
to generate invert index data.
- Removed `DEFAULT_INDEX_TRIM_CHARS` and using `ascii punctuation`.
- Set `ZO_INVERTED_INDEX_SPLIT_CHARS=""` default value to empty, then we
will using `ascii punctuation` to split token.
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **New Features**
- Added error handling in the trace service to return a `BadRequest`
response for invalid protobuf data.
- Introduced a public constant and type for file type identifier length
to improve clarity.
- **Improvements**
- Updated search functionality to use a more efficient tokenization
method.
- Refactored index generation and data processing logic for better
performance and maintainability.
- **Bug Fixes**
- Corrected error messages for unsupported `group by` operations in SQL
queries.
- Simplified and fixed validation logic in the search bar for custom
download ranges.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
The new endpoint `/config/reload` will refresh the
environment variables.
There are a bunch of env-vars which will not be reloaded
for e.g. HTTP_PORT etc. these will need a restart.
---------
Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
Add SBOM (Software Bill of Materials) for OpenObserve in cyclonedx
format. Also add instructions in README to generate fresh SBOM.
Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
Hengfei Yang
Prabhat Sharma
Ankur SrivastavaandHengfei Yang