mirror of
https://github.com/openobserve/openobserve.git
synced 2026-11-06 08:09:24 +00:00
it starts report this error after we upgrade to Datafusion 39, so this PR made some changes about inverted index: - Removed Datafusion operation and directly using RecordBatch operation to generate invert index data. - Removed `DEFAULT_INDEX_TRIM_CHARS` and using `ascii punctuation`. - Set `ZO_INVERTED_INDEX_SPLIT_CHARS=""` default value to empty, then we will using `ascii punctuation` to split token. <!-- This is an auto-generated comment: release notes by coderabbit.ai --> ## Summary by CodeRabbit - **New Features** - Added error handling in the trace service to return a `BadRequest` response for invalid protobuf data. - Introduced a public constant and type for file type identifier length to improve clarity. - **Improvements** - Updated search functionality to use a more efficient tokenization method. - Refactored index generation and data processing logic for better performance and maintainability. - **Bug Fixes** - Corrected error messages for unsupported `group by` operations in SQL queries. - Simplified and fixed validation logic in the search bar for custom download ranges. <!-- end of auto-generated comment: release notes by coderabbit.ai -->