mirror of
https://github.com/openobserve/openobserve.git
synced 2026-11-05 16:10:43 +00:00
Hengfei Yang
41d0d4acb6
### **User description** - [x] Add more logs for flower - [x] Optimize parquet footer cache calculate ___ ### **PR Type** Enhancement, Bug fix ___ ### **Description** - Switch query partition strategy to enum - Improve file stats cache size accuracy - Add follower leader work-group and partition logs - Minor consistent-hash refactor for clarity ___ ### Diagram Walkthrough ```mermaid flowchart LR CFG["Config Common.feature_query_partition_strategy (enum)"] STREAM["meta/stream QueryPartitionStrategy FromStr"] FLIGHT["search/cluster/flight uses enum directly"] FOLL["super_cluster/follower adds detailed logs"] HASH["cluster get_node_from_consistent_hash minor reorder"] CACHE["file_statistics_cache counts min/max/sum sizes"] STREAM -- "provides parser" --> CFG CFG -- "typed value" --> FLIGHT FLIGHT -- "strategy choice" --> FOLL CACHE -- "more accurate memory estimate" --> FLIGHT HASH -- "clarify flow" --> FLIGHT ``` <details> <summary><h3> File Walkthrough</h3></summary> <table><thead><tr><th></th><th align="left">Relevant files</th></tr></thead><tbody><tr><td><strong>Enhancement</strong></td><td><details><summary>6 files</summary><table> <tr> <td><strong>mod.rs</strong><dd><code>Precompute hash before node-set access</code> </dd></td> <td><a href="https://github.com/openobserve/openobserve/pull/7944/files#diff-d15434a27e2b8406811f5a707b605203b603dad4a262c0642326be860bd2b568">+1/-1</a> </td> </tr> <tr> <td><strong>config.rs</strong><dd><code>Make query partition strategy a parsed enum</code> </dd></td> <td><a href="https://github.com/openobserve/openobserve/pull/7944/files#diff-9aeee4a74c0520daa40f9b81c7016f5b6b3254375b968dd7598e745630980d62">+7/-3</a> </td> </tr> <tr> <td><strong>stream.rs</strong><dd><code>Add FromStr and default for strategy enum</code> </dd></td> <td><a href="https://github.com/openobserve/openobserve/pull/7944/files#diff-2438d04c3fe97bc5452e5b74a303163b8723d93455cda32c95f0525435ad46bd">+8/-5</a> </td> </tr> <tr> <td><strong>flight.rs</strong><dd><code>Use enum-config strategy directly</code> </dd></td> <td><a href="https://github.com/openobserve/openobserve/pull/7944/files#diff-dbffb1a03b65f6a9163b18c5bb1241ba2966735657be39bbe9f4d0e3260d8c1d">+1/-2</a> </td> </tr> <tr> <td><strong>file_statistics_cache.rs</strong><dd><code>Include min/max/sum sizes in cache estimate</code> </dd></td> <td><a href="https://github.com/openobserve/openobserve/pull/7944/files#diff-5b3f948f2ad04a6babe72c15365b95a284d0533720419fa5dc793aa379783a7d">+5/-1</a> </td> </tr> <tr> <td><strong>follower.rs</strong><dd><code>Add work-group wait and partition logs</code> </dd></td> <td><a href="https://github.com/openobserve/openobserve/pull/7944/files#diff-59e0cc386582cf8baf201977475fd9a7e479fd8ed000bbaa6746a51ecb28632f">+8/-1</a> </td> </tr> </table></details></td></tr><tr><td><strong>Miscellaneous</strong></td><td><details><summary>1 files</summary><table> <tr> <td><strong>lib.rs</strong><dd><code>Remove unused async_drop feature gate</code> </dd></td> <td><a href="https://github.com/openobserve/openobserve/pull/7944/files#diff-b1a35a68f14e696205874893c07fd24fdb88882b47c23cc0e0c80a30c7d53759">+0/-1</a> </td> </tr> </table></details></td></tr></tr></tbody></table> </details> ___
36 lines
1.1 KiB
Rust
36 lines
1.1 KiB
Rust
// Copyright 2025 OpenObserve Inc.
|
|
//
|
|
// This program is free software: you can redistribute it and/or modify
|
|
// it under the terms of the GNU Affero General Public License as published by
|
|
// the Free Software Foundation, either version 3 of the License, or
|
|
// (at your option) any later version.
|
|
//
|
|
// This program is distributed in the hope that it will be useful
|
|
// but WITHOUT ANY WARRANTY; without even the implied warranty of
|
|
// MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
|
|
// GNU Affero General Public License for more details.
|
|
//
|
|
// You should have received a copy of the GNU Affero General Public License
|
|
// along with this program. If not, see <http://www.gnu.org/licenses/>.
|
|
|
|
#![feature(btree_cursors)]
|
|
#![feature(btree_extract_if)]
|
|
|
|
#[cfg(feature = "enterprise")]
|
|
pub mod cipher;
|
|
pub mod cli;
|
|
pub mod common;
|
|
pub mod handler;
|
|
pub mod job;
|
|
pub mod migration;
|
|
pub mod router;
|
|
pub mod service;
|
|
|
|
#[cfg(feature = "enterprise")]
|
|
pub mod super_cluster_queue;
|
|
|
|
pub(crate) static USER_AGENT_REGEX_FILE: &[u8] = include_bytes!(concat!(
|
|
env!("CARGO_MANIFEST_DIR"),
|
|
"/ua_regex/regexes.yaml"
|
|
));
|