Yingwen b62f219810 feat: Add option to limit the files reading simultaneously (#6635) ...

* feat: limits the max number of files to scan at the same time

Signed-off-by: evenyag <realevenyag@gmail.com>

* feat: make max_concurrent_scan_files configurable

Signed-off-by: evenyag <realevenyag@gmail.com>

* feat: reduce concurrent scan files to 128

Signed-off-by: evenyag <realevenyag@gmail.com>

* docs: update config example

Signed-off-by: evenyag <realevenyag@gmail.com>

* test: add test for max_concurrent_scan_files

Signed-off-by: evenyag <realevenyag@gmail.com>

* style: fix clippy

Signed-off-by: evenyag <realevenyag@gmail.com>

* test: update config test

Signed-off-by: evenyag <realevenyag@gmail.com>

---------

Signed-off-by: evenyag <realevenyag@gmail.com>

2025-08-04 22:19:40 +08:00

..

config-docs-template.md

feat: make flow distributed work&tests (#4256)

2024-07-05 14:46:44 +00:00

config.md

feat: Add option to limit the files reading simultaneously (#6635)

2025-08-04 22:19:40 +08:00

datanode.example.toml

feat: Add option to limit the files reading simultaneously (#6635)

2025-08-04 22:19:40 +08:00

flownode.example.toml

refactor: add SlowQueryRecorder to record slow query in system table and refactor slow query options (#6008)

2025-05-15 04:18:48 +00:00

frontend.example.toml

chore: add option for arrow flight compression mode (#6283)

2025-06-11 06:54:10 +00:00

metasrv.example.toml

feat: refactor grpc options of metasrv (#6275)

2025-06-10 01:35:57 +00:00

standalone.example.toml

feat: Add option to limit the files reading simultaneously (#6635)

2025-08-04 22:19:40 +08:00