lancedb/config.yml at d45fd80c3f7ce0f353ec0d49a9ee4459a2bf201c - lancedb - Gitea: Git with a cup of tea

rust/lancedb

mirror of https://github.com/lancedb/lancedb.git synced 2026-05-22 14:30:41 +00:00

Files

Xuanwo 9b21c136c6 feat(python): support model-backed native FTS tokenizers (#3289 )

This wires Lance's existing `jieba/*` and `lindera/*` native FTS
tokenizers through the Python SDK instead of leaving them behind
disabled features and narrow public typing. It also documents the
`LANCE_LANGUAGE_MODEL_HOME` model layout and adds Python coverage for
successful CJK indexing plus missing-model error guidance.

Closes #2168.

2026-05-08 23:53:14 +08:00

4 lines

95 B

YAML

Raw Blame History

 segmenter:
   mode: "normal"
   dictionary:
     path: "./python/tests/models/lindera/ipadic/main"