build(deps): bump tokenizers from 0.21.4 to 0.22.0

Bumps [tokenizers](https://github.com/huggingface/tokenizers) from 0.21.4 to 0.22.0.
- [Release notes](https://github.com/huggingface/tokenizers/releases)
- [Changelog](https://github.com/huggingface/tokenizers/blob/main/RELEASE.md)
- [Commits](https://github.com/huggingface/tokenizers/compare/v0.21.4...v0.22.0)

---
updated-dependencies:
- dependency-name: tokenizers
  dependency-version: 0.22.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
This commit is contained in:
dependabot[bot]
2025-09-01 14:17:04 +00:00
committed by GitHub
parent 93c121da95
commit 37477c1e30
2 changed files with 3 additions and 3 deletions

View File

@@ -25,7 +25,7 @@ serde = { version = "1.0.210", features = ["derive"] }
serde_json = "1.0.143"
tar = "0.4.41"
thiserror = "2.0.16"
tokenizers = { version = "0.21.4", default-features = false }
tokenizers = { version = "0.22.0", default-features = false }
zstd = "0.13.2"
[features]