Skip to content

Update tokenizer mappings to use TokenizersBackend for additional models#46091

Merged
itazap merged 17 commits into
mainfrom
tokenizers_backend_update
Jun 19, 2026
Merged

Update tokenizer mappings to use TokenizersBackend for additional models#46091
itazap merged 17 commits into
mainfrom
tokenizers_backend_update

Merge branch 'main' into tokenizers_backend_update

9bcd753
Select commit
Loading
Failed to load commit list.
CircleCI Checks / noop succeeded Jun 19, 2026 in 45s

Workflow: noop