Skip to content

convert : automatically fall back to HfVocab if tokenizer.model doesn't exist#5821

Merged
cebtenzzre merged 3 commits intomasterfrom
ceb/convert-vocab-fallback
Mar 2, 2024
Merged

convert : automatically fall back to HfVocab if tokenizer.model doesn't exist#5821
cebtenzzre merged 3 commits intomasterfrom
ceb/convert-vocab-fallback

Commits

Commits on Mar 1, 2024