OELLM SPM Tokenizer with 128K tokens. It is trained with a config similar to that of GemmaTokenizer.
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
OELLM SPM Tokenizer with 128K tokens. It is trained with a config similar to that of GemmaTokenizer.