Models

GlowCheese/minBERT

Text Classification • Updated Dec 4, 2024 • 1

AhmetSemih/tr_tokenizer

Updated Dec 26, 2024

aliarda/turkish_tokenizer

Updated Dec 3, 2024 • 1

aliarda/turkish_tokenizer_256k

Updated Dec 4, 2024 • 1

tejagowda/t5-hebrew-translation

Text Classification • 0.2B • Updated Dec 7, 2024 • 11

aloobun/IN-Llama-3-Tokenizer

Updated Mar 7, 2025

clearloop/tokenizer

Updated Jan 7, 2025

Saiteja/telugu-bpe

Updated Jan 5, 2025 • 4

aayushraina/hindi-bpe-tokenizer

Text Generation • Updated Jan 11, 2025

aayushraina/bpe-hindi

Text Generation • Updated Jan 11, 2025

physical-intelligence/fast

Robotics • Updated Jan 16, 2025 • 161

InterwebAlchemy/PGNTokenizer

Updated Feb 11, 2025 • 1

sachin6624/sachin-gpt2-tokenizer

Updated Feb 3, 2025 • 1

Ornaments/72k-Bilingual-BBPE-TK-SPM-Identity

Updated Feb 18, 2025

Ornaments/72k-TK-BBPE-HF

Updated Feb 18, 2025

savath/laonlp-enhanced

Updated Feb 21, 2025

mishmish66/throwing_fast

Robotics • Updated Feb 28, 2025

Adiii143/code-search-net-tokenizer

Updated Mar 12, 2025

TuKoResearch/WavCochV8192

Feature Extraction • 11.1M • Updated Aug 19, 2025 • 10

mishmish66/trying-fast

Robotics • Updated Apr 22, 2025

deshanksuman/romanized-sinhala-tokenizer

Updated Sep 14, 2025

Namuun123/mn_sentencepiece_tokenizer

Updated Apr 25, 2025

luispintoc/MoleBERT-Tokenizer-NbTMC_scratch_150k_20ep

2.17M • Updated May 9, 2025 • 5

luispintoc/MoleBERT-Tokenizer-NbTMC_scratch_400k_30ep

2.17M • Updated May 9, 2025 • 5

ArabovMK/tajik-tokenizers-v1

Updated May 10, 2025

neghny/segmo

Updated May 15, 2025

Hailay/geez-tokenizer

Token Classification • Updated Jul 15, 2025

thuml/rt1-compressive-tokenizer

Updated May 22, 2025 • 26

thuml/rt1-frame-tokenizer

Updated May 22, 2025 • 14

Johnnyman1100/EZ-Tokenizer

Token Classification • Updated May 30, 2025