Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
huggingface 's Collections
DistilBERT release

DistilBERT release

updated Apr 17, 2024

Original DistilBERT model, checkpoints obtained from using teacher-student learning from the original BERT checkpoints.

Upvote
29

  • distilbert/distilbert-base-cased

    Fill-Mask • 65.8M • Updated May 6, 2024 • 129k • • 53

  • distilbert/distilbert-base-uncased

    Fill-Mask • 67M • Updated May 6, 2024 • 14.5M • • 782

  • distilbert/distilbert-base-multilingual-cased

    Fill-Mask • 0.1B • Updated May 6, 2024 • 975k • • 221

  • distilbert/distilbert-base-uncased-finetuned-sst-2-english

    Text Classification • 67M • Updated Dec 19, 2023 • 6.29M • • 842

  • distilbert/distilbert-base-uncased-distilled-squad

    Question Answering • 66.4M • Updated May 6, 2024 • 99k • • 118

  • distilbert/distilbert-base-cased-distilled-squad

    Question Answering • 65.2M • Updated May 6, 2024 • 215k • • 263
Upvote
29
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs