Collection by
Jun 27
Jun 27-
FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language
Paper • 2506.20920 • Published • 75 -
HuggingFaceFW/fineweb-2
Viewer • Updated • 4.48B • 90.6k • 700 -
Scaling FineWeb to 1000+ languages: Step 1: finding signal in 100s of evaluation tasks
📝82Evaluate multilingual models using FineTasks
