HPLT

community

hplt_eu

AI & ML interests

Web as a corpus, Large Language Models, Machine Translation, Language Technologies, Natural Language Processing, Internet Archive, CommonCrawl

Recent Activity

MariaFjodorowa updated a model about 7 hours ago

HPLT/hplt_t5_base_3_0_heb_Hebr

MariaFjodorowa updated a model about 7 hours ago

HPLT/hplt_t5_base_3_0_hrv_Latn

MariaFjodorowa updated a model about 7 hours ago

HPLT/hplt_t5_base_3_0_glg_Latn

View all activity

Organization Card

Community About org cards

https://hplt-project.org/

Our project name, HPLT, is an acronym for High Performance Language Technologies. We combine large quantities of data, a number of languages and high-performance computing to build powerful and efficient datasets for language and translation models. Another goal of HPLT is to publish the results of this project in a shared space with open licenses.

Version 3 of the HPLT datasets (198 languages):
- https://hplt-project.org/datasets/v3.0
- https://hf.co/datasets/HPLT/HPLT3.0
HPLT datasets ACL'2025 paper
Version 2 of the HPLT datasets (193 languages):
- https://hplt-project.org/datasets/v2.0
- https://hf.co/datasets/HPLT/HPLT2.0_cleaned
Version 1.2 of the HPLT datasets (75 languages):
- https://hplt-project.org/datasets/v1.2
- https://huggingface.co/datasets/HPLT/hplt_monolingual_v1_2

This project has received funding from the European Union’s Horizon Europe research and innovation programme under grant agreement No 101070350 and from UK Research and Innovation (UKRI) under the UK government’s Horizon Europe funding guarantee [grant number 10052546]