monolingual GPT-BERT language models
AI & ML interests
Web as a corpus, Large Language Models, Machine Translation, Language Technologies, Natural Language Processing, Internet Archive, CommonCrawl
Recent Activity
Papers
OpenLID-v3: Improving the Precision of Closely Related Language Identification -- An Experience Report
DHPLT: large-scale multilingual diachronic corpora and word representations for semantic change modelling
Llama-2b ablation models released as part of HPLT 3.0
Llama-2b ablation models released as part of HPLT 3.0
This is a collection of decoder-only language models trained on HPLT2.0_cleaned.
monolingual encoder-only language models
HPLT's MT releases. https://github.com/hplt-project/HPLT-MT-Models
monolingual encoder-only language models
Language-specific LLMs continually pre-trained from fully open English base models
monolingual encoder-decoder language models
Llama-2b ablation models released as part of HPLT 3.0
HPLT's MT releases. https://github.com/hplt-project/HPLT-MT-Models
Translation models trained on OPUS data including HPLT datasets
-
Helsinki-NLP/opus-mt-tc-bible-big-aav-fra_ita_por_spa
Translation • 0.2B • Updated • 7 • 2 -
Helsinki-NLP/opus-mt-tc-bible-big-afa-en
Translation • 0.2B • Updated • 11 • 1 -
Helsinki-NLP/opus-mt-tc-bible-big-afa-deu_eng_fra_por_spa
Translation • 0.2B • Updated • 23 -
Helsinki-NLP/opus-mt-tc-bible-big-afa-deu_eng_nld
Translation • 0.2B • Updated • 10 • 2
MaLA-LM: Massive Language Adaptation of Large Language Models
monolingual GPT-BERT language models
Language-specific LLMs continually pre-trained from fully open English base models
Llama-2b ablation models released as part of HPLT 3.0
monolingual encoder-decoder language models
Llama-2b ablation models released as part of HPLT 3.0
Llama-2b ablation models released as part of HPLT 3.0
This is a collection of decoder-only language models trained on HPLT2.0_cleaned.
HPLT's MT releases. https://github.com/hplt-project/HPLT-MT-Models
monolingual encoder-only language models
Translation models trained on OPUS data including HPLT datasets
-
Helsinki-NLP/opus-mt-tc-bible-big-aav-fra_ita_por_spa
Translation • 0.2B • Updated • 7 • 2 -
Helsinki-NLP/opus-mt-tc-bible-big-afa-en
Translation • 0.2B • Updated • 11 • 1 -
Helsinki-NLP/opus-mt-tc-bible-big-afa-deu_eng_fra_por_spa
Translation • 0.2B • Updated • 23 -
Helsinki-NLP/opus-mt-tc-bible-big-afa-deu_eng_nld
Translation • 0.2B • Updated • 10 • 2
HPLT's MT releases. https://github.com/hplt-project/HPLT-MT-Models
monolingual encoder-only language models
MaLA-LM: Massive Language Adaptation of Large Language Models