Parquet
1,501 results
quickmt-train.zh-en
quickmt zh-en Training Corpus Contains the following datasets downloaded with mtdata after deduplication and basic filtering with quickmt:…
Gov-ZA Cabinet Statements (Sentence-Aligned)
Gov-ZA Cabinet Statements (Sentence-Aligned)
Parallel Corpus from United Nations Digital Library Official Document System aligned by file
Parallel Corpus from United Nations Digital Library Official Document System aligned by file
Banque_Sonore_Dialectes_Bretons
!NOTE Dataset origin: Description Issue du site Banque Sonore des Dialectes Bretons Présentation du projet La Banque Sonore…
DS-TF2-RO-3M — 3M English→Romanian Fable Translations
DS-TF2-RO-3M — 3M English→Romanian Fable Translations
bhasha-sft
Bhasha SFT Bhasha SFT is a massive collection of multiple open sourced Supervised Fine-Tuning datasets for training Multilingual…
The Vuk’uzenzele South African Multilingual Corpus
The Vuk'uzenzele South African Multilingual Corpus
skr_trans_distill
Dataset Card for skr trans distill 本数据集由 SakuraLLM 大模型生成机器翻译结果,主要用于模型蒸馏训练。数据集包含日文原文及其对应的中文翻译,适用于日译中任务的模型训练与蒸馏。 Dataset Details Dataset Description…
mala-bilingual-translation-corpus
MaLA Corpus: Massive Language Adaptation Corpus This MaLA-LM/mala-bilingual-translation-corpus is the MaLA bilingual translation corpus, collected…
Synthetic Parallel EN-LG (external)
Synthetic Parallel EN-LG (external)
LAION-COCO translated to 200 languages
LAION-COCO translated to 200 languages
WMT20 – MultiLingual Quality Estimation (MLQE) Task2
WMT20 - MultiLingual Quality Estimation (MLQE) Task2