Multilingual
575 results
Text
Parallel Corpus from United Nations Digital Library Official Document System aligned by file
Parallel Corpus from United Nations Digital Library Official Document System aligned by file
100K–1M·MIT·Parquet
AudioMultimodalText
Banque_Sonore_Dialectes_Bretons
!NOTE Dataset origin: Description Issue du site Banque Sonore des Dialectes Bretons Présentation du projet La Banque Sonore…
1K–10K·Other·Parquet
Text
DS-TF2-RO-3M — 3M English→Romanian Fable Translations
DS-TF2-RO-3M — 3M English→Romanian Fable Translations
1M–10M·MIT·Parquet
MultimodalTabularText
bhasha-sft
Bhasha SFT Bhasha SFT is a massive collection of multiple open sourced Supervised Fine-Tuning datasets for training Multilingual…
10M–100M·Mixed·Parquet
Text
LightNovel5000
Light novels translated in Chinese - crawled from public websites that do not prohibit crawlers 脚盆轻小说汉化 - 从未禁止爬虫的公共网站爬取…
<1K·Other
Text
The Vuk’uzenzele South African Multilingual Corpus
The Vuk'uzenzele South African Multilingual Corpus
1K–10K·CC-BY·Parquet
Text
IndonesianNMT
This dataset is used on the paper "Replicable Benchmarking of Neural Machine Translation (NMT) on Low-Resource Local Languages…
10K–100K
Text
tanglish-tamil
Translation of Tanglish to tamil Source: karky.in To use python import datasets s = datasets.load dataset('Deepakvictor/tanglish-tamil') print(s)…
<1K·OpenRAIL·CSV
Text
skr_trans_distill
Dataset Card for skr trans distill 本数据集由 SakuraLLM 大模型生成机器翻译结果，主要用于模型蒸馏训练。数据集包含日文原文及其对应的中文翻译，适用于日译中任务的模型训练与蒸馏。 Dataset Details Dataset Description…
10M–100M·MIT·Parquet
AudioMultimodalText
Synthetic Parallel EN-LG (external)
Synthetic Parallel EN-LG (external)
100K–1M·CC-BY·Parquet
ImageMultimodalText
LAION-COCO translated to 200 languages
LAION-COCO translated to 200 languages
100K–1M·CC-BY-NC·Parquet
MultimodalTabularText
TED Translation Decision Dataset
TED Translation Decision Dataset
<1K·CC-BY-NC·CSV
Text
WMT20 – MultiLingual Quality Estimation (MLQE) Task2
WMT20 - MultiLingual Quality Estimation (MLQE) Task2
10K–100K·Custom / Research-only·Parquet
Text
SETimes – A Parallel Corpus of English and South-East European Languages
SETimes – A Parallel Corpus of English and South-East European Languages
1M–10M·CC-BY-SA·Parquet
ImageMultimodalText
COCO-35L
Team and Homepage Official Website: Hugging Face Organization: Contact If you encounter any issues with the dataset or…
100K–1M·Parquet