Text
The Vuk’uzenzele South African Multilingual Corpus
The Vuk'uzenzele South African Multilingual Corpus
1K–10K·CC-BY·Parquet
Translation
253 results
Text
IndonesianNMT
This dataset is used on the paper "Replicable Benchmarking of Neural Machine Translation (NMT) on Low-Resource Local Languages…
10K–100K
Text
tanglish-tamil
Translation of Tanglish to tamil Source: karky.in To use python import datasets s = datasets.load dataset('Deepakvictor/tanglish-tamil') print(s)…
<1K·OpenRAIL·CSV
Text
skr_trans_distill
Dataset Card for skr trans distill 本数据集由 SakuraLLM 大模型生成机器翻译结果，主要用于模型蒸馏训练。数据集包含日文原文及其对应的中文翻译，适用于日译中任务的模型训练与蒸馏。 Dataset Details Dataset Description…
10M–100M·MIT·Parquet
Text
mala-bilingual-translation-corpus
MaLA Corpus: Massive Language Adaptation Corpus This MaLA-LM/mala-bilingual-translation-corpus is the MaLA bilingual translation corpus, collected…
>1B·ODC-BY·Parquet
AudioMultimodalText
Synthetic Parallel EN-LG (external)
Synthetic Parallel EN-LG (external)
100K–1M·CC-BY·Parquet
ImageMultimodalText
LAION-COCO translated to 200 languages
LAION-COCO translated to 200 languages
100K–1M·CC-BY-NC·Parquet
Video
LSA-T — Continuous Argentinian Sign Language
LSA-T — Continuous Argentinian Sign Language
1K–10K·Custom / Research-only
MultimodalTabularText
TED Translation Decision Dataset
TED Translation Decision Dataset
<1K·CC-BY-NC·CSV
Text
WMT20 – MultiLingual Quality Estimation (MLQE) Task2
WMT20 - MultiLingual Quality Estimation (MLQE) Task2
10K–100K·Custom / Research-only·Parquet
Text
SETimes – A Parallel Corpus of English and South-East European Languages
SETimes – A Parallel Corpus of English and South-East European Languages
1M–10M·CC-BY-SA·Parquet
AudioMultimodalText
wmt-human-all-TTS
WMT Human + TTS Audio WMT human evaluation data (zouharvi/wmt-human-all) extended with TTS-synthesised source audio, covering 49 language…
100K–1M·CC-BY·Parquet
ImageMultimodalText
COCO-35L
Team and Homepage Official Website: Hugging Face Organization: Contact If you encounter any issues with the dataset or…
100K–1M·Parquet
Text
Shaistagi (شائستگی) Clean Urdu Mega-Dataset
Shaistagi (شائستگی) Clean Urdu Mega-Dataset
100M–1B·Apache-2.0·Parquet
Text
IN22GenBitextMining
IN22GenBitextMining An MTEB dataset Massive Text Embedding Benchmark IN22-Gen is a n-way parallel general-purpose multi-domain benchmark dataset for…
100K–1M·CC-BY·Parquet
Image
Marathi OCR model training dataset
Marathi OCR model training dataset
1K–10K·Apache-2.0·Images (folder)
MultimodalTabularText
CLERC Épée v0.2 — Sign Language Data Layer
CLERC Épée v0.2 — Sign Language Data Layer
<1K·CC-BY-NC-SA