Multimodal

African Languages Lab Multi-Open

10M–100M·Custom / Research-only·Parquet

Robots Backtranslated

100K–1M·CC-BY-SA·Arrow

Quran

1K–10K·CC-BY·Parquet

Aya Collection

100M–1B·Apache-2.0·Parquet

Banque_Sonore_Dialectes_Bretons

!NOTE Dataset origin: Description Issue du site Banque Sonore des Dialectes Bretons Présentation du projet La Banque Sonore…

1K–10K·Other·Parquet

c4p0 (consolidated)

1M–10M·Custom / Research-only·Parquet

bhasha-sft

Bhasha SFT Bhasha SFT is a massive collection of multiple open sourced Supervised Fine-Tuning datasets for training Multilingual…

10M–100M·Mixed·Parquet

Synthetic Parallel EN-LG (external)

100K–1M·CC-BY·Parquet

LAION-COCO translated to 200 languages

100K–1M·CC-BY-NC·Parquet

TED Translation Decision Dataset

<1K·CC-BY-NC·CSV

wmt-human-all-TTS

WMT Human + TTS Audio WMT human evaluation data (zouharvi/wmt-human-all) extended with TTS-synthesised source audio, covering 49 language…

100K–1M·CC-BY·Parquet

COCO-35L

Team and Homepage Official Website: Hugging Face Organization: Contact If you encounter any issues with the dataset or…

100K–1M·Parquet

PolyNewsParallel

1M–10M·CC-BY-NC·Parquet

CLERC Épée v0.2 — Sign Language Data Layer

<1K·CC-BY-NC-SA

CC3M-35L

Team and Homepage Official Website: Hugging Face Organization: Contact If you encounter any issues with the dataset or…

1M–10M·Parquet

2A

10M–100M·Apache-2.0

2A

10M–100M·Apache-2.0

Audio Image Multimodal

Soul model

<1K·Apache-2.0·Text (raw)

multiclass-sentiment-analysis-dataset

10K–100K·Apache-2.0·CSV

2M-Flores – American Sign Language Flores

2M-Flores - American Sign Language Flores

1K–10K·CC-BY-SA

HAT: Hallucination Annotation for Translation

100K–1M·CC-BY-NC-ND·Parquet