Text
IN22GenBitextMining
IN22GenBitextMining An MTEB dataset Massive Text Embedding Benchmark IN22-Gen is a n-way parallel general-purpose multi-domain benchmark dataset for…
100K–1M·CC-BY·Parquet
Multilingual
575 results
Image
Marathi OCR model training dataset
Marathi OCR model training dataset
1K–10K·Apache-2.0·Images (folder)
MultimodalTabularText
CLERC Épée v0.2 — Sign Language Data Layer
CLERC Épée v0.2 — Sign Language Data Layer
<1K·CC-BY-NC-SA
ImageMultimodalText
CC3M-35L
Team and Homepage Official Website: Hugging Face Organization: Contact If you encounter any issues with the dataset or…
1M–10M·Parquet
Text
TinyStories-Multilingual
Novelist: TinyStories Multilingual Edition Dataset Summary The TinyStories Multilingual Edition is a high-fidelity synthetic dataset of short,…
10K–100K·Apache-2.0·JSON
Text
tatoeba-bitext-mining
Tatoeba An MTEB dataset Massive Text Embedding Benchmark 1,000 English-aligned sentence pairs for each language based on the…
100K–1M·CC-BY·JSON
MultimodalTabularText
HAT: Hallucination Annotation for Translation
HAT: Hallucination Annotation for Translation
100K–1M·CC-BY-NC-ND·Parquet
Text
Open PII Masking 500k Ai4Privacy Dataset
Open PII Masking 500k Ai4Privacy Dataset
100K–1M·Custom / Research-only·JSON
Text
FloresBitextMining
FloresBitextMining An MTEB dataset Massive Text Embedding Benchmark FLORES is a benchmark dataset for machine translation between English…
1K–10K·CC-BY-SA·Parquet
MultimodalTabularText
panlex-meanings
Dataset Card for panlex-meanings This is a dataset of words in several thousand languages, extracted from Dataset Details…
100M–1B·CC0·CSV
Text
Alexandria Multudialectal Arabic Conversational Dataset for Machine Translation
Alexandria Multudialectal Arabic Conversational Dataset for Machine Translation
10K–100K·CC-BY-NC·Parquet
Text
croissant_dataset
CroissantLLM: A Truly Bilingual French-English Language Model Dataset Licenses Data redistributed here is subject to the original license…
>1B·Arrow