Text
croissant_dataset
CroissantLLM: A Truly Bilingual French-English Language Model Dataset Licenses Data redistributed here is subject to the original license…
>1B·Arrow
Open
2,922 results
Text
IndicGenBenchFloresBitextMining
IndicGenBenchFloresBitextMining An MTEB dataset Massive Text Embedding Benchmark Flores-IN dataset is an extension of Flores dataset released as…
100K–1M·CC-BY-SA·Parquet
MultimodalTabularText
OpenSakura Eve LN Aligned Dataset
OpenSakura Eve LN Aligned Dataset
100K–1M·Custom / Research-only·Parquet
Text
WikidataLabels
Wikidata Labels Large parallel corpus for machine translation Entity label data extracted from Wikidata (2022-01-03), filtered for item…
100M–1B·CC0·Parquet
Text
MultiUN (Multilingual Corpus from United Nation Documents)
MultiUN (Multilingual Corpus from United Nation Documents)
100M–1B·Custom / Research-only·Parquet
AudioMultimodalText
Translated German-English ASR Dataset
Translated German-English ASR Dataset
1M–10M·Parquet
Text
English to Hinglish or English to Hinglish
English to Hinglish or English to Hinglish
1K–10K·Apache-2.0·Parquet
Text
BornholmBitextMining
BornholmBitextMining An MTEB dataset Massive Text Embedding Benchmark Danish Bornholmsk Parallel Corpus. Bornholmsk is a Danish dialect spoken…
1K–10K·CC-BY·Parquet
Text
United Nations Parallel Corpus
United Nations Parallel Corpus
100M–1B·Custom / Research-only·Parquet