Text
English-Polish MetricX-filtered Parallel Sentences with Qwen3 Embeddings
English-Polish MetricX-filtered Parallel Sentences with Qwen3 Embeddings
10M–100M·Custom / Research-only·Parquet
Text
2,175 results
MultimodalTabularText
undl_zh2en_aligned
联合国数字图书馆的段落级中-英对齐平行语料 用我口胡的方法弄出来的平行语料，统计数据和拿argostranslate直接又跑了一份bleu score的结果已经丢论文里了，论文在写了在写了。应该拿这份去练机翻模型没问题，数据源是人写的。 bleu score…
10M–100M·MIT·Parquet
MultimodalTabularText
Mixed Arabic Datasets (MAD) Corpus
Mixed Arabic Datasets (MAD) Corpus
100M–1B·Parquet
Text
Translate_datasets
Datasets From convert to RWKV datasets format It is recommended to shuffle before use Chinese - English &…
10M–100M·MIT·Arrow
Text
rtm-sgt-ocr-v1
Data Introduction Over 1.5 Million synthetically generated ground-truth/OCR pairs for post correction tasks from our paper "Large Synthetic…
1M–10M·Apache-2.0·CSV
MultimodalTabularText
OpenSakura Lilith LN COT Dataset
OpenSakura Lilith LN COT Dataset
100K–1M·Custom / Research-only·Parquet
Text
finetranslations-sample-ar-en
Sample of filtered and split into sentences by this script intended to be used for training sentence-level machine…
100M–1B·CC0·Parquet
Text
GH_text2code
Docstring to code data Dataset Summary This dataset contains pairs of English text and code from multiple programming…
10M–100M·Parquet
Text
Bangla–English Synthetic Parallel Corpus
Bangla–English Synthetic Parallel Corpus
>1B·CC-BY·Parquet
MultimodalTabularText
panlex-meanings
Dataset Card for panlex-meanings This is a dataset of words in several thousand languages, extracted from Dataset Details…
10M–100M·CC0·CSV
Text
IN22ConvBitextMining
IN22ConvBitextMining An MTEB dataset Massive Text Embedding Benchmark IN22-Conv is a n-way parallel conversation domain benchmark dataset for…
1K–10K·CC-BY·Parquet
MultimodalTabularText
undl_ru2en_aligned
Dataset Card for "undl ru2en aligned" More Information needed
10M–100M·MIT·Parquet
Text
Parallel_Dataset
Dataset Sources Paper: LegoMT2: Selective Asynchronous Sharded Data Parallel Training for Massive Neural Machine Translation Link: Repository:
1M–10M·MIT·JSON