Skip to content
Advertisement
Tabular

DeMix_Corpora

Dataset Card for DeMix Corpora DeMix šŸ“„ Paper: Decouple Searching from Training: Scaling Data Mixing via Model Merging for Large Language Model…

Dataset Card for DeMix Corpora DeMix šŸ“„ Paper: Decouple Searching from Training: Scaling Data Mixing via Model Merging for Large Language Model Pre-training šŸ¤— Dataset: DeMix Corpora 🐱 Github: Demix Dataset Details Dataset Description DeMix Corpora (15T original tokens and 22T mixture tokens) serves as a comprehensive, high-quality, large-scale, and carefully mixed resource that can be directly employed for pre-training. (2026.2.7: This is an… See the full description on the dataset page: Corpora.

Source: Hugging Face Hub (lucius1022/DeMix_Corpora). Metadata imported from the dataset’s Hub tags.

Advertisement