Ultra-FineWeb

Ultra-FineWeb 📜 Technical Report 📦 UltraData Collection 🌐 UltraData 🤗 MiniCPM4 Series 🤗 MiniCPM5 Series English 中文 📚 Introduction Ultra-FineWeb is a large-scale, high-quality, and efficiently-filtered dataset. We use the proposed efficient verification-based high-quality filtering pipeline to the FineWeb and Chinese FineWeb datasets (source data from Chinese FineWeb-edu-v2, which includes IndustryCorpus2, MiChao, WuDao, SkyPile, WanJuan… See the full description on the dataset page:

Source: Hugging Face Hub (openbmb/Ultra-FineWeb). Metadata imported from the dataset’s Hub tags.