HPLT2-JQL-Education

HPLT2-Edu-scores Dataset summary HPLT2-JQL-Education is a model-annotated language subset of HPLT2, spanning 35 languages. Our model-annotations allow for a filtering that achieves higher-quality training outcomes without excessively aggressive data reduction. The original FW2 heuristic filtering method serves as our baseline, providing reference points for both the volume of retained tokens and downstream model performance. For example, in the Spanish language case… See the full description on the dataset page: edu scores.

Source: Hugging Face Hub (JQL-AI/hplt2_edu_scores). Metadata imported from the dataset’s Hub tags.