FineWeb2-HQ / FineWeb-HQ
dataset"Enhancing Multilingual LLM Pretraining with Model-Based Data Selection": a model-based multilingual data-selection pipeline that filters FineWeb/FineWeb2 into a higher-quality subset, improving downstream pretraining. The released FineWeb-HQ / FineWeb2-HQ datasets are widely used (~73K downloads/mo) with community language forks. From Martin Jaggi's MLO lab; the pipeline feeds the Swiss AI Apertus data pipeline (cross-referenced, non-SNAI-branded artifact).