CyberGym

Song-group benchmark: can agents reproduce and discover exploits across 1,507 real-world vulnerabilities from 188 OSS projects? Became a reference eval for offensive-cyber capability tracking in frontier-model safety assessments. Its successor, CyberGym-E2E (2026), closes the defensive loop from discovery to patch and anchors Artificial Analysis's Cyber Index.