CyberGym
evalSong-group benchmark: can agents reproduce and discover exploits across 1,507 real-world vulnerabilities from 188 OSS projects? Became a reference eval for offensive-cyber capability tracking in frontier-model safety assessments.
Song-group benchmark: can agents reproduce and discover exploits across 1,507 real-world vulnerabilities from 188 OSS projects? Became a reference eval for offensive-cyber capability tracking in frontier-model safety assessments.