SimPO

A reference-free preference-optimization method from Danqi Chen's princeton-nlp group (NeurIPS 2024, with UVA): SimPO uses the average log-probability of a sequence as the implicit reward, dropping DPO's reference model entirely. It became a widely adopted DPO alternative (956★) used across many open post-training recipes.