GenARM

Test-time alignment via an autoregressive reward model (ICLR 2025): token-level rewards guide frozen-LLM decoding without any policy retraining, supporting weak-to-strong guidance (a small reward model steering a much larger base) and multi-objective trade-offs at inference time. From Furong Huang's group.