Superposition Yields Robust Neural Scaling

NeurIPS 2025 Best Paper runner-up (Liu, Liu, Gore): a mechanistic account of why loss follows power-law neural scaling laws, tracing it to representational superposition — validated from toy models up to LLMs. A load-bearing interpretability result for the scaling-laws literature.