Introduces the concept of **Capacity Density**, a metric to evaluate LLM quality across different scales. The paper identifies an empirical "Densing Law" where LLM capacity density doubles approximately every three months, suggesting exponential gains in efficiency.

Paper

scalingefficiencyresearch

Related