Muon Optimizer

paper library
Moonshot AI
Optimizer based on matrix orthogonalization. Research demonstrating scalability for large language model training.
Paper (arXiv)GitHub

Outputs 2

Muon is Scalable for LLM Training

paper
Citations 1
arXiv HTML

Muon Library

library
GitHub Repository →
trainingoptimization