Most widely-used open-source model merging toolkit. Supports SLERP, TIES, DARE, linear, and other merge methods. Created by Charles Goddard (now Arcee's Chief of Frontier Research).

Paper

arXiv: 2403.13257

Library

GitHub Repository

open-sourcetraining