LLaMA Pro

model
Tencent
Progressive LLaMA with block expansion, enabling post-pretraining domain knowledge injection without catastrophic forgetting. Published at ACL 2024.
Paper (arXiv)GitHubHuggingFace

Paper

Venue ACL 2024
arXiv HTML

Library

GitHub Repository →
nlptrainingresearch