LMDeploy

library
PJLab
High-performance toolkit for compressing, deploying, and serving LLMs at scale.
GitHubDocumentation

Library

GitHub Repository

efficiencyframework

Notes

Date approximate.