LMDeploy

library
PJLab
High-performance toolkit for compressing, deploying, and serving LLMs at scale.
GitHubDocumentation

Library

GitHub Repository →
efficiencyframework

Notes

Date approximate.