MOPD (Multi-Teacher On-Policy Distillation)

Library/technique for distilling intelligence from multiple teacher models into smaller student models.