CPM-2

A large-scale cost-effective pre-trained language model series (up to 198B parameters) that introduced Mixture-of-Experts (MoE) and multilingual capabilities. Supported by BAAI, it achieved state-of-the-art results on both Chinese and English tasks while maintaining computational efficiency.