Open-Source Model Reaches 2.8 Trillion Parameters, Claims World's Largest

According to Dongfang Caifu, an open-source model announced it has reached 2.8 trillion parameters, claiming to be the world's largest and most powerful open-source model. This marks the first time an open-source model surpasses 2 trillion parameters, far exceeding previous models like Llama 3.1 405B. For developers and researchers using open-source large models, this means potentially stronger capabilities but also significantly higher hardware and inference costs. A 2.8 trillion parameter model demands immense GPU memory and bandwidth, currently affordable only by very few organizations.