Kimi K3.1 Pro is 2.8 trillion parameters and about 1.56 TB of weights
Running it locally could take a server with eight Nvidia B300 GPUs.
Following Moonshot AI's release of the Kimi K3.1 Pro weights on Hugging Face, Chubby (@kimmonismus) laid out what running it would take.
Per the post, the model has 2.8 trillion parameters and the weights reportedly take up about 1.56 TB. One possible local setup is a server with eight Nvidia B300 GPUs and 2.3 TB of GPU memory.
The breakdown drew about 693 likes.
