I hosted Kimi K3 (2.8T parameters) using 8 B300s. 92 tok/s, $190 per million tokens

A developer hosted Kimi K3, Moonshot AI's 2.8 trillion parameter model, on 8 NVIDIA B300 GPUs via Modal, achieving 92 tokens per second at $190 per million tokens. Cold boot takes around 27 minutes to load the 1.56 TB model at a cost of roughly $56.79 per hour. The experiment shows frontier-scale inference is now accessible but remains expensive outside managed cloud services.