AIFIRST Qwen3.8-Flash-Next multi-token prediction merged into ik_llama.cpp, doubles throughput
The brief
The ik_llama.cpp fork merged multi-token prediction support for Qwen3.8-Flash-Next via PR #2369, pushing throughput from roughly 45 to 90 tokens per second on compatible hardware.
Key points
- The change is now on main and requires no fork or patch.
- Users can use either an integrated head or a separate model file for MTP.
Sources
- redditreddit.com