Claude CodeModelsToolsOpen SourceImage and VideoAudioAgentsAppsResearchPeopleCompanies
Tools reddit

Benchmarking DFlash 2 in llama.cpp on Qwen 3.8 27B against all speculative methods

TLDR

A developer ran a 3-day benchmark of Inco AI's DFlash 2 speculative decoding PR in llama.cpp against plain decoding, MTP, n-gram lookup drafters, and the previous DFlash 1 on Qwen 3.8 27B. DFlash 2 introduces a trained drafter specifically for Qwen 3.8 27B and shows meaningful throughput improvements over all comparison methods.

Read the original