All Open items under AI Models on AIFIRST News, newest first. 10 items.
A developer hosted Kimi K3, Moonshot AI's 2.8 trillion parameter model, on 8 NVIDIA B300 GPUs via Modal, achieving 92 tokens per second at $190 per million tokens. Cold boot takes around 27 minutes to load the 1.56 TB model at a cost of roughly $56.79 per hour. The experiment shows frontier-scale inference is now accessible but remains expensive outside managed cloud services.
A developer tested Qwen 3.8 27B against Opus 5 on a hard coding task: porting a 39,000-line procedural shooter written in C to a single-file HTML/Three.js web app. Qwen completed the port and produced a working result. The comparison highlights Qwen 3.8 27B's competitive coding ability for large-scale refactoring work.
A team created Atomic Dynamic GGUF quantizations of Qwen 3.8 27B and compared their performance on a voxel island creation task using an RTX 6000. Results showed strong quality retention across quantization levels. The post shares the quantized files and methodology for running Qwen 3.8 27B locally on consumer hardware.
GLM-4.5-Air, a 106B mixture-of-experts model with only 12B active parameters, now supports Multi-Token Prediction in llama.cpp for a meaningful inference speed boost. The update makes it more practical for users who want a large MoE without requiring multiple high-end GPUs. MTP support is enabled via a configuration flag in the updated build.
A developer used Qwen 3.8 27B to reverse-engineer and document firmware for old hardware, a task that Claude Opus 4 had not been able to complete. Qwen 3.8 27B analyzed the firmware binary, generated documentation, and helped write compatibility shims. The post highlights the model's practical utility for embedded systems and legacy software preservation work.
Liquid AI, known for fast Liquid Foundation Model (LFM) architectures and competitive small language models, is preparing a 100B parameter model release. This would be the company's largest model to date, following its track record of strong performance at smaller parameter counts.
A detailed setup guide documents running Qwen3.8-27B in NVFP4 quantization on a single RTX 5090 under vLLM, achieving 77 tokens/second at short context and 64.7 tokens/second at a real 262K token context window. The post provides reproducible configuration parameters for other 5090 owners targeting long-context local inference.
Palantir CEO Alex Karp publicly accused frontier AI labs of building products designed to create addictive dependency rather than genuine utility, drawing comparisons to drug addiction dynamics. The statement comes amid broader industry debate about engagement-driven business models at OpenAI, Anthropic, and other major labs.
GLM-OCR handles complex tables, code-heavy documents, seals and multilingual layouts with a two-stage layout-then-recognition pipeline. At 0.9B parameters it runs locally via Ollama, vLLM or SGLang.
LLaMA-Factory provides a unified web UI + CLI for fine-tuning LLMs and VLMs without writing custom training code. Supports LLaMA, Mistral, Qwen, DeepSeek, Gemma, Phi, Yi, and 90+ others. Positioned as a no-code altern...
AIFIRST 
