Home / Open Source
Everything under Open Source on AIFIRST News, newest first. 59 items.
mcp-marketplace is an open-source directory of over 880 MCP servers, itself queryable via the MCP protocol. Developers using Claude, Cursor, or Cline can search it directly from their AI client without switching tools. It provides a free, low-friction way to discover and connect MCP integrations.
The ConvRot quantization method, which outperforms standard UDQ8_K_XL in accuracy benchmarks, has been integrated into the llama-cpp-turboquant fork. ConvRot applies a learned rotation to model weights before quantization, reducing the accuracy loss from low-bit formats. The fork is available on GitHub for users who want better quantization quality beyond standard GGUF methods.
illusions-ai is a lightweight, cross-platform local AI inference runtime for JavaScript and TypeScript, with the performance-critical layer written in Rust. It targets developers who want to run models locally without leaving the JS/TS ecosystem. The project is open-source and designed for easy embedding in web and desktop applications.
detect-ai-tells is an open-source agent skill that audits frontends for visual and structural patterns that indicate AI-generated output. It ships with a two-layer evaluation suite to measure detection accuracy across different site types. The tool is aimed at developers and reviewers who need to identify AI-generated interfaces or content in production.
localguard-ai is an open-source document intelligence tool that runs entirely locally and returns cited answers grounded in uploaded documents. It requires human approval before acting on AI-generated recommendations. The project targets privacy-sensitive workflows where sending documents to cloud services is not acceptable.
A developer implemented GPT-2 entirely in pure CMake, the C++ build system language, as an exercise in understanding both systems at a low level. The project generates text using only CMake primitives with no external runtime dependencies. It is a technical curiosity demonstrating CMake's computational completeness rather than a practical inference tool.
Release Oracle is a statistical tool that uses historical AI model release cadences to predict future release dates across major providers including Anthropic, OpenAI, Google, and Meta. It tracks trends in release timing to give researchers and developers a reference for planning around upcoming models. The site is free and updated as new releases occur.
The r/LocalLLaMA community monthly roundup for August 2026 reports the strongest period for open-weight models yet, with several reaching frontier-competitive performance on consumer hardware. Multiple Opus-class capable models are now reportedly runnable without extreme hardware setups, marking a measurable shift in local AI accessibility.
A hobbyist expanded their homelab DGX Spark cluster from 16 to 36 units, resulting in 4.6TB of unified memory across a single server rack. The build is among the largest documented consumer-grade local AI inference setups.
A developer fine-tuned Gemma 4 12B targeting tool calling for agentic coding use cases, achieving a 2.7x improvement over the base model. The fine-tune addresses documented weaknesses in the stock model's tool use accuracy, making it more viable for local coding assistant workflows.
A developer ran a 3-day benchmark of Inco AI's DFlash 2 speculative decoding PR in llama.cpp against plain decoding, MTP, n-gram lookup drafters, and the previous DFlash 1 on Qwen 3.8 27B. DFlash 2 introduces a trained drafter specifically for Qwen 3.8 27B and shows meaningful throughput improvements over all comparison methods.
A benchmark comparison pits the quantized Qwen3.8 27B (Q8_K_XL format) against the BF16 Qwen3.6 27B on coding tasks. Results help users decide whether the newer model's quantized variant is worth the upgrade from the previous generation on VRAM-constrained hardware.
A developer released a llama.cpp fork with HIP optimizations targeting AMD GFX906-class GPUs including the Mi50, Mi60, Radeon VII, and GCN HIP cards. These cards have minimal support in the mainline llama.cpp codebase, leaving many AMD users without an optimized inference path.
energygraph v1.3 adds discrete GPU power monitoring for NVIDIA, Intel, and AMD cards, extending the tool beyond its previous CPU-only scope. The tool is open-source with zero build dependencies and displays live power consumption data directly in the terminal.
A developer built a bidirectional neural translator between English and Claudish, the characteristic language patterns Claude uses, using the ProgramAsWeights framework. Both translation directions are compiled neural programs that run on CPU without a GPU requirement.
A recent ComfyUI update modifies tokenizer handling in a way that changes how MiniMax H3 interprets prompt formatting. Users relying on established prompt templates for H3 may need to review and adjust their workflows after updating.
lylogummy released Anima-3.8B paired with Qwen-3.5 4B, a new image-video generation model available on Hugging Face. A dedicated ComfyUI custom node is provided for integration into standard generation workflows.
Fizgig v4.3.0 adds AMD Radeon support via ROCm, covering RDNA1 through RDNA4 GPUs, for LoRA training on Flux 2 Klein, Krea 2, and MiniMax H3. Previously NVIDIA-only, the free open-source tool now provides an AMD-native training path on Windows.
remember is a self-hostable, private memory system that indexes documents, articles, and sources a user reads, then provides AI answers with citations when queried. The tool runs entirely on the user's own infrastructure and is positioned as a private alternative to cloud-based knowledge management services.
A Level1Techs forum post systematically examines why locally hosted LLMs often underperform cloud counterparts despite similar benchmark scores. Key contributing factors include quantization artifacts, suboptimal sampling parameters, context window configuration defaults, and system prompt differences that compound to a significant capability gap in practice.
nRouter SDK puts a single API key and one interface in front of six cloud model providers: Alibaba US, OpenAI, AWS Bedrock, Azure Foundry, Google Vertex AI, and Anthropic. It speaks both the OpenAI and Anthropic wire formats natively and covers chat completions, embeddings, images, text to speech, speech to text, and video. Branded packages ship for Python, JavaScript, Java, Rust, and R, with OpenAI-compatible paths for Go, Ruby, PHP, and C#. Framework integrations include LangChain, LlamaIndex, Vercel AI SDK, CrewAI, and AutoGen.
Parallax is a self-hosted platform that ingests video up to two hours long and produces timestamped transcripts, chapter segmentation, summaries, key-point extraction, and question answering grounded in citations. It runs Faster-Whisper for transcription, 384-dimensional sentence-transformer embeddings in PostgreSQL with pgvector, Celery and Redis for async task queues, and a React 18 front end. The author reports 101 Pytest and 25 Vitest tests passing with no static analysis errors. The project is local only and not cloud hosted.
AI-Researcher is a self-hosted Python 3.11 dashboard that pulls AI news from roughly 60 sources including RSS, Reddit, Hacker News, arXiv, Hugging Face, GitHub, Google News, and X. It deduplicates and clusters items with optional nomic-embed-text embeddings and ranks them with engagement normalization that weights corroboration across sources. A local Ollama model summarizes the high-priority items. All processing is local with no mandatory third-party API keys. The repository had 4 commits and 0 stars when checked.
Proliferate is an open-source AI development environment that coordinates Claude, Codex, OpenCode, Cursor, and Grok working in parallel on one codebase. Each task gets its own isolated git worktree with a separate branch, terminal, conversation, and review state, and agents can delegate to child agents within a shared workspace. It supports MCPs, skills, custom tools, and automated workflows for recurring or event-driven runs. The repository shows 266 stars, 54 forks, and 2,904 commits, is AGPL-3.0 licensed, and ships deployment guides for Docker, AWS, GCP, and Azure.
Bun 1.4 is the first release built on a Rust rewrite of the runtime, which Bun says Claude Code has run in production for months. The release reports p99 CPU in Claude Code production falling from 24% to 10%, idle CPU down 5x for small apps, and Windows startup at 15.5 ms against 39.0 ms before. It adds built-in APIs including Bun.Image, Bun.WebView for headless browser automation without Puppeteer or Playwright, Bun.markdown, Bun.cron, and Bun.Terminal, plus bun test flags for parallel, isolated, and sharded runs. Node compatibility work added 1,517 tests from the Node suite, with node:http, node:fs, node:stream and other core modules passing 97% of them.
llama.cpp is a C/C++ implementation of large language model and vision language model inference, built on the ggml tensor library and MIT licensed. It ships a command line interface, an OpenAI-compatible API server, and a web chat UI, installable as an app, via Docker, from pre-built binaries, or from source. Backends cover Apple Silicon with ARM NEON, Accelerate and Metal, x86 with AVX through AVX512 and AMX, NVIDIA CUDA, AMD HIP, Vulkan and SYCL, plus hybrid CPU and GPU inference. The repository showed 124.9k stars and 22.0k forks with 778 open issues and roughly 1.4k open pull requests, and quantization spans 1.5-bit to 8-bit so output quality depends on the level chosen.
Story Labyrinth is a self-hosted web app for fiction writers that combines a rich-text editor with a codex system tracking character wardrobe, wounds, and custom fields with full history. It uses hybrid RAG indexing via SQLite FTS5 and optional local embeddings to scan manuscripts, and provides six specialized chat desks for world-building, outlining, research, editing, brainstorming, and notes. All AI suggestions go through a propose-approve workflow to prevent silent modifications. Built with Express.js, React 19, and TypeScript under AGPL-3.0, with 787 commits despite 0 public stars.
DocsTerminal is a TypeScript monorepo published to NPM that lets documentation sites embed an interactive terminal widget supporting real shell execution, Python via Pyodide, WebAssembly binaries for Rust and C, and server-side execution via WebSocket. It ships as one package with nine entry points and integrates multiple AI providers including Anthropic and OpenAI-compatible endpoints. A live demo is available at docsterm.vercel.app. Licensed MIT with 7 commits and an NPM-published package.
Airlock is an open-source release engineering tool written in Go that treats AI components (prompts, skills, MCP servers, models) as versioned releasable units inside a CI/CD pipeline. It detects behavioral changes between snapshots, runs statistical evaluation against a policy engine, and outputs PASS/FAIL/NEEDS_APPROVAL verdicts to block or approve a release. Licensed Apache 2.0 with a CLI covering init, snapshot, diff, test, and ci subcommands.
Huzzah is an experimental editor that uses pseudocode files (.hz) instead of natural language prompts to direct AI code generation. When a .hz file is saved, Huzzah generates real code; subsequent edits capture only the diff, reducing token consumption and preserving a persistent record of developer intent. The approach positions coding as design, with specs that are language-agnostic and reusable across multiple implementation targets. The author notes limitations including scalability concerns and challenges with cross-file dependencies.
TrueForge is an open-source runtime framework that manages the execution loop for LLM-powered agents, handling model calls, MCP tool integration, sandboxing, approvals, context management, and session state. It supports multiple model providers including OpenAI, Anthropic, and Google Gemini, and offers a chat UI, HTTP API, and embeddable UI components. Deployment options range from local SQLite for personal use to Postgres and Redis for team deployments. The repository has 419 commits and includes benchmarking data comparing it against competing frameworks.
Vomit is a small open-source tool that intercepts Claude agent mode's intermediate reasoning output and pipes it through a local LLM to produce more readable English summaries. It runs fully locally with no telemetry, supports Llama.app and Ollama backends, and can be used either as an integrated hook replacing Claude's displayed output or as a standalone session monitor via the 'vomit tail' command. The tool targets the verbosity of Claude's token output during agentic tasks.
Obfuscation fonts designed to confuse AI scrapers are ineffective because any information a human can see can in principle be parsed by a machine. The author argues these tools harm accessibility by garbling text that screen readers process, and that public demonstrations serve as benchmarks that help AI companies improve circumvention. The piece warns that widespread adoption could pressure platforms toward centralized identity verification systems, creating risks for disabled users and enabling censorship.
Francisco Trindade argues that AI tools have raised rather than eliminated the value of junior engineers by reducing the senior time needed to train and onboard them. Junior engineers who started their careers with AI tools are, the author contends, better positioned to leverage those tools than their seniors. One concrete example given is an intern who independently led a long-requested feature from conception to delivery.
Shoehorn is a locally run, browser-based tool that quantizes language models with hardware-aware mixed precision, assigning a precision level per tensor rather than applying a preset and targeting about 99.99% of available memory. It scans popular Hugging Face models to work out what fits a given machine and writes standard GGUF v3 files for llama.cpp. It supports macOS on Apple Silicon, Linux on x86-64, and Windows on x86-64. The quantizer core is written from scratch in Rust.
headroom sits between agent and LLM, compressing tool outputs, logs, RAG chunks, files and history before they hit the model, claiming the same answers on far fewer tokens. Stars went vertical as model costs rose.
A library of real product flows you can click through to study empty states, transitions and microcopy. Can extract design tokens and connect to Claude via MCP to recreate any screen. Currently free.
Claude confidently invents sources, stats and quotes unless instructed otherwise. The fix treats honesty as an operating rule: separate verified facts from guesses, flag uncertain stats and label unverifiable claims.
A team tool that visualizes and shares Claude Code conversation threads: decision maps, team presence, and RAG over all threads to ask how a feature was built. Aims at the 'did you even read your own PR' review problem.
A beginner distilled 50 debugging prompts down to five that work. Highest leverage: the 'assume you're wrong' prompt asking for three alternative causes, and a self-review prompt that gets past Claude's first-guess.
A commercial MCP server covering email, OTP extraction, stealth browsing, meeting joins and mail RAG. Standout pattern: a zero-knowledge credential vault where the server fills login forms and the LLM never sees the.
DataMoat auto-captures session files from Claude CLI, Codex, Cursor and OpenClaw, normalizes them into a common schema and encrypts with AES-256-GCM. Thesis: AI work traces are private data assets worth preserving.
A free tool scores any URL on 8 AI-relevance signals and generates a ready /llms.txt file. The four pillars: clean HTML, JSON-LD structured data, a robots.txt that permits AI bots, and llms.txt.
A 6-step method distills a book's repeatable framework into a SKILL.md slash command using five extraction questions. Only books with numbered-step frameworks work; big books split into diagnose and apply skills.
`google-surf-mcp` - TS/Playwright stealth MCP, no API key. 4 tools: `search`, `search_parallel`, `extract(url)`, `search_extract(query)` (search + article extraction in one call). Auto CAPTCHA recovery: Chrome opens v...
Official MCP server from X's developer platform org (`xdevplatform`). 150+ tools covering posts, search, DMs, user ops, bookmarks, analytics. Python/FastMCP, runs on localhost:8000/mcp. Key feature: tool allowlist - d...
Adding 'no hedge words' to a prompt strips uncertainty framing that RLHF-trained models lean on, forcing commitment to specific claims. One test dropped an AI-detector score from 0.91 to 0.18 on a rewritten cold email.
A curated toolkit targets different token-waste vectors: output verbosity, terminal noise, code review context, tool output overflow, CLAUDE.md bloat, codebase loading via vector search, and symbol navigation.
Static SKILL.md files dump full context up front and cause drift in complex workflows. The alternative: encode workflows as MCP-delivered decision trees where the agent sees one step at a time and server-side logic.
An MCP server that indexes a codebase once with tree-sitter and lets agents retrieve exact functions and symbols instead of reading whole files.
Python wrapper for ByteDance's Seedance 2.0 (delivered via muapi.ai). Supports text-to-video, image-to-video, video extension, character sheet generation, omni-reference (image+video+audio in one call). 2K output, 16:...
PenClaw runs an uncensored LLM on H100 hardware with 128K context and 50+ tools including nmap, nuclei and SQLmap. One command triggers recon, scanning, exploitation and reporting. Hosted at $20 per month.
DeepTutor lets you upload textbooks/PDFs and creates a personal AI tutor with 10,300 GitHub stars. Positioned as free alternative to tutors/Coursera. Comments mostly skeptical - concerns about hallucinations, low-effo...
A satirical debunk shows viral token-reduction math ignores output tokens, cache writes and multi-turn costs. The real point: retrieval is largely solved, persistent memory across sessions is the unsolved problem for.
Snipboard captures multiple screen regions in sequence and batch-copies them as Markdown image links, so one paste gives Claude full visual context. Windows, offline-first, with a $9.99 Pro tier.
codeburn reads Claude Code project JSONL files and breaks down where tokens go. The author found 56% of weekly spend was conversation turns with zero tool use, while actual coding accounted for only 20%.
Claude's built-in MCP connectors allow direct Gmail, Calendar, Notion, HubSpot and Stripe access without writing code, with a roughly 2-minute setup per tool. Popular use: automated morning briefings.
AIFIRST 
