Hi HN, I'm Mohan from Antigma Labs. Ante is a coding agent that ships as one self-contained ~15MB binary: the TUI, an embedded ripgrep, local PDF/OCR, and a natively managed llama.cpp engine are all inside. No runtime dependencies, no node_modules, no account.<p>- Ante installs a pinned, checksum-verified official llama.cpp build matched to your machine (Metal on Apple silicon; CUDA, Vulkan, or CPU on Linux) and handles upgrades when the pin changes.
- It discovers GGUF files already on disk (~/.ante/models, the llama.cpp and Hugging Face caches), attaches to llama servers already running on local ports, and estimates RAM/VRAM from model size and context window before anything loads.
- `ante --offline-model /path/to/model.gguf "prompt"` boots the server, runs the session, and shuts it down. `/offline-mode` does the same interactively; `ante serve --offline-model` loads a model once for many clients.
- No API key, no account. Once the model is on disk, inference needs no network at all; set ANTE_TELEMETRY=off and no telemetry is exported either.<p>On capability, we'd rather publish the number than oversell: we benchmark local models with the same harness and auditable runs as frontier ones, and Qwen3.6 27B (a 17 GB download) scores 56.2% on Terminal-Bench 2.1 across 445 trials (live results: <a href="https://antigma.ai/eval" rel="nofollow">https://antigma.ai/eval</a>). That's a real gap from frontier models. The design bet is that you mix: hosted providers and local live in the same catalog, `/providers` switches mid-session, so sensitive repos or high-volume work go local and hard problems go frontier.<p>Hosted models work with your own keys or subscription. But nothing about trying Ante requires signing up for anything: download the binary, point it at a GGUF.<p>Offline mode is under active development and has rough edges with the overview at <a href="https://ante.run/local/overview" rel="nofollow">https://ante.run/local/overview</a>. I'll be in the comments.
Not sure why this was dead but I vouched. It would be nice if telemetry was opt-in, otherwise this looks awesome and can't wait to try it!
Why not make it Actually Portable Executable using Cosmopolitan Libc, like Llamafile, to make it run on Windows/Linux/MacOS? Why don't you support Windows with CUDA?
Opt-out telemetry is a hard no for me, sorry.