| ▲ | ubermon 5 hours ago | |||||||||||||||||||||||||
Hi HN, I'm Mohan from Antigma Labs. Ante is a coding agent that ships as one self-contained ~15MB binary: the TUI, an embedded ripgrep, local PDF/OCR, and a natively managed llama.cpp engine are all inside. No runtime dependencies, no node_modules, no account. - Ante installs a pinned, checksum-verified official llama.cpp build matched to your machine (Metal on Apple silicon; CUDA, Vulkan, or CPU on Linux) and handles upgrades when the pin changes. - It discovers GGUF files already on disk (~/.ante/models, the llama.cpp and Hugging Face caches), attaches to llama servers already running on local ports, and estimates RAM/VRAM from model size and context window before anything loads. - `ante --offline-model /path/to/model.gguf "prompt"` boots the server, runs the session, and shuts it down. `/offline-mode` does the same interactively; `ante serve --offline-model` loads a model once for many clients. - No API key, no account. Once the model is on disk, inference needs no network at all; set ANTE_TELEMETRY=off and no telemetry is exported either. On capability, we'd rather publish the number than oversell: we benchmark local models with the same harness and auditable runs as frontier ones, and Qwen3.6 27B (a 17 GB download) scores 56.2% on Terminal-Bench 2.1 across 445 trials (live results: https://antigma.ai/eval). That's a real gap from frontier models. The design bet is that you mix: hosted providers and local live in the same catalog, `/providers` switches mid-session, so sensitive repos or high-volume work go local and hard problems go frontier. Hosted models work with your own keys or subscription. But nothing about trying Ante requires signing up for anything: download the binary, point it at a GGUF. Offline mode is under active development and has rough edges with the overview at https://ante.run/local/overview. I'll be in the comments. | ||||||||||||||||||||||||||
| ▲ | felooboolooomba 2 hours ago | parent | next [-] | |||||||||||||||||||||||||
Here you say:
But in README:
May I suggest you use the first phrasing in both places. I took it as Ante devs had written their own engine and I doubt I'm the only one. | ||||||||||||||||||||||||||
| ||||||||||||||||||||||||||
| ▲ | nazgulsenpai 4 hours ago | parent | prev | next [-] | |||||||||||||||||||||||||
Not sure why this was dead but I vouched. It would be nice if telemetry was opt-in, otherwise this looks awesome and can't wait to try it! | ||||||||||||||||||||||||||
| ||||||||||||||||||||||||||
| ▲ | adastra22 3 hours ago | parent | prev | next [-] | |||||||||||||||||||||||||
Where is the source code? | ||||||||||||||||||||||||||
| ||||||||||||||||||||||||||
| ▲ | wwww23 2 hours ago | parent | prev | next [-] | |||||||||||||||||||||||||
Many people have slow computers, but for agent it is no problem. Only run LLM slow too. | ||||||||||||||||||||||||||
| ▲ | niutech 3 hours ago | parent | prev | next [-] | |||||||||||||||||||||||||
Why not make it Actually Portable Executable using Cosmopolitan Libc, like Llamafile, to make it run on Windows/Linux/MacOS? Why don't you support Windows with CUDA? | ||||||||||||||||||||||||||
| ||||||||||||||||||||||||||
| ▲ | majorchord 4 hours ago | parent | prev [-] | |||||||||||||||||||||||||
Opt-out telemetry is a hard no for me, sorry. | ||||||||||||||||||||||||||
| ||||||||||||||||||||||||||