Remix.run Logo
ubermon 5 hours ago

Hi HN, I'm Mohan from Antigma Labs. Ante is a coding agent that ships as one self-contained ~15MB binary: the TUI, an embedded ripgrep, local PDF/OCR, and a natively managed llama.cpp engine are all inside. No runtime dependencies, no node_modules, no account.

- Ante installs a pinned, checksum-verified official llama.cpp build matched to your machine (Metal on Apple silicon; CUDA, Vulkan, or CPU on Linux) and handles upgrades when the pin changes. - It discovers GGUF files already on disk (~/.ante/models, the llama.cpp and Hugging Face caches), attaches to llama servers already running on local ports, and estimates RAM/VRAM from model size and context window before anything loads. - `ante --offline-model /path/to/model.gguf "prompt"` boots the server, runs the session, and shuts it down. `/offline-mode` does the same interactively; `ante serve --offline-model` loads a model once for many clients. - No API key, no account. Once the model is on disk, inference needs no network at all; set ANTE_TELEMETRY=off and no telemetry is exported either.

On capability, we'd rather publish the number than oversell: we benchmark local models with the same harness and auditable runs as frontier ones, and Qwen3.6 27B (a 17 GB download) scores 56.2% on Terminal-Bench 2.1 across 445 trials (live results: https://antigma.ai/eval). That's a real gap from frontier models. The design bet is that you mix: hosted providers and local live in the same catalog, `/providers` switches mid-session, so sensitive repos or high-volume work go local and hard problems go frontier.

Hosted models work with your own keys or subscription. But nothing about trying Ante requires signing up for anything: download the binary, point it at a GGUF.

Offline mode is under active development and has rough edges with the overview at https://ante.run/local/overview. I'll be in the comments.

felooboolooomba 2 hours ago | parent | next [-]

Here you say:

  > Ante installs a pinned, checksum-verified official llama.cpp
But in README:

  > Ante ships its own inference engine
May I suggest you use the first phrasing in both places. I took it as Ante devs had written their own engine and I doubt I'm the only one.
ubermon 2 hours ago | parent | next [-]

there is one toy version https://github.com/AntigmaLabs/nanochat-rs README updated.

ubermon 2 hours ago | parent | prev [-]

the public repo README is updated.

nazgulsenpai 4 hours ago | parent | prev | next [-]

Not sure why this was dead but I vouched. It would be nice if telemetry was opt-in, otherwise this looks awesome and can't wait to try it!

ubermon 3 hours ago | parent [-]

will add those soon!

adastra22 3 hours ago | parent | prev | next [-]

Where is the source code?

ubermon 3 hours ago | parent [-]

for now only some of core crates is migrated, will do so progressively

wwww23 2 hours ago | parent | prev | next [-]

Many people have slow computers, but for agent it is no problem. Only run LLM slow too.

niutech 3 hours ago | parent | prev | next [-]

Why not make it Actually Portable Executable using Cosmopolitan Libc, like Llamafile, to make it run on Windows/Linux/MacOS? Why don't you support Windows with CUDA?

ubermon 3 hours ago | parent [-]

even with power of AI, we are mere human and still slow. Adding this to backlog.

majorchord 4 hours ago | parent | prev [-]

Opt-out telemetry is a hard no for me, sorry.

nextblock 3 hours ago | parent | next [-]

Agreed! When a tool is explicitely marketed for offline use, opt-out telemetry feels especially contradictory. Should Definitely be opt-in by default...

stronglikedan 4 hours ago | parent | prev | next [-]

Right? How hard is it to just ask a single opt-in question during installation. Opt-out just seems lazy, especially if I have to dig though configs to get to it.

ubermon 3 hours ago | parent | prev | next [-]

feedback received, it was carry over from the preview dev build.

abdullahk0634 2 hours ago | parent | prev [-]

[dead]