Remix.run Logo
▲ JulianPaul 2 hours ago

Why is this better than running Opus 5.5 directly against my app with a custom Playwright-based harness for in my own subscription?

▲MGabrielDenton 2 hours ago | parent | next [-]

Hey I'm Gabe (one of the engineers @Momentic). In general Mo's advantage is in the total amount of bugs found. In comparison to claude code we find roughly 5x as many bugs at 35% less per bug (for the 60 min session).

▲rheisen_ 16 minutes ago | parent | next [-]

Then stock claude code??? that's like... the lowest of bars.

▲cacio-e-pepe 2 hours ago | parent | prev [-]

Thoughts on the bitter lesson? Eg what if models just keep getting better?

▲MGabrielDenton 2 hours ago | parent [-]

Good question, in short our harness & e2e tests act as compliments with the frontier rather than competitors. Architectural choices and data you provide really matter for domain specific tasks. Mo will be working with harness specific tooling like: previous momentic test results, our KB, and eventually creating new Momentic regression. Having smarter/more capable models will improve the efficiency of AI generated tests (coverage/runtime) and ideally do less repetition in exploratory testing.

▲mikert89 2 hours ago | parent | prev [-]

[flagged]