I've found Pro to be a lot better per "task" than the recently released Flash for code reviews and things (via OpenRouter running in pi.dev).

Flash makes a lot more initial mistakes, and then has to re-check stuff, and produces much more output compared to Pro. It often gets to the correct result eventually, but the output volume is often 5x more than for Pro, and the initial outputs are often wrong, with the first few saying something wrong (like there's a bug, or the code won't compile when it does), and then saying things like "Wait, let me re-check:", or "Actually, looking at it more carefully:" and then it thinks a bit more and eventually gets to the right answer.

▲

swiftcoder 6 hours ago | parent | next [-]

yeah, I've definitely noticed one has to be quite precise to keep Flash on the straight-and-narrow

	▲	RALaBarge 2 hours ago \| parent [-]
		Every plan and every code checkpoint finds me saying "Check with Grok and Fable latest to critique our strategy/code review" with pretty much every model. I havent ran into any deal breakers with the new Flash version yet (like it not running a tool properly or coming back with something completely daft)

▲

surgical_fire 6 hours ago | parent | prev [-]

I use a plan -> implement wotkflow for this reason.

pro plans, flash implements. I am super happy with how flash behaves like that.