Remix.run Logo
▲ Lerc 3 hours ago

A Theo vid suggests there's a time to first token issue. When doing subagent actions it can compound to be massive from a bunch of internal short queries.

It really looks like something is broken more than just being inefficient.

▲96khz 3 hours ago | parent | next [-]

are we talking about token prefill here?

▲Lerc 2 hours ago | parent [-]

11 seconds worth?

▲teknologist 3 hours ago | parent | prev [-]

Theo seems to dislike anything that isn't Anthropic Claude. Suspicious, to say the least. On CursorBench, a good measure of real-world coding tasks, Gemini 4 Carbon comes out top: https://cursor.com/evals

▲LiamPowell 2 hours ago | parent [-]

Every time I see a Theo tweet he's judging something on the most absurd metrics. Today for example, he was saying Astra 6.2 is bad because when he gave it a single line prompt telling it to create a new level for a game it used a name for the level that he'd seen before. Judging a model on how often it reuses a name is one of the most ridiculous benchmarks I've ever seen.

As far as I can tell, all his judgements are based on similarly absurd metrics, I don't know why people treat his preferences as valuable.