Remix.run Logo
bcherny 3 hours ago

From the contents of the issue, this seems like a fairly clear default effort issue. Would love your input if there's something specific that you think is unaddressed.

DennisL123 4 minutes ago | parent | next [-]

Gotcha. It seemed though from the replies on the github ticket that at least some of the problem was unrelated to effort settings.

JamesSwift an hour ago | parent | prev | next [-]

I commented on the GH issue, but Ive had effort set to 'high' for however long its been available and had a marked decline since... checks notes... about 23 March according to slack messages I sent to the team to see if I was alone (I wasnt).

EDIT: actually the first glaring issue I remember was on 20 March where it hallucinated a full sha from a short sha while updating my github actions version pinning. That follows a pattern of it making really egregious assumptions about things without first validating or checking. Ive also had it answer with hallucinated information instead of looking online first (to a higher degree than Ive been used to after using these models daily for the past ~6 months)

dev_l1x_be 34 minutes ago | parent [-]

It hallucinated a GUID for me instead of using the one in the RFC for webscokets. Fun part was that the beginning was the same. Then it hardcoded the unit tests to be green with the wrong GUID.

vecter 2 hours ago | parent | prev [-]

From this reply, it seems that it has nothing to do with `/effort`: https://github.com/anthropics/claude-code/issues/42796#issue...

I hope you take this seriously. I'm considering moving my company off of Claude Code immediately.

Closing the GH issue without first engaging with the OP is just a slap in the face, especially given how much hard work they've done on your behalf.

wonnage 2 hours ago | parent [-]

The OP “bug report” is a wall of AI slop generated from looking at its own chat transcripts

vecter an hour ago | parent [-]

Do you disagree with any of the data or conclusions?