Remix.run Logo
freehorse 2 days ago

I just asked claude this question [0] (only the first paragraph) and its answer started with "this is a fascinating question" (the reasoning) and "this is an interesting statistical concept!" (non-reasoning). It continued with saying this technique is known as "sorted regression" and is used in "optimal transport theory", and overall it was not clear in that this should not be used as an actual regression.

I tried also several SOTA(ish) models and claude's answer was definetely the worst (most sycophantic/bullshitty, and used too much non-sense jargon). Even llama maverick's answer was way better.

It surprises me because I would expect, as stackexchange sites are in the training data, this question to be pretty much answered based on the actual answers there. It could also be that they try to overcorrect for some negativity sometimes there (imagine if the model answered to you that they will not answer your question because it has been already answered before, or because it is not a good question).

I think I stop using claude after this for asking questions.

[0] https://stats.stackexchange.com/questions/185507/what-happen...