Remix.run Logo
pixl97 10 hours ago

Panagram is a scam.

colesantiago 10 hours ago | parent [-]

(This is the part where you provide extensive extraordinary evidence to your claim)

rcxdude 37 minutes ago | parent | next [-]

Scam might be too strong a word but it certainly has far higher false positive rates than they are claiming, and their output is at best misleadingly presented: https://freddiedeboer.substack.com/p/i-wouldnt-say-pangram-i...

pixl97 9 hours ago | parent | prev | next [-]

No, they are the ones making claims, especially their CEO saying things like a 1/10000 false positive rate. Their own testing showed a 2% rate, which is insanely high when you talk about the number of papers students turn in. Worse their testing methodology compared it with pre-llm documents and not post llm documents that were human written (much harder and more expensive to verify), by treating language as static.

platinumrad 11 minutes ago | parent | prev [-]

Pangram is subjectively very useful and I personally subscribe, but the burden of proof is on them. The product is very much "trust me bro" and I fear that if they ever try to improve recall both their precision and reputation will tank.