| ▲ | colesantiago 10 hours ago | |
(This is the part where you provide extensive extraordinary evidence to your claim) | ||
| ▲ | rcxdude 38 minutes ago | parent | next [-] | |
Scam might be too strong a word but it certainly has far higher false positive rates than they are claiming, and their output is at best misleadingly presented: https://freddiedeboer.substack.com/p/i-wouldnt-say-pangram-i... | ||
| ▲ | pixl97 9 hours ago | parent | prev | next [-] | |
No, they are the ones making claims, especially their CEO saying things like a 1/10000 false positive rate. Their own testing showed a 2% rate, which is insanely high when you talk about the number of papers students turn in. Worse their testing methodology compared it with pre-llm documents and not post llm documents that were human written (much harder and more expensive to verify), by treating language as static. | ||
| ▲ | platinumrad 12 minutes ago | parent | prev [-] | |
Pangram is subjectively very useful and I personally subscribe, but the burden of proof is on them. The product is very much "trust me bro" and I fear that if they ever try to improve recall both their precision and reputation will tank. | ||