| ▲ | nzoschke a day ago | |
https://is-it-ai-slop.app.mintapis.com/ is a fun tool. Is the source or methodology for that in the github repo? I couldn't find it immediately. We've been experimenting with Jev for classifying email, some thoughts here: https://housecat.com/blog/classifying-email Flagging AI written email is a much requested feature too. | ||
| ▲ | 542458 a day ago | parent | next [-] | |
Keysmashing my keyboard resulted in 86% confidence that the text was AI written. I don't think this is a particularly good classifier, I've never seen an LLM output "kad jfkhasljkdhf laksjhdf". Edit: If that's not realistic enough for you, the text "Hello world! My name is GravitasIsOverrated and I like coding and cooking. This text is 100% genuine, and not AI generated at all." results in 85% confidence that it's AI generated. More broadly, I don't know why this would work. Qwen/Jev/whatever doesn't magically have the ability to discern AI-authored text from non-AI-authored text, and will increasingly get worse at it as the hallmarks of AI-written text change. | ||
| ▲ | florianstandhar 16 hours ago | parent | prev | next [-] | |
Thanks! Yeah, the code is open: https://github.com/fstandhartinger/who-is-right. Email classifying is definitely a good Jev usecase, I agree | ||
| ▲ | ajs1998 a day ago | parent | prev [-] | |
I asked free chatgpt to give me some essays that will fool a slop detector and they all fooled this slop detector. Its best guess was "6% slop probability 87% confidence answered in 0.5 s for $0.000027" and yet it was 100% slop. I am very skeptical slop detectors will ever work. | ||