Remix.run Logo
largbae 4 hours ago

Somewhere I read that malware is already starting to use nuclear and biological and cybersecurity terms in the code to trick Fable into shutting down. Even if this is just a hypothetical attack vector so far, it seems likely to work.

jeffmcjunkin 3 hours ago | parent | next [-]

Confirmed: https://socket.dev/blog/mini-shai-hulud-miasma-and-hades-wor...

CuriouslyC 2 hours ago | parent | prev | next [-]

We all need to use nuclear, bio and cybersec terms in all our code to make low quality filtering like this untenable. When you can't work on a resume that has cybersecurity or biology terms in it or reply to a job opening that includes them because the "AI" filtering is so bad that it confuses these for threats, that deserves a collective response, particularly to an IPO'ing company that claims they'll make workers obsolete in two years.

mylifeandtimes an hour ago | parent [-]

That's why I use M-x spook to generate all of my variable names

ofjcihen 4 hours ago | parent | prev | next [-]

Some of the latest versions of Shai Hulud do this. Worked a contract recently where they were having AI check packages for obfuscation before admitting them into Artifactory but had vibed up the logic and it failed open.

So in other words this worked because the terms caused the LLM checker to stall out and then the fail open logic resulted in the package being pulled down.

reeece 3 hours ago | parent [-]

[flagged]

himata4113 4 hours ago | parent | prev | next [-]

I've done this, including the hardcoded refusal strings that already exist in claude code. It won't stop a real attacker, but I still find it really funny when you're trying to use one of the AI tools and it gives you a random refusal and you don't know why, wastes a little bit of time.

pixl97 4 hours ago | parent | prev | next [-]

If ( yellowcake) then { die }

Our future is loonytoons.

3 hours ago | parent | prev | next [-]
[deleted]
cookiengineer an hour ago | parent | prev [-]

Yes, the miasma worm does this since the new Hades campaign.

Note that the 3rd wave now also uses a pth file in pypi packages that _search system wide_ for any index.js or .github/setup.js to find its own payload. It literally splits up the payload on purpose to avoid detection.

Mitigation Tool: https://github.com/cookiengineer/antimiasma

Technical Blog Post: https://cookie.engineer/weblog/articles/malware-insights-mia...