There have definitely been times when I've cloned repos that were vibed, pointed my own agent at it, and then hacked up whatever changes I've wanted. I don't think there's been a single time that a lack of prompts has caused any issues, but there have been at least a few times where stuff like AGENTS.md checked into the repo has caused hiccups from them encoding stuff that conflicts with how I want things done.