Well, yes - if the model has been trained/edited to be malicious.
yea definitely wound't run an agent with this on a box with any assets