I think any of the decent open models that would be useful for this claw frency require way more ram than any Mac Mini you can possibly configure.

The whole point of the Mini is that the agent can interact with all your Apple services like reminders, iMessage, iCloud. If you don’t need any just use whatever you already have or get a cheap VPS for example.