Would it work locally on a Mac Pro M4 24gb? If so I'd really appreciate a step-by-step guide.

These E2B and E4B models are very small so that they can fit into phones with around 8gb of RAM. You can get away with a much larger model. Just run:

    brew install ollama 

    ollama run gemma4:26b-a4b-it-q4_K_M