Software wise there's plenty to choose from already. Ollama/llama.cpp, LM Studio, Lemonade, vllm etc. Anything Apple would bring to the table?

Maybe https://mlx-framework.org

FWIW, Ollama, LM Studio and Lemonade (and oMLX) also wrap Apple's MLX framework.