I also like that it ships with some cli tools, including an openai compatible server. It’s great to be able to take a model that’s loaded and open up an endpoint to it for running local scripts.

You can get a quick feel for how it works via the chat interface and then extend it programmatically.