Check out exo if you haven’t already https://github.com/exo-explore/exo

Thank you! Looks cool

| exo provides multiple API-compatible interfaces for maximum compatibility with existing tools: | | OpenAI Chat Completions API - Compatible with OpenAI clients | Claude Messages API - Compatible with Anthropic's Claude format | OpenAI Responses API - Compatible with OpenAI's Responses format | Ollama API - Compatible with Ollama and tools like OpenWebUI

So a bit higher-level than a virtual device, but yes still pretty neat.