I built a router that lets you route between local and cloud models. Link in my profile.

▲ embedding-shape an hour ago | parent [-]

Yeah, I also built my own "router" for this:

    if (process.env.LOCAL_MODEL {
      http('localhost:3000/v1/completions')...
    } else {
      http('api.openrouter.ai/v1/completions')...
    }

	▲	nvme0n1p1 an hour ago \| parent [-]
		Brilliant! I'd like to invest $10M. Who should I make the check out to?