| ▲ | consumer451 5 hours ago | |
Ignorant questions for you and anyone else using DS: 1. who hosts the inference 2. which harness are you using with it, still CC? | ||
| ▲ | oulu2006 5 hours ago | parent | next [-] | |
So everyone has their preferred way of doing it. 1. I go direct to source, i.e. DS platform, I find it cheaper than paying the openrouter tax -- I also switch it up a bit 2. I built a local LLM router, that I update with new profiles that have my preferred provider of the week (lowest token costs/speed) with fallbacks, like mimo --> DS4 etc.. if there is overloading, 3. I use 3 diff harnesses, CC/Codex + Opencode -- they all talk to each other through a custom rig system that routes messages between llms using a Rust backed structured JSON system Not saying this is the best, it's just what I like and works for me^. I can flow quite naturally between Opus/Astra/K3/GLM/MiMo/DS/etc.. this way and often do...more so these days with subs no longer great as they used to be. | ||
| ▲ | pavo-etc 5 hours ago | parent | prev [-] | |
Whatever openrouter puts me on, running in pi (though I do all comms over my xmpp wrapper). | ||