| ▲ | blinded 12 hours ago | |||||||
I spin up a gpu instance in a cloud, run my model via vllm, connect to it via an ssh tunnel. done. | ||||||||
| ▲ | stuxnet79 12 hours ago | parent [-] | |||||||
Can you elaborate on the first step? Which cloud and which service? What's the cost outlay if you are just having a convo and not doing anything 'agentic'? | ||||||||
| ||||||||