I tried to search, could not find anything, do they offer subscriptions? Or only pay per tokens?

I think they don't. I'd wait for the Cerebras release; they have a subscription offering called Cerebras Code for $50/month. https://www.cerebras.ai/pricing