So, silly question, does this mean I will be able to get OpenAI models via Bedrock soon?

Likely, and via vertex on gcp (or whatever they are calling it this year).

Which also means, if you are a big boring AWS or GCP shop, and have a spend commitment with either as part of a long term partnership, it will count towards that. And, you won't likely have to commit to a spend with OpenAI if you want the EU data residency for instance. And likely a bit more transparency with infra provisioning and reserved capacity vs. OpenAI. All substantial improvements over the current ways to use OpenAI in real production.