▲ | AlexAndScripts 3 days ago | |
Amazon Bedrock supports Claude 3.5, and you can use inference profiles to split it across multiple regions. It's also the same price. For my use case I use a hybrid of the two, simulating standard rate limits and doing backoff on 529s. It's pretty reliable that way. Just beware that the European AWS regions have been overloaded for about a month. I had to switch to the American ones. |