| ▲ | ballon_monkey 3 hours ago | |
Bedrock is really bad. It seems like they don't host the models very well because they produce tons of bugs/errors calling the model. For example you can end up with Anthropic models not returning a stop token and you end up waiting for a timeout thinking its doing something when it isn't. | ||
| ▲ | Betelbuddy 3 hours ago | parent [-] | |
Well Anthropic hosts their models at AWS, ( and at many others...) so maybe the AWS team can ask them how they do it ;-) ? | ||