| ▲ | Ask HN: Slow OpenAI Inference on AWS Bedrock | |
| 2 points by timedude 10 hours ago | 1 comments | ||
Inference on AWS Bedrock for OpenAI models has been very slow and glitchy the last few days with today being the worst. Very long latency of over 5 minutes to first token. What's going on? | ||
| ▲ | timedude 10 hours ago | parent [-] | |
us-east-1 seems to be the worst region right now. | ||