| ▲ | CharlieDigital 2 hours ago |
| There's nothing particularly special about Lambda's scaling. You can do the same with GCP Cloud Run[0] or Azure Container Apps[1] Specify the maximum number of allowed instances and maximum concurrency per instance. Optionally configure more targeted scale rules. It will scale it from 0 - n as needed. [0] https://docs.cloud.google.com/run/docs/about-instance-autosc... [1] https://learn.microsoft.com/en-us/azure/container-apps/scale... |
|
| ▲ | badatnames 2 hours ago | parent [-] |
| So long as you don't count >2 orders of magnitude difference in scaleup time as particularly special.. |
| |
| ▲ | CharlieDigital 2 hours ago | parent [-] | | That's not how it works since each instance can handle multiple requests (up to 1000 per instance). So you may set this to scale at say 75% load level. Indeed if you configured each instance as a single threaded handler, you will not have fun. | | |
| ▲ | badatnames 41 minutes ago | parent [-] | | That's only how it works when misapplying mean() to characterise application performance. In your scenario, every request is hitting either an overloaded instance, or when scaled down, a 20-30 second wait for spin up, better hope they're neither interactive nor some jobs configured with a short timeout. The mechanisms are so completely different they're hard to even make meaningful comparisons between |
|
|