| ▲ | x3haloed 2 hours ago | |
That’s a traffic design problem. You should be happy that your work is valuable and also protected it against excessive requests. Simple. | ||
| ▲ | primitivesuave 26 minutes ago | parent [-] | |
I deployed a Lambda function behind CloudFront which rendered a simple HTML page with the query results from executing some SQL over the dataset. I served millions of page views for next to nothing because most pages were already in the cache. I don't know where you get this expectation that people should anticipate that a crawler might try every possible combination of query parameters, thereby missing the cache on each one. Most people consider it a bitter and arrogant perspective, which is why this got downvoted. | ||