Following up to my March 5, 8:21 AM comment:
I have not yet heard back from Pantheon. I will ping them again today
I am thinking of trying Cloudflare’s Pro Plan ($20/month) . I chatted with them this morning, explained the situation, and pointed them to this discussion.
Person I chatted with was quite knowledgable. He/she said:
there is two option
- you can get the pro plan ($20) and see if the WAF can help eliminate this.
- in the case this does not work you can add Rate limiting, if you can create a rule that stops the exact behaviour of those specific Bots, you are sorted
With the WAF you will be able to do this then
But you will have to create your own rule to block those user agents for instance
You can do this on the pro plan
nonetheless, this is for you to do it, if you are looking for the help of a Solution engineer we have the Enterprise plan for that
If the $20 plan can do this, it’s more than worth it. Not 100% clear how difficult it will be to create the blocking rules, but will see how it goes I guess. Seems like any rule I would do on my Drupal site on Pantheon would disable caching so that’s no good.
This doc confuses me a bit: https://pantheon.io/docs/cloudflare …I guess I would do Option 1?
But anyhow, in a December 19 comment above , Josh said this:
CloudFlare isn’t necessarily a good tool to reduce your usage of Pantheon. I’ve seen them actually increase the amount of pages served from Pantheon due to pre-fetching.
So not sure what the answer is, if that ^ is correct.