If you want your site to appear in AI search, allowing crawlers can seem like the obvious choice. But if automated traffic consumes too many server resources, blocking it seems just as reasonable. The problem is treating those two options as mutually exclusive.
