Tagged: "Disable Crawler Traffic"

Disable Crawler Traffic

The following snippet is a urlRewrite rule to disable traffic from a crawler.  Just replace crawleragent with the User Agent of the crawler. The...