Codeshare List of user-contributed code snippets for dotCMS Java CMS.

Tagged: "disable crawler traffic"

Disable Crawler Traffic

Author: Chris Falzone | Created: Dec 23, 2011

The following snippet is a urlRewrite rule to disable traffic from a crawler. Just replace crawler agent with the User Agent of the crawler.