Forum Discussion

MocoSpace_63233's avatar
MocoSpace_63233
Icon for Nimbostratus rankNimbostratus
Oct 10, 2007

Redirecting User-Agent Googlebot to new pool or server

Ok - simple problem but I am a newbie. We are getting killed with Googlebot-Mobile spiders. Chewing up all ouer connections. We don't want to stop it but ultimately we may want to rate limit it or som...
application delivery
dev
devops
iRules
hooleylist's avatar
hooleylist
Icon for Cirrostratus rankCirrostratus
Mar 19, 2008
Actually, I think I misread your request. You want to rewrite the user-agent header to a static value? If so, you can use something like this:


when HTTP_REQUEST {
   if {$something == 1}{
       Replace the User-Agent header (inserting it if it doesn't exist already)
      HTTP::header replace "User-Agent" "x-bot"
   }
}

Aaron