Forum Discussion

Daniel_S_135288's avatar
Daniel_S_135288
Icon for Nimbostratus rankNimbostratus
Nov 26, 2013
Solved

irule to log googlebots

Hello   My goal is to log the googlebot's. I want to log the time and which page was crawled...   Can anybody help me?   Regards   Danisch  
  • IheartF5_45022's avatar
    Nov 26, 2013

    something like (not tested);

    when HTTP_REQUEST {
        set fBot 0
        if {[HTTP::header value "User-Agent"] contains "Googlebot"} {
            set fBot 1
            set ua [HTTP::header value "User-Agent"]
            set uri [HTTP::uri]
        }
    }
    when HTTP_RESPONSE {
        if {$fBot} {
            log local0. "[clock clicks -milliseconds],$uri,$ua,[HTTP::status]"
        }
    }