Forum Discussion

Stewart_76633's avatar
Stewart_76633
Icon for Nimbostratus rankNimbostratus
Mar 20, 2013

seeing failover events

When over in the data center recently I noticed on the front panel of our F5's that several active/standby changes had occured between the 3 appliances we have. This was news to me as I'd not seen any events in the logs on the web gui, or anything to suggest there had been problems. Digging a little deeper in the ltm log files I have found several of these messages:

 

 

Mar 20 09:51:47 tmm notice tmm[7157]: 01010029:5: Clock advanced by 4484 ticks

 

Mar 20 09:51:47 tmm info tmm[7157]: 01190004:6: Resuming log processing at this invocation; held 15 messages.

 

Mar 20 09:51:47 tmm warning tmm[7157]: 01190004:4: address conflict detected for 192.168.1.32 (00:23:e9:51:a8:03) on vlan 4094

 

Mar 20 09:51:47 tmm warning tmm[7157]: 01190004:4: address conflict detected for 192.168.1.30 (00:23:e9:51:a8:03) on vlan 4094

 

Mar 20 09:51:47 tmm warning tmm[7157]: 01190004:4: address conflict detected for 192.168.1.51 (00:23:e9:51:a8:03) on vlan 4094

 

Mar 20 09:51:47 tmm warning tmm[7157]: 01190004:4: address conflict detected for 192.168.1.31 (00:23:e9:51:a8:03) on vlan 4094

 

Mar 20 09:51:47 tmm warning tmm[7157]: 01190004:4: address conflict detected for 192.168.1.52 (00:23:e9:51:a8:03) on vlan 4094

 

Mar 20 09:51:47 tmm info tmm[7157]: 01190004:6: Per-invocation log rate exceeded; throttling.

 

Mar 20 09:51:49 dcsltm01 notice sod[4708]: 010c002a:5: Requesting tmm to resend gratuitous arps for traffic group /Common/traffic-group-1.

 

 

Reading around this probably coincides with a failover happening, as the VIP's may have been active in two places and caused a brief conflict.

 

 

I guess my question is this, how do I see when failovers between traffic group members have occured? Is there somewhere I can see the last failover, reasons it happened etc?

 

 

Cheers

 

config
design

6 Replies

Sort By
  • Ajmal_2608's avatar
    Ajmal_2608
    Icon for Nimbostratus rankNimbostratus
    Mar 20, 2013
    Did you check sod messages in the ltm logs?

     

     

    Check this - zgrep sod /var/log/ltm*
  • Stewart_76633's avatar
    Stewart_76633
    Icon for Nimbostratus rankNimbostratus
    Mar 20, 2013
    I have a bunch of these:

     

     

    /var/log/ltm:Mar 20 09:51:49 dcsltm01 notice sod[4708]: 010c002a:5: Requesting tmm to resend gratuitous arps for traffic group /Common/traffic-group-1.

     

    /var/log/ltm:Mar 20 11:11:32 dcsltm01 notice sod[4708]: 010c002a:5: Requesting tmm to resend gratuitous arps for traffic group /Common/traffic-group-1.

     

    /var/log/ltm:Mar 20 13:59:47 dcsltm01 notice sod[4708]: 010c002a:5: Requesting tmm to resend gratuitous arps for traffic group /Common/traffic-group-1.

     

     

    I think the only time it would request a device send a gratuitous arp is when a failure has occured, or would you expect more info?
  • nitass's avatar
    nitass
    Icon for Employee rankEmployee
    Mar 20, 2013
    how do I see when failovers between traffic group members have occured? as Ajmal mentioned, i understand you have to review /var/log/ltm on both units.

    Is there somewhere I can see the last failoveris "uptime" usable? 

    [root@ve11a:Active:In Sync] config  uptime
 00:34:40 up  1:42,  1 user,  load average: 0.00, 0.00, 0.00

    reasons it happened etc?it should be written in /var/log/ltm
    • Prasad_Chowdary's avatar
      Prasad_Chowdary
      Icon for Nimbostratus rankNimbostratus
      Jun 16, 2016
      Hi Stewart, Did you able to fix this issue??? Do you remember what caused this and how to fix this issue??? I am seeing the same issue on my box. Thanks, Prasad
  • nitass_89166's avatar
    nitass_89166
    Icon for Noctilucent rankNoctilucent
    Mar 20, 2013
    how do I see when failovers between traffic group members have occured? as Ajmal mentioned, i understand you have to review /var/log/ltm on both units.

    Is there somewhere I can see the last failoveris "uptime" usable? 

    [root@ve11a:Active:In Sync] config  uptime
 00:34:40 up  1:42,  1 user,  load average: 0.00, 0.00, 0.00

    reasons it happened etc?it should be written in /var/log/ltm
    • Prasad_Chowdary's avatar
      Prasad_Chowdary
      Icon for Nimbostratus rankNimbostratus
      Jun 16, 2016
      Hi Stewart, Did you able to fix this issue??? Do you remember what caused this and how to fix this issue??? I am seeing the same issue on my box. Thanks, Prasad