<html><head><base href="x-msg://492/"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">A few questions I have:<div><br></div><div>What type of bond method are you using? round robin, active passive, etc cat /proc/net/bonding/bond0</div><div><br></div><div>What is the uplink switch and do you have logs on it that you can check for when the interfaces went down?</div><div><br></div><div>I've seen in our environment that round-robin simply doesn't work with the switch configuration and causes interfaces to flap. We use active-passive bonding for all of our servers.</div><div><br></div><div>Joey</div><div><br></div><div><div><div>On Sep 15, 2010, at 5:11 PM, Lightner, Jeff wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><span class="Apple-style-span" style="border-collapse: separate; font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; font-size: medium; "><div lang="EN-US" link="blue" vlink="purple"><div><div class="Section1" style="page: Section1; "><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">Can anyone tell me what the below messages mean? I didn’t find many hits on the web:<o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; "><o:p> </o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">Sep 14 13:15:45 atlrdtd1 avahi-daemon[6709]: Interface bond0.IPv6 no longer relevant for mDNS.<o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">Sep 14 13:15:45 atlrdtd1 avahi-daemon[6709]: Leaving mDNS multicast group on interface bond0.IPv6 with address fe80::204:23ff:feba:f120.<o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">Sep 14 13:15:45 atlrdtd1 avahi-daemon[6709]: Interface bond0.IPv4 no longer relevant for mDNS.<o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">Sep 14 13:15:45 atlrdtd1 avahi-daemon[6709]: Leaving mDNS multicast group on interface bond0.IPv4 with address 192.168.8.73.<o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">Sep 14 13:15:45 atlrdtd1 avahi-daemon[6709]: Withdrawing address record for fe80::204:23ff:feba:f120 on bond0.<o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">Sep 14 13:15:45 atlrdtd1 avahi-daemon[6709]: Withdrawing address record for 192.168.8.73 on bond0.<o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">Sep 14 13:15:45 atlrdtd1 avahi-daemon[6709]: New relevant interface bond0.IPv4 for mDNS.<o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">Sep 14 13:15:45 atlrdtd1 avahi-daemon[6709]: Joining mDNS multicast group on interface bond0.IPv4 with address 192.168.8.73.<o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">Sep 14 13:15:45 atlrdtd1 avahi-daemon[6709]: Registering new address record for 192.168.8.73 on bond0.<o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">Sep 14 13:15:45 atlrdtd1 avahi-daemon[6709]: Interface eth2.IPv6 no longer relevant for mDNS.<o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">Sep 14 13:15:45 atlrdtd1 avahi-daemon[6709]: Leaving mDNS multicast group on interface eth2.IPv6 with address fe80::204:23ff:feba:f120.<o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">Sep 14 13:15:45 atlrdtd1 avahi-daemon[6709]: Withdrawing address record for fe80::204:23ff:feba:f120 on eth2.<o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">Sep 14 13:15:45 atlrdtd1 kernel: bonding: bond0: Interface eth2 is already enslaved!<o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">Sep 14 13:15:45 atlrdtd1 avahi-daemon[6709]: Interface eth3.IPv6 no longer relevant for mDNS.<o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">Sep 14 13:15:45 atlrdtd1 avahi-daemon[6709]: Leaving mDNS multicast group on interface eth3.IPv6 with address fe80::204:23ff:feba:f120.<o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">Sep 14 13:15:45 atlrdtd1 avahi-daemon[6709]: Withdrawing address record for fe80::204:23ff:feba:f120 on eth3.<o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">Sep 14 13:15:45 atlrdtd1 kernel: bonding: bond0: Interface eth3 is already enslaved!<o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">Sep 14 13:15:47 atlrdtd1 avahi-daemon[6709]: New relevant interface bond0.IPv6 for mDNS.<o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">Sep 14 13:15:47 atlrdtd1 avahi-daemon[6709]: Joining mDNS multicast group on interface bond0.IPv6 with address fe80::204:23ff:feba:f120.<o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">Sep 14 13:15:47 atlrdtd1 avahi-daemon[6709]: Registering new address record for fe80::204:23ff:feba:f120 on bond0.<o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; "><o:p> </o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">Background: <o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">We have an Oracle RAC cluster of 2 nodes. Yesterday one of the nodes rebooted and its log indicates that Oracle forced the reboot to preserve cluster integrity. There were no other messages in that node’s /var/log/messages near the time of this message and reboot. <o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; "><o:p> </o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">We use a private lan setup on 2 bonded NICs on each side for the Oracle Cluster Ready Services to communicate with each other. That is bond0 and is using 2 Intel GigE NIC ports on both sides (eth2 and eth3 are the NICs). We found that the connectivity on the private lan had gone away and on checking found that both eth2 and eth3 on the node that got these messages was showing no link. Running “ifdown bond0” followed by “ifup bond0” re-established links on both eth2 and eth3.<o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; "><o:p> </o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">The above messages occurred on the node where bond0’s links were down less than 2 minutes before the node that rebooted issued the message about shutting down to preserve cluster integrity. It seems fairly clear the cause of the reboot was the loss of connectivity but I can’t really determine from the above log entries WHY bond0 went down. So was hoping someone had seen something like this and could give me a clue. <o:p></o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; "><o:p> </o:p></span></font></div><div style="margin-top: 0in; margin-right: 0in; margin-bottom: 0.0001pt; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman'; "><font size="2" face="Arial"><span style="font-size: 10pt; font-family: Arial; ">P.S. We don’t actually use the ipv6 – the relevant addresses are the ipv4 ones. Apparently the guy who set this up didn’t disable ipv6 on these NICs but I don’t believe that is the issue as they have been up for a few months with this configuration.<o:p></o:p></span></font></div></div></div><div> </div><div><font face="Arial" size="2">Proud partner. Susan G. Komen for the Cure.</font></div><div> </div><div><font face="Arial" color="green" size="1"><em>Please consider our environment before printing this e-mail or attachments.</em></font></div><div style="font-size: 9pt; font-family: 'Courier New'; "><font face="Arial" size="2">----------------------------------<br>CONFIDENTIALITY NOTICE: This e-mail may contain privileged or confidential information and is for the sole use of the intended recipient(s). If you are not the intended recipient, any disclosure, copying, distribution, or use of the contents of this information is prohibited and may be unlawful. If you have received this electronic transmission in error, please reply immediately to the sender that you have received the message in error, and delete it. Thank you.<br>----------------------------------<br></font></div>_______________________________________________<br>Ale mailing list<br><a href="mailto:Ale@ale.org" style="color: blue; text-decoration: underline; ">Ale@ale.org</a><br><a href="http://mail.ale.org/mailman/listinfo/ale" style="color: blue; text-decoration: underline; ">http://mail.ale.org/mailman/listinfo/ale</a><br>See JOBS, ANNOUNCE and SCHOOLS lists at<br><a href="http://mail.ale.org/mailman/listinfo" style="color: blue; text-decoration: underline; ">http://mail.ale.org/mailman/listinfo</a><br></div></span></blockquote></div><br></div></body></html>