[ale] sometimes you just need to reboot NOW!

[Pete Hardie]

Shoot the hostage.....


On Tue, Jul 29, 2014 at 11:09 PM, Jim Kinney <jim.kinney at gmail.com> wrote:

> So you're working away and suddenly you get a console error message:
> Kernel: BUG: <fill in your fav thing to break here>
> and that console pukes and locks.
> You're loged in remote over and ssh session and screen. You can't reattach
> to that screen session and then, WHAM, another one pops in and informs you
> also that cpu core #19 has timed out for the past 67 seconds.
>
> and THAT console locks.
>
> Suddenly you get that sinking feeling in the pit of your gut as you realize
> you never did set the ipmi port IP address.
>
> You can ssh in but you have only a few seconds to do something before every
> new session you open locks up.
>
> If you can reboot, you can set the IPMI IP address. But even a remote KVM
> console hangs after you hit the 3-finger-salute and you know shutdown -r
> now will never finish since you have 3 consoles that are hung with that
> one.
>
> Now you're screwed.
>
> But, ah HA! a solution:
>
> If you could send an instant "reboot now and do no shutdown stuff" over an
> new ssh connection, it might get through.
>
> In that case, you want to know these commands:
>
> Force Reboot :
> *#echo 1 > /proc/sys/kernel/sysrq *
>  *#echo b > /proc/sysrq-trigger*
>   If you want to force shutdown machine try this.
> *#echo 1 > /proc/sys/kernel/sysrq*
> *#echo o > /proc/sysrq-trigger*
>
> So you run ssh root at brokenbox.com 'echo 1 > /proc/sys/kernel/sysrq; echo b
> > /proc/sysrq-trigger' and your remote KVM console flashes to green as the
> video disconnects on the reboot. Resume breathing and reach for a tasty
> beverage.
>
> Now set that IPMI IP address...
>
> --
> --
> James P. Kinney III
>
> Every time you stop a school, you will have to build a jail. What you gain
> at one end you lose at the other. It's like feeding a dog on his own tail.
> It won't fatten the dog.
> - Speech 11/23/1900 Mark Twain
>
>
> *http://heretothereideas.blogspot.com/
> <http://heretothereideas.blogspot.com/>*
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <
> http://mail.ale.org/pipermail/ale/attachments/20140729/2f864f78/attachment.html
> >
> _______________________________________________
> Ale mailing list
> Ale at ale.org
> http://mail.ale.org/mailman/listinfo/ale
> See JOBS, ANNOUNCE and SCHOOLS lists at
> http://mail.ale.org/mailman/listinfo
>



-- 
Pete Hardie
--------
Better Living Through Bitmaps
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.ale.org/pipermail/ale/attachments/20140730/69a09e5a/attachment.html>